[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:57:44.437763   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:32983
I20260709 12:57:44.439313   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:57:44.440358   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:44.458700   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:44.458997   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:44.461318   431 server_base.cc:1061] running on GCE node
W20260709 12:57:44.459452   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:45.660338   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:45.660591   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:45.660744   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601865660728 us; error 0 us; skew 500 ppm
I20260709 12:57:45.661528   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:45.666838   431 webserver.cc:533] Webserver started at http://127.0.107.254:38501/ using document root <none> and password file <none>
I20260709 12:57:45.667640   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:45.667829   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:45.668217   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:45.674006   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "0365df2057e64f2e8861b461cdd291fc"
format_stamp: "Formatted at 2026-07-09 12:57:45 on dist-test-slave-vcr9"
I20260709 12:57:45.682195   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.007s
I20260709 12:57:45.687219   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:45.688481   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:57:45.688833   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "0365df2057e64f2e8861b461cdd291fc"
format_stamp: "Formatted at 2026-07-09 12:57:45 on dist-test-slave-vcr9"
I20260709 12:57:45.689177   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:45.742807   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:45.744644   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:57:45.745168   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:45.822870   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:32983
I20260709 12:57:45.822923   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:32983 every 8 connection(s)
I20260709 12:57:45.832039   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:45.854033   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc: Bootstrap starting.
I20260709 12:57:45.860467   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:45.862576   498 log.cc:826] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc: Log is configured to *not* fsync() on all Append() calls
I20260709 12:57:45.867352   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc: No bootstrap required, opened a new log
I20260709 12:57:45.888562   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0365df2057e64f2e8861b461cdd291fc" member_type: VOTER }
I20260709 12:57:45.889122   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:45.889343   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0365df2057e64f2e8861b461cdd291fc, State: Initialized, Role: FOLLOWER
I20260709 12:57:45.890268   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0365df2057e64f2e8861b461cdd291fc" member_type: VOTER }
I20260709 12:57:45.890731   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:45.890969   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:45.891259   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:45.895646   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0365df2057e64f2e8861b461cdd291fc" member_type: VOTER }
I20260709 12:57:45.896395   498 leader_election.cc:304] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0365df2057e64f2e8861b461cdd291fc; no voters: 
I20260709 12:57:45.898171   498 leader_election.cc:290] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:45.898581   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:45.901252   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 1 LEADER]: Becoming Leader. State: Replica: 0365df2057e64f2e8861b461cdd291fc, State: Running, Role: LEADER
I20260709 12:57:45.902259   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0365df2057e64f2e8861b461cdd291fc" member_type: VOTER }
I20260709 12:57:45.903772   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:45.913934   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0365df2057e64f2e8861b461cdd291fc. Latest consensus state: current_term: 1 leader_uuid: "0365df2057e64f2e8861b461cdd291fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0365df2057e64f2e8861b461cdd291fc" member_type: VOTER } }
I20260709 12:57:45.915089   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:45.915067   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0365df2057e64f2e8861b461cdd291fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0365df2057e64f2e8861b461cdd291fc" member_type: VOTER } }
I20260709 12:57:45.915897   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:45.919799   509 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:45.932082   509 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:45.933781   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:45.950767   509 catalog_manager.cc:1383] Generated new cluster ID: 93ed7cf130014f13ab094515eb5d6d60
I20260709 12:57:45.951104   509 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:45.974817   509 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:45.976435   509 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:45.992424   509 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc: Generated new TSK 0
I20260709 12:57:45.993368   509 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:46.000983   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:46.011919   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:46.014753   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:46.016611   431 server_base.cc:1061] running on GCE node
W20260709 12:57:46.017266   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:46.018260   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:46.018527   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:46.018726   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601866018709 us; error 0 us; skew 500 ppm
I20260709 12:57:46.019886   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:46.023869   431 webserver.cc:533] Webserver started at http://127.0.107.193:46327/ using document root <none> and password file <none>
I20260709 12:57:46.024560   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:46.024819   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:46.025148   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:46.026655   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
format_stamp: "Formatted at 2026-07-09 12:57:46 on dist-test-slave-vcr9"
I20260709 12:57:46.033895   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.008s
I20260709 12:57:46.039301   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.040164   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:57:46.040539   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
format_stamp: "Formatted at 2026-07-09 12:57:46 on dist-test-slave-vcr9"
I20260709 12:57:46.040942   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:46.084614   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:46.086056   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:46.088893   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:46.093824   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:46.094046   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.094388   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:46.094538   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.209275   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39665
I20260709 12:57:46.209333   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39665 every 8 connection(s)
I20260709 12:57:46.217298   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:46.229708   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:46.235189   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:46.239826   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:46.242513   431 server_base.cc:1061] running on GCE node
I20260709 12:57:46.243572   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:46.243837   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:46.244042   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601866244024 us; error 0 us; skew 500 ppm
I20260709 12:57:46.244745   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:46.246026   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32983
I20260709 12:57:46.246476   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:46.247619   431 webserver.cc:533] Webserver started at http://127.0.107.194:46157/ using document root <none> and password file <none>
I20260709 12:57:46.247658   591 heartbeater.cc:507] Master 127.0.107.254:32983 requested a full tablet report, sending...
I20260709 12:57:46.248083   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:46.248322   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:46.248624   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:46.249689   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "e8b860bc6143444e9742ff376da181d8"
format_stamp: "Formatted at 2026-07-09 12:57:46 on dist-test-slave-vcr9"
I20260709 12:57:46.251607   463 ts_manager.cc:194] Registered new tserver with Master: 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665)
I20260709 12:57:46.254563   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46254
I20260709 12:57:46.256649   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:57:46.261730   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.262648   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:57:46.262934   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "e8b860bc6143444e9742ff376da181d8"
format_stamp: "Formatted at 2026-07-09 12:57:46 on dist-test-slave-vcr9"
I20260709 12:57:46.263214   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:46.278957   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:46.280639   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:46.283226   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:46.286533   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:46.286713   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.287027   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:46.287197   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.397122   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40769
I20260709 12:57:46.397361   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40769 every 8 connection(s)
I20260709 12:57:46.403748   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:46.414057   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:46.417701   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:46.421975   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32983
I20260709 12:57:46.422405   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:46.423694   666 heartbeater.cc:507] Master 127.0.107.254:32983 requested a full tablet report, sending...
I20260709 12:57:46.426146   431 server_base.cc:1061] running on GCE node
I20260709 12:57:46.426164   463 ts_manager.cc:194] Registered new tserver with Master: e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
W20260709 12:57:46.426707   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:46.428177   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:57:46.428323   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46260
W20260709 12:57:46.428474   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:46.428730   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601866428712 us; error 0 us; skew 500 ppm
I20260709 12:57:46.429497   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:46.432376   431 webserver.cc:533] Webserver started at http://127.0.107.195:43879/ using document root <none> and password file <none>
I20260709 12:57:46.432988   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:46.433215   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:46.433537   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:46.435048   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
format_stamp: "Formatted at 2026-07-09 12:57:46 on dist-test-slave-vcr9"
I20260709 12:57:46.440691   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:57:46.444859   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.445729   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:57:46.446063   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
format_stamp: "Formatted at 2026-07-09 12:57:46 on dist-test-slave-vcr9"
I20260709 12:57:46.446412   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:46.466430   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:46.468129   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:46.471014   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:46.474516   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:46.474773   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.475046   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:46.475244   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:46.585755   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38493
I20260709 12:57:46.585907   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38493 every 8 connection(s)
I20260709 12:57:46.607511   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32983
I20260709 12:57:46.607964   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:46.609050   740 heartbeater.cc:507] Master 127.0.107.254:32983 requested a full tablet report, sending...
I20260709 12:57:46.613051   463 ts_manager.cc:194] Registered new tserver with Master: e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:46.613922   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017109323s
I20260709 12:57:46.615115   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46276
I20260709 12:57:46.680141   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46292:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:46.685160   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:46.785594   705 tablet_service.cc:1511] Processing CreateTablet for tablet b6a47a08dafc4361a9e8e788a25ad4bd (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:46.786361   704 tablet_service.cc:1511] Processing CreateTablet for tablet e0e64c1df7a14b6d9c0d9feafc3cc3a0 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:46.787196   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a47a08dafc4361a9e8e788a25ad4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.788216   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e64c1df7a14b6d9c0d9feafc3cc3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.800470   703 tablet_service.cc:1511] Processing CreateTablet for tablet ec1fb75378724478b1ee7af1cce6c248 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:46.804028   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1fb75378724478b1ee7af1cce6c248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.815202   702 tablet_service.cc:1511] Processing CreateTablet for tablet 19985091313241afb16b93de613462ae (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:46.816896   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19985091313241afb16b93de613462ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.823082   556 tablet_service.cc:1511] Processing CreateTablet for tablet b6a47a08dafc4361a9e8e788a25ad4bd (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:46.834043   554 tablet_service.cc:1511] Processing CreateTablet for tablet ec1fb75378724478b1ee7af1cce6c248 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:46.829830   555 tablet_service.cc:1511] Processing CreateTablet for tablet e0e64c1df7a14b6d9c0d9feafc3cc3a0 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:46.839727   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a47a08dafc4361a9e8e788a25ad4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.845925   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1fb75378724478b1ee7af1cce6c248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.852321   552 tablet_service.cc:1511] Processing CreateTablet for tablet 278b4c1203584c929d4fe70375f0c7d3 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:46.853796   553 tablet_service.cc:1511] Processing CreateTablet for tablet 19985091313241afb16b93de613462ae (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:46.857997   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19985091313241afb16b93de613462ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.864465   701 tablet_service.cc:1511] Processing CreateTablet for tablet 278b4c1203584c929d4fe70375f0c7d3 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:46.865588   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278b4c1203584c929d4fe70375f0c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.866076   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278b4c1203584c929d4fe70375f0c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.868773   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e64c1df7a14b6d9c0d9feafc3cc3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.869946   551 tablet_service.cc:1511] Processing CreateTablet for tablet ddafe4cd1bdd4883913602cc73aac5c3 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:46.882992   758 tablet_bootstrap.cc:492] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:46.881506   630 tablet_service.cc:1511] Processing CreateTablet for tablet e0e64c1df7a14b6d9c0d9feafc3cc3a0 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:46.888257   627 tablet_service.cc:1511] Processing CreateTablet for tablet 278b4c1203584c929d4fe70375f0c7d3 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:46.888309   628 tablet_service.cc:1511] Processing CreateTablet for tablet 19985091313241afb16b93de613462ae (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:46.889052   631 tablet_service.cc:1511] Processing CreateTablet for tablet b6a47a08dafc4361a9e8e788a25ad4bd (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:46.890929   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278b4c1203584c929d4fe70375f0c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.889295   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddafe4cd1bdd4883913602cc73aac5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.880064   629 tablet_service.cc:1511] Processing CreateTablet for tablet ec1fb75378724478b1ee7af1cce6c248 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:46.899062   626 tablet_service.cc:1511] Processing CreateTablet for tablet ddafe4cd1bdd4883913602cc73aac5c3 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:46.896243   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19985091313241afb16b93de613462ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.908782   550 tablet_service.cc:1511] Processing CreateTablet for tablet d0a96a2ef9444d4484fdac3451506a6c (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:46.911100   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a96a2ef9444d4484fdac3451506a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.907667   705 tablet_service.cc:1511] Processing CreateTablet for tablet ddafe4cd1bdd4883913602cc73aac5c3 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:46.912196   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e64c1df7a14b6d9c0d9feafc3cc3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.917815   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddafe4cd1bdd4883913602cc73aac5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.921936   625 tablet_service.cc:1511] Processing CreateTablet for tablet d0a96a2ef9444d4484fdac3451506a6c (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 12:57:46.927271   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:46.928737   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddafe4cd1bdd4883913602cc73aac5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.930047   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1fb75378724478b1ee7af1cce6c248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.930928   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a96a2ef9444d4484fdac3451506a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.935490   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a47a08dafc4361a9e8e788a25ad4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.942770   703 tablet_service.cc:1511] Processing CreateTablet for tablet d0a96a2ef9444d4484fdac3451506a6c (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:46.946188   549 tablet_service.cc:1511] Processing CreateTablet for tablet aaf655eac3fe48f1aaabea2bbbec7b08 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:46.947551   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaf655eac3fe48f1aaabea2bbbec7b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.959219   624 tablet_service.cc:1511] Processing CreateTablet for tablet aaf655eac3fe48f1aaabea2bbbec7b08 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:46.963094   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaf655eac3fe48f1aaabea2bbbec7b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.963724   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a96a2ef9444d4484fdac3451506a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.963447   704 tablet_service.cc:1511] Processing CreateTablet for tablet aaf655eac3fe48f1aaabea2bbbec7b08 (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:46.980321   548 tablet_service.cc:1511] Processing CreateTablet for tablet f9737c83111d4608a6f5fcfec38cf75d (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:46.986726   623 tablet_service.cc:1511] Processing CreateTablet for tablet f9737c83111d4608a6f5fcfec38cf75d (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:46.989821   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9737c83111d4608a6f5fcfec38cf75d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.995852   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9737c83111d4608a6f5fcfec38cf75d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:46.997417   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaf655eac3fe48f1aaabea2bbbec7b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:47.050396   758 tablet_bootstrap.cc:654] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.079526   705 tablet_service.cc:1511] Processing CreateTablet for tablet f9737c83111d4608a6f5fcfec38cf75d (DEFAULT_TABLE table=test-workload [id=d43eb4c4e792496ca0c2d5accab9926c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:47.080816   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9737c83111d4608a6f5fcfec38cf75d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:47.094195   760 tablet_bootstrap.cc:492] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.103242   759 tablet_bootstrap.cc:492] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.125203   758 tablet_bootstrap.cc:492] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.127588   758 ts_tablet_manager.cc:1403] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.257s	user 0.029s	sys 0.031s
I20260709 12:57:47.143985   759 tablet_bootstrap.cc:654] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.145329   760 tablet_bootstrap.cc:654] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.144780   758 raft_consensus.cc:359] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.145880   758 raft_consensus.cc:385] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.146137   758 raft_consensus.cc:740] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.146874   758 consensus_queue.cc:260] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.156648   758 ts_tablet_manager.cc:1434] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.002s
I20260709 12:57:47.156661   740 heartbeater.cc:499] Master 127.0.107.254:32983 was elected leader, sending a full tablet report...
I20260709 12:57:47.157872   758 tablet_bootstrap.cc:492] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.158435   760 tablet_bootstrap.cc:492] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.158877   760 ts_tablet_manager.cc:1403] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.005s
I20260709 12:57:47.162760   760 raft_consensus.cc:359] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.163949   760 raft_consensus.cc:385] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.164260   760 raft_consensus.cc:740] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.165200   758 tablet_bootstrap.cc:654] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.164994   760 consensus_queue.cc:260] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.173710   666 heartbeater.cc:499] Master 127.0.107.254:32983 was elected leader, sending a full tablet report...
I20260709 12:57:47.174722   760 ts_tablet_manager.cc:1434] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:57:47.175702   760 tablet_bootstrap.cc:492] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.184894   759 tablet_bootstrap.cc:492] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:47.185045   760 tablet_bootstrap.cc:654] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.185407   759 ts_tablet_manager.cc:1403] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.011s
I20260709 12:57:47.189296   759 raft_consensus.cc:359] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.190246   759 raft_consensus.cc:385] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.190630   759 raft_consensus.cc:740] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.191740   759 consensus_queue.cc:260] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.194792   758 tablet_bootstrap.cc:492] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.195314   758 ts_tablet_manager.cc:1403] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.014s
I20260709 12:57:47.198137   758 raft_consensus.cc:359] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.198892   758 raft_consensus.cc:385] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.200531   758 raft_consensus.cc:740] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.203063   591 heartbeater.cc:499] Master 127.0.107.254:32983 was elected leader, sending a full tablet report...
I20260709 12:57:47.204187   758 consensus_queue.cc:260] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.205053   759 ts_tablet_manager.cc:1434] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:57:47.206157   759 tablet_bootstrap.cc:492] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.206239   758 ts_tablet_manager.cc:1434] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.003s
I20260709 12:57:47.207156   758 tablet_bootstrap.cc:492] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.208631   760 tablet_bootstrap.cc:492] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.209142   760 ts_tablet_manager.cc:1403] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
I20260709 12:57:47.212000   760 raft_consensus.cc:359] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.213292   760 raft_consensus.cc:385] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.213631   760 raft_consensus.cc:740] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.214391   760 consensus_queue.cc:260] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.219858   760 ts_tablet_manager.cc:1434] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:57:47.220929   760 tablet_bootstrap.cc:492] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.222049   759 tablet_bootstrap.cc:654] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.229342   758 tablet_bootstrap.cc:654] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:47.229403   592 tablet.cc:2406] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:47.230950   760 tablet_bootstrap.cc:654] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.234851   759 tablet_bootstrap.cc:492] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:47.235275   759 ts_tablet_manager.cc:1403] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.007s
I20260709 12:57:47.238715   759 raft_consensus.cc:359] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.239631   759 raft_consensus.cc:385] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.239985   759 raft_consensus.cc:740] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.240815   759 consensus_queue.cc:260] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.243808   759 ts_tablet_manager.cc:1434] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:57:47.245636   759 tablet_bootstrap.cc:492] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.248101   760 tablet_bootstrap.cc:492] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.248564   760 ts_tablet_manager.cc:1403] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.011s
I20260709 12:57:47.252378   760 raft_consensus.cc:359] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.255491   759 tablet_bootstrap.cc:654] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.253213   760 raft_consensus.cc:385] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.258350   760 raft_consensus.cc:740] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.259123   760 consensus_queue.cc:260] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.261292   760 ts_tablet_manager.cc:1434] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:57:47.262192   760 tablet_bootstrap.cc:492] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.268092   758 tablet_bootstrap.cc:492] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.269028   758 ts_tablet_manager.cc:1403] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.010s
I20260709 12:57:47.269238   760 tablet_bootstrap.cc:654] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.273335   758 raft_consensus.cc:359] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.274066   759 tablet_bootstrap.cc:492] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:47.274070   758 raft_consensus.cc:385] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.274634   759 ts_tablet_manager.cc:1403] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:57:47.274597   758 raft_consensus.cc:740] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.275489   758 consensus_queue.cc:260] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.276566   760 tablet_bootstrap.cc:492] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.278705   760 ts_tablet_manager.cc:1403] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 12:57:47.277069   759 raft_consensus.cc:359] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.278008   758 ts_tablet_manager.cc:1434] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:57:47.279024   759 raft_consensus.cc:385] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.279358   759 raft_consensus.cc:740] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.280048   758 tablet_bootstrap.cc:492] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.280567   759 consensus_queue.cc:260] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.282830   759 ts_tablet_manager.cc:1434] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:57:47.283828   759 tablet_bootstrap.cc:492] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.290951   760 raft_consensus.cc:359] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.291754   760 raft_consensus.cc:385] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.292505   760 raft_consensus.cc:740] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.293251   760 consensus_queue.cc:260] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.294657   758 tablet_bootstrap.cc:654] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.295360   760 ts_tablet_manager.cc:1434] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:57:47.296306   760 tablet_bootstrap.cc:492] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.303269   760 tablet_bootstrap.cc:654] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.303956   759 tablet_bootstrap.cc:654] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.312738   765 raft_consensus.cc:493] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.313293   765 raft_consensus.cc:515] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.316627   759 tablet_bootstrap.cc:492] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:47.316990   760 tablet_bootstrap.cc:492] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.317101   759 ts_tablet_manager.cc:1403] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.012s
I20260709 12:57:47.317606   760 ts_tablet_manager.cc:1403] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 12:57:47.319159   765 leader_election.cc:290] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.322433   760 raft_consensus.cc:359] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.323462   760 raft_consensus.cc:385] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.323876   760 raft_consensus.cc:740] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.327600   759 raft_consensus.cc:359] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.328756   759 raft_consensus.cc:385] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.329137   759 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.330044   760 consensus_queue.cc:260] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.334610   759 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.335167   760 ts_tablet_manager.cc:1434] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.005s
I20260709 12:57:47.337014   760 tablet_bootstrap.cc:492] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.337460   758 tablet_bootstrap.cc:492] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.337901   758 ts_tablet_manager.cc:1403] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:57:47.342712   758 raft_consensus.cc:359] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.343683   758 raft_consensus.cc:385] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.343971   758 raft_consensus.cc:740] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.344920   758 consensus_queue.cc:260] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.345947   760 tablet_bootstrap.cc:654] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.348964   758 ts_tablet_manager.cc:1434] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:57:47.349924   758 tablet_bootstrap.cc:492] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.355223   759 ts_tablet_manager.cc:1434] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 12:57:47.356184   759 tablet_bootstrap.cc:492] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.361158   758 tablet_bootstrap.cc:654] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.370924   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
W20260709 12:57:47.377856   607 leader_election.cc:343] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.378218   759 tablet_bootstrap.cc:654] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.381837   760 tablet_bootstrap.cc:492] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.382290   760 ts_tablet_manager.cc:1403] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.003s
I20260709 12:57:47.385313   760 raft_consensus.cc:359] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.386008   760 raft_consensus.cc:385] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.386300   760 raft_consensus.cc:740] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.387010   760 consensus_queue.cc:260] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.389467   760 ts_tablet_manager.cc:1434] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:57:47.390403   760 tablet_bootstrap.cc:492] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.397696   760 tablet_bootstrap.cc:654] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.398825   759 tablet_bootstrap.cc:492] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:47.399353   759 ts_tablet_manager.cc:1403] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.008s
I20260709 12:57:47.402676   765 raft_consensus.cc:493] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.403162   765 raft_consensus.cc:515] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.403745   759 raft_consensus.cc:359] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.405736   759 raft_consensus.cc:385] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.406502   759 raft_consensus.cc:740] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.406730   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.407892   765 leader_election.cc:290] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
W20260709 12:57:47.408628   604 leader_election.cc:343] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.408989   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.409070   604 leader_election.cc:304] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:47.408869   759 consensus_queue.cc:260] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.409770   566 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 0.
I20260709 12:57:47.411384   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.411650   759 ts_tablet_manager.cc:1434] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:57:47.411983   715 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 0.
I20260709 12:57:47.412758   759 tablet_bootstrap.cc:492] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.412884   607 leader_election.cc:304] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:47.416410   758 tablet_bootstrap.cc:492] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.417042   758 ts_tablet_manager.cc:1403] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.011s
I20260709 12:57:47.413506   765 raft_consensus.cc:2749] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.418824   765 raft_consensus.cc:2804] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.419400   765 raft_consensus.cc:493] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.420033   765 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.422479   758 raft_consensus.cc:359] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.430737   758 raft_consensus.cc:385] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.431093   758 raft_consensus.cc:740] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.430040   765 raft_consensus.cc:515] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.431867   758 consensus_queue.cc:260] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.436767   758 ts_tablet_manager.cc:1434] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:57:47.437664   758 tablet_bootstrap.cc:492] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.438040   759 tablet_bootstrap.cc:654] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.446163   785 raft_consensus.cc:493] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.448534   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:47.449049   760 tablet_bootstrap.cc:492] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.449117   715 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.449539   760 ts_tablet_manager.cc:1403] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.001s
I20260709 12:57:47.453155   768 raft_consensus.cc:493] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.455142   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:47.447096   765 leader_election.cc:290] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.447088   785 raft_consensus.cc:515] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.456154   566 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.454296   768 raft_consensus.cc:515] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.457651   765 raft_consensus.cc:493] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.461687   758 tablet_bootstrap.cc:654] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.460207   765 raft_consensus.cc:515] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.467119   768 leader_election.cc:290] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.486158   760 raft_consensus.cc:359] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.490502   760 raft_consensus.cc:385] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.490955   760 raft_consensus.cc:740] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.491914   760 consensus_queue.cc:260] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.499105   566 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 1.
I20260709 12:57:47.484728   715 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 1.
I20260709 12:57:47.505931   768 raft_consensus.cc:493] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.507069   764 raft_consensus.cc:493] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.507335   768 raft_consensus.cc:515] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.507545   764 raft_consensus.cc:515] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.510591   768 leader_election.cc:290] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.512552   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.517202   714 raft_consensus.cc:2468] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 0.
I20260709 12:57:47.506675   785 leader_election.cc:290] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.517491   764 leader_election.cc:290] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.523125   765 leader_election.cc:290] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.521518   604 leader_election.cc:304] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:47.524442   765 raft_consensus.cc:2804] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.526051   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.528218   765 raft_consensus.cc:697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:47.540691   765 consensus_queue.cc:237] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.531060   786 raft_consensus.cc:493] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.542788   786 raft_consensus.cc:515] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.546289   786 leader_election.cc:290] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.546799   760 ts_tablet_manager.cc:1434] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.094s	user 0.012s	sys 0.006s
I20260709 12:57:47.547750   760 tablet_bootstrap.cc:492] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.549852   759 tablet_bootstrap.cc:492] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:47.550310   759 ts_tablet_manager.cc:1403] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.138s	user 0.024s	sys 0.017s
I20260709 12:57:47.550613   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.552629   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.553401   566 raft_consensus.cc:2468] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 0.
I20260709 12:57:47.558288   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.558519   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.558913   714 raft_consensus.cc:2468] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
W20260709 12:57:47.560120   529 leader_election.cc:343] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.561508   529 leader_election.cc:304] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:47.566051   768 raft_consensus.cc:2804] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.567211   768 raft_consensus.cc:493] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.567569   768 raft_consensus.cc:3060] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.568452   604 leader_election.cc:304] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:47.560906   759 raft_consensus.cc:359] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.569835   786 raft_consensus.cc:2804] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.571030   786 raft_consensus.cc:493] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.571390   786 raft_consensus.cc:3060] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.570483   759 raft_consensus.cc:385] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:57:47.572095   604 leader_election.cc:343] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.574333   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.574867   758 tablet_bootstrap.cc:492] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.575467   758 ts_tablet_manager.cc:1403] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.138s	user 0.020s	sys 0.010s
W20260709 12:57:47.575642   604 leader_election.cc:343] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.573338   759 raft_consensus.cc:740] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.584273   759 consensus_queue.cc:260] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.589143   758 raft_consensus.cc:359] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.590126   758 raft_consensus.cc:385] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.593165   461 catalog_manager.cc:5697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:47.596856   764 raft_consensus.cc:493] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.597100   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.597297   764 raft_consensus.cc:515] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.599241   764 leader_election.cc:290] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.592883   758 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
W20260709 12:57:47.601780   607 leader_election.cc:343] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.593305   768 raft_consensus.cc:515] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.606564   786 raft_consensus.cc:515] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.611030   760 tablet_bootstrap.cc:654] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.613070   768 leader_election.cc:290] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.611311   786 leader_election.cc:290] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.613399   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:47.613966   714 raft_consensus.cc:3060] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.614413   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.615556   565 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 0.
I20260709 12:57:47.616938   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:47.604283   758 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.602451   607 leader_election.cc:304] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:47.618743   786 raft_consensus.cc:2749] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.619838   681 leader_election.cc:304] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:47.620153   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.622768   566 raft_consensus.cc:2393] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e00db112b9fb4f4486f8c78cde65f7c8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
W20260709 12:57:47.620882   607 leader_election.cc:343] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.624293   764 raft_consensus.cc:2804] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.624867   764 raft_consensus.cc:493] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.625540   607 leader_election.cc:304] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:47.625694   764 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.626271   765 raft_consensus.cc:2749] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.633608   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:47.634796   566 raft_consensus.cc:2393] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8b860bc6143444e9742ff376da181d8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
I20260709 12:57:47.635679   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.636794   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.637437   758 ts_tablet_manager.cc:1434] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.062s	user 0.012s	sys 0.000s
I20260709 12:57:47.637935   641 raft_consensus.cc:2468] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:47.640506   640 raft_consensus.cc:2393] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e8b860bc6143444e9742ff376da181d8 in this term.
I20260709 12:57:47.641506   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.642442   639 raft_consensus.cc:2393] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e8b860bc6143444e9742ff376da181d8 in this term.
I20260709 12:57:47.643847   714 raft_consensus.cc:2468] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 1.
I20260709 12:57:47.645030   604 leader_election.cc:304] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:47.645874   786 raft_consensus.cc:2804] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.646667   786 raft_consensus.cc:697] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:47.647302   758 tablet_bootstrap.cc:492] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.649190   768 raft_consensus.cc:493] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.649639   768 raft_consensus.cc:515] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.647315   764 raft_consensus.cc:515] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.649704   531 leader_election.cc:304] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960; no voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8
I20260709 12:57:47.651310   531 leader_election.cc:304] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:47.651707   768 leader_election.cc:290] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.652199   768 raft_consensus.cc:2749] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.653235   768 raft_consensus.cc:2804] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.653563   768 raft_consensus.cc:493] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.653899   768 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.654630   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:47.655241   764 leader_election.cc:290] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.655330   566 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.662314   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4c1203584c929d4fe70375f0c7d3" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.664183   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.656075   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.665383   758 tablet_bootstrap.cc:654] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.667511   768 raft_consensus.cc:515] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.665307   714 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:47.669588   529 leader_election.cc:304] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:47.669914   768 leader_election.cc:290] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.648016   786 consensus_queue.cc:237] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.665598   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.667168   680 leader_election.cc:304] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8
I20260709 12:57:47.672137   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
W20260709 12:57:47.674319   680 leader_election.cc:343] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:47.675565   680 leader_election.cc:343] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.675696   764 raft_consensus.cc:2749] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.674284   768 raft_consensus.cc:2804] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:57:47.676546   529 leader_election.cc:343] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.676668   768 raft_consensus.cc:493] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.677047   768 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.678125   566 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 1.
I20260709 12:57:47.679489   681 leader_election.cc:304] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: e8b860bc6143444e9742ff376da181d8
I20260709 12:57:47.680562   764 raft_consensus.cc:2804] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.681051   759 ts_tablet_manager.cc:1434] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.130s	user 0.013s	sys 0.004s
I20260709 12:57:47.712481   759 tablet_bootstrap.cc:492] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:47.728062   805 raft_consensus.cc:493] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.728677   805 raft_consensus.cc:515] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
W20260709 12:57:47.696604   531 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40769, user_credentials={real_user=slave}} blocked reactor thread for 45364.1us
I20260709 12:57:47.712092   764 raft_consensus.cc:697] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:47.750527   760 tablet_bootstrap.cc:492] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.751447   760 ts_tablet_manager.cc:1403] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.204s	user 0.022s	sys 0.009s
I20260709 12:57:47.738865   764 consensus_queue.cc:237] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.739032   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.750237   765 raft_consensus.cc:493] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.756807   765 raft_consensus.cc:515] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.757122   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.749085   800 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.758056   639 raft_consensus.cc:2468] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 0.
I20260709 12:57:47.750077   803 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.743206   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.742995   805 leader_election.cc:290] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.758455   800 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
W20260709 12:57:47.757544   681 leader_election.cc:343] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.761169   803 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.762995   765 leader_election.cc:290] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.763325   758 tablet_bootstrap.cc:492] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.763748   758 ts_tablet_manager.cc:1403] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.117s	user 0.028s	sys 0.034s
I20260709 12:57:47.763629   680 leader_election.cc:304] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:47.765043   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.765645   768 raft_consensus.cc:515] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.765828   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.768188   804 raft_consensus.cc:2804] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.768652   804 raft_consensus.cc:493] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.769680   759 tablet_bootstrap.cc:654] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.761795   641 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:47.769626   804 raft_consensus.cc:3060] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.768180   715 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 0.
I20260709 12:57:47.771175   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.771720   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.776003   565 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 0.
I20260709 12:57:47.776208   639 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.777308   566 raft_consensus.cc:2393] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b860bc6143444e9742ff376da181d8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
I20260709 12:57:47.780783   760 raft_consensus.cc:359] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.781580   760 raft_consensus.cc:385] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.781910   760 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.782539   768 leader_election.cc:290] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.780946   604 leader_election.cc:304] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:47.782650   760 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.783509   765 raft_consensus.cc:2804] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.783864   765 raft_consensus.cc:493] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.783735   681 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:47.784281   765 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.784766   805 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.784940   760 ts_tablet_manager.cc:1434] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 12:57:47.785183   805 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.785626   805 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.785848   760 tablet_bootstrap.cc:492] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: Bootstrap starting.
I20260709 12:57:47.789366   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.782439   800 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.789522   758 raft_consensus.cc:359] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.790171   758 raft_consensus.cc:385] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.790863   758 raft_consensus.cc:740] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.805116   803 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.809226   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.810611   638 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 0.
I20260709 12:57:47.811770   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.812422   641 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:47.813812   531 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:47.813819   758 consensus_queue.cc:260] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.815992   805 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.820009   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:47.820782   715 raft_consensus.cc:2393] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e00db112b9fb4f4486f8c78cde65f7c8 in this term.
I20260709 12:57:47.822544   805 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.822791   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.816962   800 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:47.823804   800 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.823836   641 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.824383   800 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.823873   463 catalog_manager.cc:5697] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:47.826172   765 raft_consensus.cc:515] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.829201   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:47.830149   715 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.837463   800 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.838052   715 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 1.
I20260709 12:57:47.841688   640 raft_consensus.cc:2393] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e8b860bc6143444e9742ff376da181d8 in this term.
I20260709 12:57:47.846410   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.848330   639 raft_consensus.cc:2468] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 1.
I20260709 12:57:47.849385   531 leader_election.cc:304] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:47.850165   768 raft_consensus.cc:2804] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.852133   804 raft_consensus.cc:515] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.867311   760 tablet_bootstrap.cc:654] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.868682   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:47.869056   804 leader_election.cc:290] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.869860   565 raft_consensus.cc:2393] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e00db112b9fb4f4486f8c78cde65f7c8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
I20260709 12:57:47.870230   758 ts_tablet_manager.cc:1434] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.005s
I20260709 12:57:47.867074   529 leader_election.cc:304] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:47.866223   768 raft_consensus.cc:697] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:47.875692   758 tablet_bootstrap.cc:492] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:47.876091   798 raft_consensus.cc:2804] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.873605   800 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.876487   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:47.885079   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:47.888605   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:47.889389   759 tablet_bootstrap.cc:492] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
W20260709 12:57:47.889739   681 leader_election.cc:343] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:47.889865   759 ts_tablet_manager.cc:1403] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.014s
I20260709 12:57:47.885807   639 raft_consensus.cc:3060] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.893880   759 raft_consensus.cc:359] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.894662   759 raft_consensus.cc:385] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.894964   759 raft_consensus.cc:740] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.896445   768 consensus_queue.cc:237] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.895711   759 consensus_queue.cc:260] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.887396   798 raft_consensus.cc:697] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:47.900611   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:47.902814   758 tablet_bootstrap.cc:654] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.902949   798 consensus_queue.cc:237] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.898190   639 raft_consensus.cc:2468] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 1.
I20260709 12:57:47.900581   641 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 1.
I20260709 12:57:47.904649   765 leader_election.cc:290] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:47.905112   715 raft_consensus.cc:2393] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e00db112b9fb4f4486f8c78cde65f7c8 in this term.
I20260709 12:57:47.906411   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:47.909044   714 raft_consensus.cc:2393] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8b860bc6143444e9742ff376da181d8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
I20260709 12:57:47.912353   759 ts_tablet_manager.cc:1434] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 12:57:47.912608   760 tablet_bootstrap.cc:492] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: No bootstrap required, opened a new log
I20260709 12:57:47.913079   760 ts_tablet_manager.cc:1403] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: Time spent bootstrapping tablet: real 0.127s	user 0.009s	sys 0.005s
I20260709 12:57:47.912992   680 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:47.914055   804 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.914424   680 leader_election.cc:304] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:47.914529   804 raft_consensus.cc:697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:47.912456   604 leader_election.cc:304] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:47.919821   805 raft_consensus.cc:2804] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:47.920138   764 raft_consensus.cc:493] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.922048   805 raft_consensus.cc:697] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:47.922271   764 raft_consensus.cc:515] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.922834   805 consensus_queue.cc:237] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.920790   804 consensus_queue.cc:237] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.920922   765 raft_consensus.cc:2749] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.929373   463 catalog_manager.cc:5697] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:47.932075   758 tablet_bootstrap.cc:492] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:47.932576   758 ts_tablet_manager.cc:1403] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.004s
I20260709 12:57:47.920979   759 tablet_bootstrap.cc:492] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
W20260709 12:57:47.936560   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:47.921170   529 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960; no voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8
I20260709 12:57:47.941341   800 raft_consensus.cc:2749] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.943143   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:47.945420   760 raft_consensus.cc:359] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.946090   760 raft_consensus.cc:385] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.946331   760 raft_consensus.cc:740] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.947507   760 consensus_queue.cc:260] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:47.947132   764 leader_election.cc:290] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:47.950613   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:47.954092   760 ts_tablet_manager.cc:1434] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 12:57:47.954730   639 raft_consensus.cc:2393] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e00db112b9fb4f4486f8c78cde65f7c8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
I20260709 12:57:47.957617   680 leader_election.cc:304] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8
I20260709 12:57:47.958384   764 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:47.960095   758 raft_consensus.cc:359] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.962705   758 raft_consensus.cc:385] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:47.962899   758 raft_consensus.cc:740] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:47.966053   758 consensus_queue.cc:260] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:47.992064   764 raft_consensus.cc:2749] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:47.992863   463 catalog_manager.cc:5697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:47.994292   759 tablet_bootstrap.cc:654] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:47.995673   461 catalog_manager.cc:5697] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:47.997581   461 catalog_manager.cc:5697] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.000115   758 ts_tablet_manager.cc:1434] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.000s
I20260709 12:57:48.001025   758 tablet_bootstrap.cc:492] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8: Bootstrap starting.
I20260709 12:57:48.004884   759 tablet_bootstrap.cc:492] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:48.005331   759 ts_tablet_manager.cc:1403] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.001s
I20260709 12:57:48.006939   758 tablet_bootstrap.cc:654] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:48.010880   462 catalog_manager.cc:5697] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:48.012827   758 tablet_bootstrap.cc:492] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8: No bootstrap required, opened a new log
I20260709 12:57:48.013245   758 ts_tablet_manager.cc:1403] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.007s
I20260709 12:57:48.015722   758 raft_consensus.cc:359] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.016410   758 raft_consensus.cc:385] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:48.016671   758 raft_consensus.cc:740] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Initialized, Role: FOLLOWER
I20260709 12:57:48.017932   758 consensus_queue.cc:260] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.019841   758 ts_tablet_manager.cc:1434] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:57:48.019268   759 raft_consensus.cc:359] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.020715   759 raft_consensus.cc:385] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:48.021041   759 raft_consensus.cc:740] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:48.021750   759 consensus_queue.cc:260] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.023561   759 ts_tablet_manager.cc:1434] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:57:48.024324   759 tablet_bootstrap.cc:492] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: Bootstrap starting.
I20260709 12:57:48.030318   759 tablet_bootstrap.cc:654] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:48.035941   759 tablet_bootstrap.cc:492] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: No bootstrap required, opened a new log
I20260709 12:57:48.036391   759 ts_tablet_manager.cc:1403] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent bootstrapping tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 12:57:48.039498   759 raft_consensus.cc:359] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.040148   759 raft_consensus.cc:385] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:48.040438   759 raft_consensus.cc:740] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Initialized, Role: FOLLOWER
I20260709 12:57:48.041074   759 consensus_queue.cc:260] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.042415   759 ts_tablet_manager.cc:1434] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:57:48.132308   765 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.151624   765 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.155887   765 raft_consensus.cc:493] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.156387   765 raft_consensus.cc:515] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:48.159514   765 leader_election.cc:290] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493), 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665)
I20260709 12:57:48.161216   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:48.161988   565 raft_consensus.cc:2393] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b860bc6143444e9742ff376da181d8 in current term 1: Already voted for candidate e00db112b9fb4f4486f8c78cde65f7c8 in this term.
I20260709 12:57:48.163484   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:48.165014   604 leader_election.cc:304] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b860bc6143444e9742ff376da181d8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:48.166206   765 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.173102   765 raft_consensus.cc:2749] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:48.192989   765 consensus_queue.cc:1048] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.206732   786 consensus_queue.cc:1048] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.232933   804 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.246042   803 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.293313   768 raft_consensus.cc:493] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.293781   768 raft_consensus.cc:515] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.295601   768 leader_election.cc:290] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.296854   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:48.297449   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:48.297585   639 raft_consensus.cc:2393] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e00db112b9fb4f4486f8c78cde65f7c8 in this term.
I20260709 12:57:48.298810   529 leader_election.cc:304] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960; no voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8
I20260709 12:57:48.299533   768 raft_consensus.cc:3060] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.304548   768 raft_consensus.cc:2749] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:48.343545   764 consensus_queue.cc:1048] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.359395   831 consensus_queue.cc:1048] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.372154   768 consensus_queue.cc:1048] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.383709   811 consensus_queue.cc:1048] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:48.385066   811 raft_consensus.cc:493] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.385507   811 raft_consensus.cc:515] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.385936   798 consensus_queue.cc:1048] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.387524   811 leader_election.cc:290] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.390457   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:48.391098   714 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:48.391110   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:48.391860   640 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:48.393069   531 leader_election.cc:304] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.394085   800 raft_consensus.cc:2804] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:48.394420   800 raft_consensus.cc:493] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.394740   800 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.400457   831 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.403338   800 raft_consensus.cc:515] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.409029   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:48.409571   640 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.410537   803 raft_consensus.cc:493] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.411126   803 raft_consensus.cc:515] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.413976   803 leader_election.cc:290] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:48.414373   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" is_pre_election: true
I20260709 12:57:48.414695   811 raft_consensus.cc:493] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.415227   811 raft_consensus.cc:515] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.415309   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:48.416195   638 raft_consensus.cc:2468] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 0.
I20260709 12:57:48.416281   566 raft_consensus.cc:2468] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 0.
I20260709 12:57:48.417384   680 leader_election.cc:304] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.418193   803 raft_consensus.cc:2804] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:48.418552   803 raft_consensus.cc:493] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.418879   803 raft_consensus.cc:3060] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.420904   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" is_pre_election: true
I20260709 12:57:48.421123   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8" is_pre_election: true
I20260709 12:57:48.421756   638 raft_consensus.cc:2468] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 0.
I20260709 12:57:48.422199   811 leader_election.cc:290] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.425761   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:48.426373   713 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.426081   531 leader_election.cc:304] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.431269   798 raft_consensus.cc:2804] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:48.431624   798 raft_consensus.cc:493] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.431928   798 raft_consensus.cc:3060] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.423669   640 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 1.
I20260709 12:57:48.442605   531 leader_election.cc:304] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.443547   768 raft_consensus.cc:2804] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:48.443238   798 raft_consensus.cc:515] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.437486   800 leader_election.cc:290] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.439800   811 consensus_queue.cc:1048] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:48.445240   713 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 1.
I20260709 12:57:48.446210   768 raft_consensus.cc:697] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:48.447356   768 consensus_queue.cc:237] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.478878   803 raft_consensus.cc:515] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.483385   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:48.484218   639 raft_consensus.cc:3060] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:48.510812   639 raft_consensus.cc:2468] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 1.
I20260709 12:57:48.511984   531 leader_election.cc:304] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.512463   831 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.513804   839 raft_consensus.cc:2804] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:48.514505   839 raft_consensus.cc:697] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:48.515390   839 consensus_queue.cc:237] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.518595   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:48.520588   798 leader_election.cc:290] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 1 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.525926   714 raft_consensus.cc:2393] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32c28e9d31d14f4fae18c4e58dfa1960 in current term 1: Already voted for candidate e00db112b9fb4f4486f8c78cde65f7c8 in this term.
I20260709 12:57:48.528756   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:48.530634   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:48.531639   639 raft_consensus.cc:2393] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e00db112b9fb4f4486f8c78cde65f7c8 in current term 1: Already voted for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in this term.
I20260709 12:57:48.532858   680 leader_election.cc:304] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8; no voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8
I20260709 12:57:48.533737   831 raft_consensus.cc:2749] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:48.527002   803 leader_election.cc:290] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 1 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:48.551347   462 catalog_manager.cc:5697] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.571759   462 catalog_manager.cc:5697] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.653409   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
mode: GRACEFUL
new_leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:50664
I20260709 12:57:48.654121   713 raft_consensus.cc:606] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Received request to transfer leadership to TS 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:48.673561   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:44014
I20260709 12:57:48.674072   640 raft_consensus.cc:606] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Received request to transfer leadership to TS 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:48.686744   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:50664
I20260709 12:57:48.687378   713 raft_consensus.cc:606] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:48.701793   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:35014
I20260709 12:57:48.702399   565 raft_consensus.cc:606] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:48.707567   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:50664
I20260709 12:57:48.708144   713 raft_consensus.cc:606] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:48.713455   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
mode: GRACEFUL
new_leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:35014
I20260709 12:57:48.714017   565 raft_consensus.cc:606] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Received request to transfer leadership to TS e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:48.764586   831 raft_consensus.cc:993] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: : Instructing follower 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:48.765026   831 raft_consensus.cc:1081] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Signalling peer 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:48.766623   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:35458
I20260709 12:57:48.767139   565 raft_consensus.cc:493] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:48.767447   565 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.772557   565 raft_consensus.cc:515] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:48.774214   565 leader_election.cc:290] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 2 election: Requested vote from peers e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:48.775375   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:48.775866   713 raft_consensus.cc:3055] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:48.775951   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:48.776162   713 raft_consensus.cc:740] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:48.776556   640 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.777000   713 consensus_queue.cc:260] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:48.777920   713 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.782807   713 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 2.
I20260709 12:57:48.783030   640 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 2.
I20260709 12:57:48.783741   529 leader_election.cc:304] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:48.784543   768 raft_consensus.cc:2804] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:48.784989   768 raft_consensus.cc:697] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:48.785727   768 consensus_queue.cc:237] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:48.792331   462 catalog_manager.cc:5697] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 1 to 2, leader changed from e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195) to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.913398   803 raft_consensus.cc:993] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:48.913874   831 raft_consensus.cc:1081] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:48.915884   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:57:48.916527   640 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:48.917344   640 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.922894   803 raft_consensus.cc:993] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:48.923549   831 raft_consensus.cc:1081] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:48.924898   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:57:48.925359   639 raft_consensus.cc:493] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:48.925700   639 raft_consensus.cc:3060] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.925851   640 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.928157   640 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.928669   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:48.928937   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:48.929275   565 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.929445   713 raft_consensus.cc:3055] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:48.929793   713 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:48.931027   713 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.932122   713 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.936425   639 raft_consensus.cc:515] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.936851   565 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:48.937944   607 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.938804   765 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:48.939329   765 raft_consensus.cc:697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:48.940196   765 consensus_queue.cc:237] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.941897   639 leader_election.cc:290] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:48.945071   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:48.945657   565 raft_consensus.cc:3060] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.945753   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddafe4cd1bdd4883913602cc73aac5c3" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:48.946305   715 raft_consensus.cc:3055] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:48.946698   715 raft_consensus.cc:740] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:48.947482   715 consensus_queue.cc:260] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.952468   565 raft_consensus.cc:2468] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:48.953600   607 leader_election.cc:304] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:48.953626   462 catalog_manager.cc:5697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 1 to 2, leader changed from e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.954388   825 raft_consensus.cc:2804] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:48.954455   768 consensus_queue.cc:1048] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.955084   825 raft_consensus.cc:697] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:48.958231   768 consensus_queue.cc:1048] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:48.955953   825 consensus_queue.cc:237] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:48.969269   715 raft_consensus.cc:3060] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.938961   713 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:48.975941   715 raft_consensus.cc:2468] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:48.988070   463 catalog_manager.cc:5697] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 1 to 2, leader changed from e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.990151   768 consensus_queue.cc:1048] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:49.003269   768 consensus_queue.cc:1048] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:49.006932   839 raft_consensus.cc:993] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:49.007432   839 raft_consensus.cc:1081] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:49.012383   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41046
I20260709 12:57:49.013055   640 raft_consensus.cc:493] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.013564   640 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.027275   640 raft_consensus.cc:515] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.032680   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:49.033353   715 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.034412   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:49.034626   640 leader_election.cc:290] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:49.035069   565 raft_consensus.cc:3055] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:49.035494   565 raft_consensus.cc:740] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:49.036837   565 consensus_queue.cc:260] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.039937   565 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.050640   715 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:49.051352   565 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:49.053149   604 leader_election.cc:304] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:49.054634   825 raft_consensus.cc:2804] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:49.055085   825 raft_consensus.cc:697] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:49.056720   768 raft_consensus.cc:993] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: : Instructing follower e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:49.056339   825 consensus_queue.cc:237] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.057189   768 raft_consensus.cc:1081] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Signalling peer e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:49.059988   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:33074
I20260709 12:57:49.060633   714 raft_consensus.cc:493] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.061112   714 raft_consensus.cc:3060] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.064419   463 catalog_manager.cc:5697] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 1 to 2, leader changed from 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.068584   714 raft_consensus.cc:515] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.070855   714 leader_election.cc:290] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 2 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:49.072860   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:49.073086   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9737c83111d4608a6f5fcfec38cf75d" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:49.073421   640 raft_consensus.cc:3060] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.073705   565 raft_consensus.cc:3055] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:49.074069   565 raft_consensus.cc:740] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:49.075315   565 consensus_queue.cc:260] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.076529   565 raft_consensus.cc:3060] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.083438   640 raft_consensus.cc:2468] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 2.
I20260709 12:57:49.084592   565 raft_consensus.cc:2468] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 2.
I20260709 12:57:49.084951   680 leader_election.cc:304] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:49.086936   831 raft_consensus.cc:2804] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:49.087666   831 raft_consensus.cc:697] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:49.088878   831 consensus_queue.cc:237] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.091918   765 raft_consensus.cc:993] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: : Instructing follower 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:49.092581   825 raft_consensus.cc:1081] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Signalling peer 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:49.094796   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:35456
I20260709 12:57:49.095381   565 raft_consensus.cc:493] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:49.095840   565 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.098181   463 catalog_manager.cc:5697] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 1 to 2, leader changed from 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193) to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.101378   565 raft_consensus.cc:515] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.104405   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:49.104960   640 raft_consensus.cc:3055] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:49.105350   640 raft_consensus.cc:740] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:49.105373   565 leader_election.cc:290] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 2 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:49.104856   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:49.106207   714 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.107240   640 consensus_queue.cc:260] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.108644   640 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:49.112629   714 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 2.
I20260709 12:57:49.113662   529 leader_election.cc:304] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:49.114416   839 raft_consensus.cc:2804] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:49.114930   839 raft_consensus.cc:697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:49.115959   640 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 2.
I20260709 12:57:49.115790   839 consensus_queue.cc:237] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:49.122844   463 catalog_manager.cc:5697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 1 to 2, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.172817   714 raft_consensus.cc:1275] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.174011   839 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.180876   640 raft_consensus.cc:1275] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.182196   811 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.413254   565 raft_consensus.cc:1275] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.415200   765 consensus_queue.cc:1048] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.423058   714 raft_consensus.cc:1275] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.425463   856 consensus_queue.cc:1048] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.498812   566 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.500146   856 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.507223   714 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.511914   765 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.540169   566 raft_consensus.cc:1275] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.541441   831 consensus_queue.cc:1048] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.544406   640 raft_consensus.cc:1275] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.545948   811 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.549026   639 raft_consensus.cc:1275] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.550611   831 consensus_queue.cc:1048] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:49.561730   715 raft_consensus.cc:1275] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.563508   714 raft_consensus.cc:1275] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.565083   765 consensus_queue.cc:1048] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:49.565145   811 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:49.574746   566 raft_consensus.cc:1275] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:49.576458   825 consensus_queue.cc:1048] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:51.740648   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:57:51.741482   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:51.756773   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19985091313241afb16b93de613462ae"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
mode: GRACEFUL
new_leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:35022
I20260709 12:57:51.757226   566 raft_consensus.cc:606] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Received request to transfer leadership to TS e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:51.766716   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:44030
I20260709 12:57:51.767220   639 raft_consensus.cc:606] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Received request to transfer leadership to TS e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:51.768420   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:51.769066   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:52.050252   811 raft_consensus.cc:993] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: : Instructing follower e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:52.050683   868 raft_consensus.cc:1081] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Signalling peer e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:52.052021   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19985091313241afb16b93de613462ae"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:33074
I20260709 12:57:52.052510   714 raft_consensus.cc:493] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.052762   714 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.058112   714 raft_consensus.cc:515] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.059836   714 leader_election.cc:290] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 2 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:52.060636   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:52.060930   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:52.061201   566 raft_consensus.cc:3055] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:52.061429   639 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.061579   566 raft_consensus.cc:740] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:52.062392   566 consensus_queue.cc:260] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.063282   566 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:52.066022   639 raft_consensus.cc:2468] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 2.
I20260709 12:57:52.067082   680 leader_election.cc:304] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:52.067759   864 raft_consensus.cc:2804] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:52.068760   566 raft_consensus.cc:2468] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 2.
I20260709 12:57:52.069686   864 raft_consensus.cc:697] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:52.070585   864 consensus_queue.cc:237] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.079154   463 catalog_manager.cc:5697] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 1 to 2, leader changed from 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193) to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.236008   765 raft_consensus.cc:993] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: : Instructing follower e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:52.236482   875 raft_consensus.cc:1081] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Signalling peer e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:52.237809   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:33062
I20260709 12:57:52.238269   714 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.238579   714 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:52.242921   714 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.244656   714 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 3 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:52.245386   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:52.245623   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:52.245882   566 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:52.246163   639 raft_consensus.cc:3055] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:52.246472   639 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:52.247103   639 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.247959   639 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:52.250631   566 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 3.
I20260709 12:57:52.251616   681 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:52.252420   864 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:52.252707   639 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 3.
I20260709 12:57:52.252830   864 raft_consensus.cc:697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:52.253717   864 consensus_queue.cc:237] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.260423   463 catalog_manager.cc:5697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 2 to 3, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.512313   566 raft_consensus.cc:1275] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.513494   864 consensus_queue.cc:1048] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.526556   639 raft_consensus.cc:1275] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:52.527968   864 consensus_queue.cc:1048] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:52.654145   639 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:52.655509   864 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:52.664670   566 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:52.666363   880 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:52.769816   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:52.778959   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:35014
I20260709 12:57:52.779487   566 raft_consensus.cc:606] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:52.783859   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:35014
I20260709 12:57:52.784348   566 raft_consensus.cc:606] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:52.788515   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:35014
I20260709 12:57:52.788993   566 raft_consensus.cc:606] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:52.793579   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19985091313241afb16b93de613462ae"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:50664
I20260709 12:57:52.794066   714 raft_consensus.cc:606] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:52.805335   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
mode: GRACEFUL
new_leader_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:50664
I20260709 12:57:52.805812   714 raft_consensus.cc:606] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Received request to transfer leadership to TS e8b860bc6143444e9742ff376da181d8
I20260709 12:57:52.951922   868 raft_consensus.cc:993] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:52.952402   886 raft_consensus.cc:1081] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:52.953722   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41046
I20260709 12:57:52.954125   639 raft_consensus.cc:493] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:52.954368   639 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:52.958984   639 raft_consensus.cc:515] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.960489   639 leader_election.cc:290] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 3 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:52.961225   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:52.961475   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:52.961808   566 raft_consensus.cc:3055] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:52.961982   714 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:52.962160   566 raft_consensus.cc:740] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:52.962997   566 consensus_queue.cc:260] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.964150   566 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:52.969055   714 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 3.
I20260709 12:57:52.970290   604 leader_election.cc:304] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:52.970708   566 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 3.
I20260709 12:57:52.970969   875 raft_consensus.cc:2804] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:52.971423   875 raft_consensus.cc:697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:52.972141   875 consensus_queue.cc:237] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:52.977880   463 catalog_manager.cc:5697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 2 to 3, leader changed from 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.003410   868 raft_consensus.cc:993] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.003902   886 raft_consensus.cc:1081] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.005302   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41046
I20260709 12:57:53.005836   639 raft_consensus.cc:493] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.006137   639 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.010586   639 raft_consensus.cc:515] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.012059   639 leader_election.cc:290] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:53.012984   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:53.013542   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:53.013557   566 raft_consensus.cc:3055] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:53.014006   566 raft_consensus.cc:740] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:53.014045   714 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.014716   566 consensus_queue.cc:260] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.015600   566 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.019032   714 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:53.020021   604 leader_election.cc:304] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:53.020771   875 raft_consensus.cc:2804] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.021275   875 raft_consensus.cc:697] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:53.021363   566 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 2.
I20260709 12:57:53.022140   875 consensus_queue.cc:237] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.029708   463 catalog_manager.cc:5697] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 1 to 2, leader changed from 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.056842   864 raft_consensus.cc:993] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.057241   880 raft_consensus.cc:1081] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.058519   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:57:53.058905   639 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.059116   639 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:53.062781   639 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.064103   639 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 4 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:53.064898   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:53.065428   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:53.065507   566 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:53.065888   714 raft_consensus.cc:3055] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:53.066143   714 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:53.066665   714 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.067451   714 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:53.070462   566 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 4.
I20260709 12:57:53.071233   714 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 4.
I20260709 12:57:53.071564   607 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:53.072355   875 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:53.072877   875 raft_consensus.cc:697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:53.073586   875 consensus_queue.cc:237] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.078884   463 catalog_manager.cc:5697] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 3 to 4, leader changed from e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.104525   864 raft_consensus.cc:993] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.105008   880 raft_consensus.cc:1081] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.106885   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19985091313241afb16b93de613462ae"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41048
I20260709 12:57:53.107419   639 raft_consensus.cc:493] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.107748   639 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.111492   639 raft_consensus.cc:515] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.112846   639 leader_election.cc:290] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 3 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:53.113627   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:53.113770   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19985091313241afb16b93de613462ae" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:53.114192   566 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.114195   714 raft_consensus.cc:3055] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:53.114722   714 raft_consensus.cc:740] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:53.115444   714 consensus_queue.cc:260] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.116532   714 raft_consensus.cc:3060] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.120325   566 raft_consensus.cc:2468] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 3.
I20260709 12:57:53.121398   607 leader_election.cc:304] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:53.121954   714 raft_consensus.cc:2468] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 3.
I20260709 12:57:53.122108   875 raft_consensus.cc:2804] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:53.122658   875 raft_consensus.cc:697] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:53.123381   875 consensus_queue.cc:237] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:53.129181   463 catalog_manager.cc:5697] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 2 to 3, leader changed from e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.130405   868 raft_consensus.cc:993] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: : Instructing follower e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.130893   886 raft_consensus.cc:1081] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Signalling peer e8b860bc6143444e9742ff376da181d8 to start an election
I20260709 12:57:53.132264   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
 from {username='slave'} at 127.0.0.1:41046
I20260709 12:57:53.132748   639 raft_consensus.cc:493] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:53.133064   639 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.137814   639 raft_consensus.cc:515] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:53.139030   639 leader_election.cc:290] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 3 election: Requested vote from peers e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493), 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665)
I20260709 12:57:53.139811   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:53.139941   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e8b860bc6143444e9742ff376da181d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:53.140388   714 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.140497   566 raft_consensus.cc:3055] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:53.140810   566 raft_consensus.cc:740] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:53.141402   566 consensus_queue.cc:260] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:53.142204   566 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:53.144373   714 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 3.
I20260709 12:57:53.145210   604 leader_election.cc:304] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e00db112b9fb4f4486f8c78cde65f7c8, e8b860bc6143444e9742ff376da181d8; no voters: 
I20260709 12:57:53.145908   875 raft_consensus.cc:2804] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:53.146294   875 raft_consensus.cc:697] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Becoming Leader. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:53.146310   566 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b860bc6143444e9742ff376da181d8 in term 3.
I20260709 12:57:53.147064   875 consensus_queue.cc:237] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:53.152937   463 catalog_manager.cc:5697] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 reported cstate change: term changed from 2 to 3, leader changed from 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193) to e8b860bc6143444e9742ff376da181d8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e8b860bc6143444e9742ff376da181d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:53.356117   566 raft_consensus.cc:1275] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.357259   875 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.365191   714 raft_consensus.cc:1275] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.367208   765 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.487599   566 raft_consensus.cc:1275] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:53.488873   765 consensus_queue.cc:1048] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:53.491422   714 raft_consensus.cc:1275] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:53.492887   765 consensus_queue.cc:1048] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:53.568588   715 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:53.568953   713 raft_consensus.cc:1275] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.570119   900 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:53.570343   901 consensus_queue.cc:1048] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.574146   714 raft_consensus.cc:1275] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.576334   875 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.586321   566 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:53.587697   901 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:53.600327   565 raft_consensus.cc:1275] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.600934   566 raft_consensus.cc:1275] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Refusing update from remote peer e8b860bc6143444e9742ff376da181d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:53.602448   904 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:53.602818   875 consensus_queue.cc:1048] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:55.810160   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:55.817688   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:44030
I20260709 12:57:55.818528   639 raft_consensus.cc:606] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 LEADER]: Received request to transfer leadership to TS 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:55.821578   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:44030
I20260709 12:57:55.821995   639 raft_consensus.cc:606] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Received request to transfer leadership to TS e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:55.824010   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:44030
I20260709 12:57:55.824419   639 raft_consensus.cc:606] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Received request to transfer leadership to TS e00db112b9fb4f4486f8c78cde65f7c8
I20260709 12:57:55.826467   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:44030
I20260709 12:57:55.826855   639 raft_consensus.cc:606] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Received request to transfer leadership to TS 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:55.828867   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248"
dest_uuid: "e8b860bc6143444e9742ff376da181d8"
mode: GRACEFUL
new_leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:44030
I20260709 12:57:55.829242   639 raft_consensus.cc:606] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Received request to transfer leadership to TS 32c28e9d31d14f4fae18c4e58dfa1960
I20260709 12:57:55.830200   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:55.830579   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:55.872536   875 raft_consensus.cc:993] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: : Instructing follower 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:55.873031   901 raft_consensus.cc:1081] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Signalling peer 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:55.874433   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:35456
I20260709 12:57:55.874833   566 raft_consensus.cc:493] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:55.875087   566 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.879619   566 raft_consensus.cc:515] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:55.881124   566 leader_election.cc:290] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 3 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:55.882079   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:55.882314   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1fb75378724478b1ee7af1cce6c248" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:55.882867   714 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.882853   639 raft_consensus.cc:3055] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:55.883358   639 raft_consensus.cc:740] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:55.884166   639 consensus_queue.cc:260] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:55.885391   639 raft_consensus.cc:3060] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.889182   714 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 3.
I20260709 12:57:55.890372   529 leader_election.cc:304] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:55.890980   639 raft_consensus.cc:2468] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 3.
I20260709 12:57:55.892016   908 raft_consensus.cc:2804] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:55.892841   908 raft_consensus.cc:697] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:55.893584   908 consensus_queue.cc:237] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:55.899783   462 catalog_manager.cc:5697] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 2 to 3, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:55.955509   875 raft_consensus.cc:993] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: : Instructing follower e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:55.955921   875 raft_consensus.cc:1081] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Signalling peer e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:55.957283   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:33062
I20260709 12:57:55.957734   714 raft_consensus.cc:493] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:55.958007   714 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:55.961848   714 raft_consensus.cc:515] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:55.963253   714 leader_election.cc:290] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 4 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:55.964119   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:55.964165   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a47a08dafc4361a9e8e788a25ad4bd" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:55.964716   639 raft_consensus.cc:3055] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:55.964684   566 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:55.965097   639 raft_consensus.cc:740] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:55.965833   639 consensus_queue.cc:260] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:55.966904   639 raft_consensus.cc:3060] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:55.970594   566 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 4.
I20260709 12:57:55.971861   681 leader_election.cc:304] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:55.972322   639 raft_consensus.cc:2468] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 4.
I20260709 12:57:55.972705   880 raft_consensus.cc:2804] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:55.973846   880 raft_consensus.cc:697] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:55.974639   880 consensus_queue.cc:237] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } }
I20260709 12:57:55.980883   462 catalog_manager.cc:5697] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 3 to 4, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:56.083524   901 raft_consensus.cc:993] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: : Instructing follower 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:56.083976   875 raft_consensus.cc:1081] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Signalling peer 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:56.085355   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:35456
I20260709 12:57:56.085817   566 raft_consensus.cc:493] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:56.086069   566 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:56.089915   566 raft_consensus.cc:515] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.091198   566 leader_election.cc:290] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 4 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:56.092097   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:56.092602   639 raft_consensus.cc:3055] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:56.092834   639 raft_consensus.cc:740] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:56.093029   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e64c1df7a14b6d9c0d9feafc3cc3a0" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:56.093566   714 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:56.093674   639 consensus_queue.cc:260] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.094849   639 raft_consensus.cc:3060] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:56.099613   714 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 4.
I20260709 12:57:56.100662   639 raft_consensus.cc:2468] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 4.
I20260709 12:57:56.100739   529 leader_election.cc:304] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:56.101574   908 raft_consensus.cc:2804] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:56.101895   908 raft_consensus.cc:697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:56.102581   908 consensus_queue.cc:237] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.109306   462 catalog_manager.cc:5697] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 3 to 4, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:56.132418   901 raft_consensus.cc:993] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: : Instructing follower e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:56.133064   875 raft_consensus.cc:1081] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Signalling peer e00db112b9fb4f4486f8c78cde65f7c8 to start an election
I20260709 12:57:56.134498   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c"
dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
 from {username='slave'} at 127.0.0.1:33062
I20260709 12:57:56.134943   714 raft_consensus.cc:493] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:56.135251   714 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.139083   714 raft_consensus.cc:515] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.140530   714 leader_election.cc:290] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 3 election: Requested vote from peers 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665), e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769)
I20260709 12:57:56.141399   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:56.141314   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a96a2ef9444d4484fdac3451506a6c" candidate_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
I20260709 12:57:56.141975   639 raft_consensus.cc:3055] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:56.142005   566 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.142448   639 raft_consensus.cc:740] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:56.143129   639 consensus_queue.cc:260] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.144196   639 raft_consensus.cc:3060] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:56.148020   566 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 3.
I20260709 12:57:56.149097   681 leader_election.cc:304] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:56.149883   880 raft_consensus.cc:2804] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:56.150022   639 raft_consensus.cc:2468] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e00db112b9fb4f4486f8c78cde65f7c8 in term 3.
I20260709 12:57:56.150301   880 raft_consensus.cc:697] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Becoming Leader. State: Replica: e00db112b9fb4f4486f8c78cde65f7c8, State: Running, Role: LEADER
I20260709 12:57:56.151176   880 consensus_queue.cc:237] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.157301   462 catalog_manager.cc:5697] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 reported cstate change: term changed from 2 to 3, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:56.164057   901 raft_consensus.cc:993] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: : Instructing follower 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:56.164525   875 raft_consensus.cc:1081] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 LEADER]: Signalling peer 32c28e9d31d14f4fae18c4e58dfa1960 to start an election
I20260709 12:57:56.165962   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08"
dest_uuid: "32c28e9d31d14f4fae18c4e58dfa1960"
 from {username='slave'} at 127.0.0.1:35456
I20260709 12:57:56.166318   566 raft_consensus.cc:493] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:56.166532   566 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.170140   566 raft_consensus.cc:515] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.171739   566 leader_election.cc:290] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 5 election: Requested vote from peers e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769), e00db112b9fb4f4486f8c78cde65f7c8 (127.0.107.195:38493)
I20260709 12:57:56.172575   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e8b860bc6143444e9742ff376da181d8"
I20260709 12:57:56.172829   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf655eac3fe48f1aaabea2bbbec7b08" candidate_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e00db112b9fb4f4486f8c78cde65f7c8"
I20260709 12:57:56.173146   639 raft_consensus.cc:3055] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:56.173316   714 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.173506   639 raft_consensus.cc:740] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8b860bc6143444e9742ff376da181d8, State: Running, Role: LEADER
I20260709 12:57:56.174230   639 consensus_queue.cc:260] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.175014   639 raft_consensus.cc:3060] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.177286   714 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 5.
I20260709 12:57:56.178174   529 leader_election.cc:304] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c28e9d31d14f4fae18c4e58dfa1960, e00db112b9fb4f4486f8c78cde65f7c8; no voters: 
I20260709 12:57:56.178838   908 raft_consensus.cc:2804] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:56.178916   639 raft_consensus.cc:2468] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c28e9d31d14f4fae18c4e58dfa1960 in term 5.
I20260709 12:57:56.179334   908 raft_consensus.cc:697] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 5 LEADER]: Becoming Leader. State: Replica: 32c28e9d31d14f4fae18c4e58dfa1960, State: Running, Role: LEADER
I20260709 12:57:56.180200   908 consensus_queue.cc:237] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } }
I20260709 12:57:56.186203   462 catalog_manager.cc:5697] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 reported cstate change: term changed from 4 to 5, leader changed from e8b860bc6143444e9742ff376da181d8 (127.0.107.194) to 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:56.434612   565 raft_consensus.cc:1275] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:56.435796   880 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:56.445451   639 raft_consensus.cc:1275] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:56.447058   915 consensus_queue.cc:1048] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:56.481429   714 raft_consensus.cc:1275] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:56.482476   908 consensus_queue.cc:1048] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:56.489627   714 raft_consensus.cc:1275] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:56.490868   639 raft_consensus.cc:1275] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:56.491413   908 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:56.493360   927 consensus_queue.cc:1048] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:56.507920   639 raft_consensus.cc:1275] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:56.509341   926 consensus_queue.cc:1048] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:56.672979   565 raft_consensus.cc:1275] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:56.674068   915 consensus_queue.cc:1048] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c28e9d31d14f4fae18c4e58dfa1960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:56.682296   639 raft_consensus.cc:1275] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Refusing update from remote peer e00db112b9fb4f4486f8c78cde65f7c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:56.684120   932 consensus_queue.cc:1048] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:56.803162   639 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 5 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:56.803478   713 raft_consensus.cc:1275] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 5 FOLLOWER]: Refusing update from remote peer 32c28e9d31d14f4fae18c4e58dfa1960: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:56.804450   927 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b860bc6143444e9742ff376da181d8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:56.805146   926 consensus_queue.cc:1048] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00db112b9fb4f4486f8c78cde65f7c8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:56.831331   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:56.836472   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:57:56.863782   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:56.865190   431 tablet_replica.cc:333] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.866147   431 raft_consensus.cc:2243] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:56.866856   431 raft_consensus.cc:2272] T f9737c83111d4608a6f5fcfec38cf75d P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.869750   431 tablet_replica.cc:333] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.870458   431 raft_consensus.cc:2243] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:56.870975   431 raft_consensus.cc:2272] T ddafe4cd1bdd4883913602cc73aac5c3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.872699   431 tablet_replica.cc:333] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.873165   431 raft_consensus.cc:2243] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:56.873557   431 raft_consensus.cc:2272] T d0a96a2ef9444d4484fdac3451506a6c P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.876111   431 tablet_replica.cc:333] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.876641   431 raft_consensus.cc:2243] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:57:56.877302   431 raft_consensus.cc:2272] T aaf655eac3fe48f1aaabea2bbbec7b08 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.879837   431 tablet_replica.cc:333] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.880381   431 raft_consensus.cc:2243] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:56.880820   431 raft_consensus.cc:2272] T b6a47a08dafc4361a9e8e788a25ad4bd P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.882791   431 tablet_replica.cc:333] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.883318   431 raft_consensus.cc:2243] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:56.883772   431 raft_consensus.cc:2272] T 278b4c1203584c929d4fe70375f0c7d3 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.885522   431 tablet_replica.cc:333] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.886001   431 raft_consensus.cc:2243] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:56.886715   431 raft_consensus.cc:2272] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.888867   431 tablet_replica.cc:333] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.889345   431 raft_consensus.cc:2243] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:56.890070   431 raft_consensus.cc:2272] T ec1fb75378724478b1ee7af1cce6c248 P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:56.891853   431 tablet_replica.cc:333] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960: stopping tablet replica
I20260709 12:57:56.892385   431 raft_consensus.cc:2243] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:56.892797   431 raft_consensus.cc:2272] T 19985091313241afb16b93de613462ae P 32c28e9d31d14f4fae18c4e58dfa1960 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:56.985352   607 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39665: connect: Connection refused (error 111)
I20260709 12:57:56.987037   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:57:56.988989   607 consensus_peers.cc:597] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 -> Peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Couldn't send request to peer 32c28e9d31d14f4fae18c4e58dfa1960. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.006440   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:57:57.031889   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:57.032608   431 tablet_replica.cc:333] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.033296   431 raft_consensus.cc:2243] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.033824   431 raft_consensus.cc:2272] T b6a47a08dafc4361a9e8e788a25ad4bd P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:57.035213   681 consensus_peers.cc:597] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 -> Peer 32c28e9d31d14f4fae18c4e58dfa1960 (127.0.107.193:39665): Couldn't send request to peer 32c28e9d31d14f4fae18c4e58dfa1960. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.036450   431 tablet_replica.cc:333] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.036966   431 raft_consensus.cc:2243] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.037351   431 raft_consensus.cc:2272] T aaf655eac3fe48f1aaabea2bbbec7b08 P e8b860bc6143444e9742ff376da181d8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.039216   431 tablet_replica.cc:333] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.039688   431 raft_consensus.cc:2243] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.040472   431 raft_consensus.cc:2272] T 278b4c1203584c929d4fe70375f0c7d3 P e8b860bc6143444e9742ff376da181d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.042034   431 tablet_replica.cc:333] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.042538   431 raft_consensus.cc:2243] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.042914   431 raft_consensus.cc:2272] T f9737c83111d4608a6f5fcfec38cf75d P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.044575   431 tablet_replica.cc:333] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.045046   431 raft_consensus.cc:2243] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.045403   431 raft_consensus.cc:2272] T d0a96a2ef9444d4484fdac3451506a6c P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.047464   431 tablet_replica.cc:333] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.047919   431 raft_consensus.cc:2243] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.048367   431 raft_consensus.cc:2272] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e8b860bc6143444e9742ff376da181d8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.050345   431 tablet_replica.cc:333] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.050906   431 raft_consensus.cc:2243] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.051749   431 raft_consensus.cc:2272] T ddafe4cd1bdd4883913602cc73aac5c3 P e8b860bc6143444e9742ff376da181d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.053557   431 tablet_replica.cc:333] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.054129   431 raft_consensus.cc:2243] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:57:57.054466   680 consensus_peers.cc:597] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 -> Peer e8b860bc6143444e9742ff376da181d8 (127.0.107.194:40769): Couldn't send request to peer e8b860bc6143444e9742ff376da181d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.054545   431 raft_consensus.cc:2272] T ec1fb75378724478b1ee7af1cce6c248 P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.056317   431 tablet_replica.cc:333] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8: stopping tablet replica
I20260709 12:57:57.056732   431 raft_consensus.cc:2243] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.057369   431 raft_consensus.cc:2272] T 19985091313241afb16b93de613462ae P e8b860bc6143444e9742ff376da181d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.083494   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:57:57.099278   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:57:57.124758   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:57.125526   431 tablet_replica.cc:333] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.126327   431 raft_consensus.cc:2243] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.127285   431 raft_consensus.cc:2272] T f9737c83111d4608a6f5fcfec38cf75d P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.129685   431 tablet_replica.cc:333] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.130385   431 raft_consensus.cc:2243] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.131273   431 raft_consensus.cc:2272] T d0a96a2ef9444d4484fdac3451506a6c P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.133602   431 tablet_replica.cc:333] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.134024   431 raft_consensus.cc:2243] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.134382   431 raft_consensus.cc:2272] T aaf655eac3fe48f1aaabea2bbbec7b08 P e00db112b9fb4f4486f8c78cde65f7c8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.136715   431 tablet_replica.cc:333] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.137148   431 raft_consensus.cc:2243] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.137487   431 raft_consensus.cc:2272] T ddafe4cd1bdd4883913602cc73aac5c3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.138926   431 tablet_replica.cc:333] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.139328   431 raft_consensus.cc:2243] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.139657   431 raft_consensus.cc:2272] T 19985091313241afb16b93de613462ae P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.141090   431 tablet_replica.cc:333] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.141480   431 raft_consensus.cc:2243] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.141796   431 raft_consensus.cc:2272] T ec1fb75378724478b1ee7af1cce6c248 P e00db112b9fb4f4486f8c78cde65f7c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.143558   431 tablet_replica.cc:333] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.143952   431 raft_consensus.cc:2243] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.144313   431 raft_consensus.cc:2272] T e0e64c1df7a14b6d9c0d9feafc3cc3a0 P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.146226   431 tablet_replica.cc:333] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.146616   431 raft_consensus.cc:2243] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:57.146922   431 raft_consensus.cc:2272] T 278b4c1203584c929d4fe70375f0c7d3 P e00db112b9fb4f4486f8c78cde65f7c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.148411   431 tablet_replica.cc:333] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8: stopping tablet replica
I20260709 12:57:57.148768   431 raft_consensus.cc:2243] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.149410   431 raft_consensus.cc:2272] T b6a47a08dafc4361a9e8e788a25ad4bd P e00db112b9fb4f4486f8c78cde65f7c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.174256   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:57:57.189813   431 master.cc:562] Master@127.0.107.254:32983 shutting down...
I20260709 12:57:57.388091   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:57.388660   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:57.388952   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0365df2057e64f2e8861b461cdd291fc: stopping tablet replica
I20260709 12:57:57.407213   431 master.cc:584] Master@127.0.107.254:32983 shutdown complete.
32c28e9d31d14f4fae18c4e58dfa1960  4
e00db112b9fb4f4486f8c78cde65f7c8  1
e8b860bc6143444e9742ff376da181d8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13010 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:57:57.445564   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46289
I20260709 12:57:57.446666   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:57.452186   940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.452977   943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.452898   941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:57.455128   431 server_base.cc:1061] running on GCE node
I20260709 12:57:57.455866   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:57.456043   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:57.456216   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601877456202 us; error 0 us; skew 500 ppm
I20260709 12:57:57.456766   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:57.459158   431 webserver.cc:533] Webserver started at http://127.0.107.254:40569/ using document root <none> and password file <none>
I20260709 12:57:57.459661   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:57.459820   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:57.460135   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:57.461253   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "87cfbadb0eb44812a8eeaf40850a2b12"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.465415   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:57:57.468587   948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.469290   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:57:57.469573   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "87cfbadb0eb44812a8eeaf40850a2b12"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.469854   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:57.483814   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:57.485059   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:57.521919   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46289
I20260709 12:57:57.522012   999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46289 every 8 connection(s)
I20260709 12:57:57.525727  1000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:57.534741  1000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12: Bootstrap starting.
I20260709 12:57:57.540331  1000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.544346  1000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12: No bootstrap required, opened a new log
I20260709 12:57:57.546309  1000 raft_consensus.cc:359] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" member_type: VOTER }
I20260709 12:57:57.546703  1000 raft_consensus.cc:385] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.546937  1000 raft_consensus.cc:740] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87cfbadb0eb44812a8eeaf40850a2b12, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.547544  1000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" member_type: VOTER }
I20260709 12:57:57.547968  1000 raft_consensus.cc:399] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:57.548174  1000 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:57.548491  1000 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.552330  1000 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" member_type: VOTER }
I20260709 12:57:57.552850  1000 leader_election.cc:304] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87cfbadb0eb44812a8eeaf40850a2b12; no voters: 
I20260709 12:57:57.553941  1000 leader_election.cc:290] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:57.554255  1003 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.555588  1003 raft_consensus.cc:697] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 1 LEADER]: Becoming Leader. State: Replica: 87cfbadb0eb44812a8eeaf40850a2b12, State: Running, Role: LEADER
I20260709 12:57:57.556305  1003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" member_type: VOTER }
I20260709 12:57:57.556926  1000 sys_catalog.cc:565] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:57.561410  1005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87cfbadb0eb44812a8eeaf40850a2b12. Latest consensus state: current_term: 1 leader_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" member_type: VOTER } }
I20260709 12:57:57.562326  1005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:57.562880  1004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87cfbadb0eb44812a8eeaf40850a2b12" member_type: VOTER } }
I20260709 12:57:57.563478  1004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:57.564644  1011 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:57.572183  1011 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:57.573403   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:57.580765  1011 catalog_manager.cc:1383] Generated new cluster ID: 16732bff3c594ed4a090d85984d25ce8
I20260709 12:57:57.581072  1011 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:57.601082  1011 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:57.602540  1011 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:57.623600  1011 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12: Generated new TSK 0
I20260709 12:57:57.624218  1011 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:57.640018   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:57.645787  1021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.646744  1022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.648334  1024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:57.648886   431 server_base.cc:1061] running on GCE node
I20260709 12:57:57.649770   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:57.649986   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:57.650194   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601877650174 us; error 0 us; skew 500 ppm
I20260709 12:57:57.650739   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:57.652928   431 webserver.cc:533] Webserver started at http://127.0.107.193:33127/ using document root <none> and password file <none>
I20260709 12:57:57.653410   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:57.653607   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:57.653889   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:57.654928   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.659281   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:57:57.662393  1029 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.663125   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:57:57.663431   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.663699   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:57.679231   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:57.680575   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:57.682035   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:57.684197   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:57.684437   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.684684   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:57.684870   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.723577   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38747
I20260709 12:57:57.723682  1091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38747 every 8 connection(s)
I20260709 12:57:57.728406   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:57.735311  1096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.736380  1097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:57.739121   431 server_base.cc:1061] running on GCE node
W20260709 12:57:57.739871  1099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:57.740692   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:57.740900   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:57.741025   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601877741014 us; error 0 us; skew 500 ppm
I20260709 12:57:57.741482   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:57.743677   431 webserver.cc:533] Webserver started at http://127.0.107.194:37183/ using document root <none> and password file <none>
I20260709 12:57:57.744355   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:57.744593   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:57.744896   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:57.746291  1092 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46289
I20260709 12:57:57.746281   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "510684f49c9e49a8838857869ba37ba9"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.746752  1092 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:57.747619  1092 heartbeater.cc:507] Master 127.0.107.254:46289 requested a full tablet report, sending...
I20260709 12:57:57.749693   965 ts_manager.cc:194] Registered new tserver with Master: 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747)
I20260709 12:57:57.751627   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:57:57.751745   965 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46468
I20260709 12:57:57.755292  1104 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.756031   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:57:57.756376   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "510684f49c9e49a8838857869ba37ba9"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.756671   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:57.767455   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:57.768710   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:57.770102   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:57.772397   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:57.772615   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.772848   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:57.773015   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.810804   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38341
I20260709 12:57:57.810899  1166 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38341 every 8 connection(s)
I20260709 12:57:57.815405   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:57.821966  1170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.823000  1171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:57.825024  1173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:57.825212   431 server_base.cc:1061] running on GCE node
I20260709 12:57:57.826447   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:57.826669   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:57.826864   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601877826845 us; error 0 us; skew 500 ppm
I20260709 12:57:57.827358  1167 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46289
I20260709 12:57:57.827497   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:57.827732  1167 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:57.828539  1167 heartbeater.cc:507] Master 127.0.107.254:46289 requested a full tablet report, sending...
I20260709 12:57:57.830255   431 webserver.cc:533] Webserver started at http://127.0.107.195:37429/ using document root <none> and password file <none>
I20260709 12:57:57.830881   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:57.830788   965 ts_manager.cc:194] Registered new tserver with Master: 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:57.831208   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:57.831537   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:57.832672   965 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46472
I20260709 12:57:57.833032   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "a068c0f86c2a4282a961df8be5c95435"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.837563   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:57:57.840641  1178 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.841352   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:57:57.841602   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "a068c0f86c2a4282a961df8be5c95435"
format_stamp: "Formatted at 2026-07-09 12:57:57 on dist-test-slave-vcr9"
I20260709 12:57:57.841831   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:57.859267   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:57.860447   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:57.861788   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:57.863898   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:57.864068   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.864372   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:57.864517   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:57.902516   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36165
I20260709 12:57:57.902753  1240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36165 every 8 connection(s)
I20260709 12:57:57.915757  1241 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46289
I20260709 12:57:57.916137  1241 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:57.916877  1241 heartbeater.cc:507] Master 127.0.107.254:46289 requested a full tablet report, sending...
I20260709 12:57:57.918700   965 ts_manager.cc:194] Registered new tserver with Master: a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:57.919654   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014190838s
I20260709 12:57:57.920094   965 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46478
I20260709 12:57:57.943601   965 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46480:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:57.946341   965 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:58.038460  1130 tablet_service.cc:1511] Processing CreateTablet for tablet 501f9fa2eb1b4e60afa31547fcfc1af7 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:58.039978  1130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501f9fa2eb1b4e60afa31547fcfc1af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.040392  1127 tablet_service.cc:1511] Processing CreateTablet for tablet 2c95edc2809d4ae79842ca4aed05c354 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:58.041720  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c95edc2809d4ae79842ca4aed05c354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.044462  1126 tablet_service.cc:1511] Processing CreateTablet for tablet c5e7b519fdb64824a00ea8841a13789a (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:58.045357  1129 tablet_service.cc:1511] Processing CreateTablet for tablet fbd570861fbd463080e4641319dab1ba (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:58.047267  1131 tablet_service.cc:1511] Processing CreateTablet for tablet 199ccdada50342ec82e4dc5eca71c861 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:58.047541  1128 tablet_service.cc:1511] Processing CreateTablet for tablet dd65593693dd449d9f907e6ea29b6890 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:58.045766  1126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e7b519fdb64824a00ea8841a13789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.049481  1132 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc66927689c49a5addaa19f63574728 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:58.050495  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65593693dd449d9f907e6ea29b6890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.051626  1203 tablet_service.cc:1511] Processing CreateTablet for tablet fbd570861fbd463080e4641319dab1ba (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:58.052950  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd570861fbd463080e4641319dab1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.052706  1202 tablet_service.cc:1511] Processing CreateTablet for tablet dd65593693dd449d9f907e6ea29b6890 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:58.053997  1202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65593693dd449d9f907e6ea29b6890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.055060  1204 tablet_service.cc:1511] Processing CreateTablet for tablet 501f9fa2eb1b4e60afa31547fcfc1af7 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:58.056558  1129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd570861fbd463080e4641319dab1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.057394  1205 tablet_service.cc:1511] Processing CreateTablet for tablet 199ccdada50342ec82e4dc5eca71c861 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:58.059559  1206 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc66927689c49a5addaa19f63574728 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:58.061839  1200 tablet_service.cc:1511] Processing CreateTablet for tablet c5e7b519fdb64824a00ea8841a13789a (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:58.064000  1201 tablet_service.cc:1511] Processing CreateTablet for tablet 2c95edc2809d4ae79842ca4aed05c354 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:58.066186  1199 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9db541c34144f7ac6a4c48efbc64a3 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:58.067831  1125 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9db541c34144f7ac6a4c48efbc64a3 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:58.069000  1204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501f9fa2eb1b4e60afa31547fcfc1af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.069639  1200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e7b519fdb64824a00ea8841a13789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.070290  1199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9db541c34144f7ac6a4c48efbc64a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.074435  1131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199ccdada50342ec82e4dc5eca71c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.083123  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc66927689c49a5addaa19f63574728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.076472  1206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc66927689c49a5addaa19f63574728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.077251  1198 tablet_service.cc:1511] Processing CreateTablet for tablet 02711afdec9640f6bd510a50bb620a1e (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:58.078176  1197 tablet_service.cc:1511] Processing CreateTablet for tablet 1c49c337200e4db7acb3190c2fb37277 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:58.079263  1124 tablet_service.cc:1511] Processing CreateTablet for tablet 02711afdec9640f6bd510a50bb620a1e (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:58.080992  1123 tablet_service.cc:1511] Processing CreateTablet for tablet 1c49c337200e4db7acb3190c2fb37277 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:58.089021  1125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9db541c34144f7ac6a4c48efbc64a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.090161  1124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02711afdec9640f6bd510a50bb620a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.091315  1123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c49c337200e4db7acb3190c2fb37277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.096840  1197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c49c337200e4db7acb3190c2fb37277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.100544  1198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02711afdec9640f6bd510a50bb620a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.104528  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c95edc2809d4ae79842ca4aed05c354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.112699  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199ccdada50342ec82e4dc5eca71c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.125001  1057 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc66927689c49a5addaa19f63574728 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:58.126315  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc66927689c49a5addaa19f63574728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.129483  1052 tablet_service.cc:1511] Processing CreateTablet for tablet 2c95edc2809d4ae79842ca4aed05c354 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:58.129889  1051 tablet_service.cc:1511] Processing CreateTablet for tablet c5e7b519fdb64824a00ea8841a13789a (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:58.130926  1052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c95edc2809d4ae79842ca4aed05c354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.132113  1050 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9db541c34144f7ac6a4c48efbc64a3 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:58.133452  1050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9db541c34144f7ac6a4c48efbc64a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.137341  1053 tablet_service.cc:1511] Processing CreateTablet for tablet dd65593693dd449d9f907e6ea29b6890 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:58.138664  1053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65593693dd449d9f907e6ea29b6890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.143182  1056 tablet_service.cc:1511] Processing CreateTablet for tablet 199ccdada50342ec82e4dc5eca71c861 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:58.172096  1055 tablet_service.cc:1511] Processing CreateTablet for tablet 501f9fa2eb1b4e60afa31547fcfc1af7 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:58.172546  1049 tablet_service.cc:1511] Processing CreateTablet for tablet 02711afdec9640f6bd510a50bb620a1e (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:58.175400  1054 tablet_service.cc:1511] Processing CreateTablet for tablet fbd570861fbd463080e4641319dab1ba (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:58.176939  1048 tablet_service.cc:1511] Processing CreateTablet for tablet 1c49c337200e4db7acb3190c2fb37277 (DEFAULT_TABLE table=test-workload [id=6e9beaaccea04bafb311efbdba1b7588]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:58.184362  1051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e7b519fdb64824a00ea8841a13789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.185060  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199ccdada50342ec82e4dc5eca71c861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.189015  1257 tablet_bootstrap.cc:492] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.189990  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c49c337200e4db7acb3190c2fb37277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.196588  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501f9fa2eb1b4e60afa31547fcfc1af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.209991  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd570861fbd463080e4641319dab1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.212697  1049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02711afdec9640f6bd510a50bb620a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:58.217881  1257 tablet_bootstrap.cc:654] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.244997  1256 tablet_bootstrap.cc:492] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.260918  1258 tablet_bootstrap.cc:492] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.268707  1257 tablet_bootstrap.cc:492] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.269340  1257 ts_tablet_manager.cc:1403] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
I20260709 12:57:58.271281  1256 tablet_bootstrap.cc:654] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.274607  1257 raft_consensus.cc:359] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.271418  1258 tablet_bootstrap.cc:654] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.275269  1257 raft_consensus.cc:385] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.276422  1257 raft_consensus.cc:740] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.277554  1256 tablet_bootstrap.cc:492] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.277194  1257 consensus_queue.cc:260] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.277997  1256 ts_tablet_manager.cc:1403] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:57:58.280139  1256 raft_consensus.cc:359] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.280759  1256 raft_consensus.cc:385] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.281018  1256 raft_consensus.cc:740] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.281769  1256 consensus_queue.cc:260] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.283490  1258 tablet_bootstrap.cc:492] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.284006  1258 ts_tablet_manager.cc:1403] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.003s
I20260709 12:57:58.284076  1167 heartbeater.cc:499] Master 127.0.107.254:46289 was elected leader, sending a full tablet report...
I20260709 12:57:58.284283  1257 ts_tablet_manager.cc:1434] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:57:58.284650  1256 ts_tablet_manager.cc:1434] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:57:58.284945  1241 heartbeater.cc:499] Master 127.0.107.254:46289 was elected leader, sending a full tablet report...
I20260709 12:57:58.285604  1256 tablet_bootstrap.cc:492] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.287309  1258 raft_consensus.cc:359] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.288081  1258 raft_consensus.cc:385] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.288455  1258 raft_consensus.cc:740] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.289166  1257 tablet_bootstrap.cc:492] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.292346  1256 tablet_bootstrap.cc:654] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.292693  1258 consensus_queue.cc:260] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.296481  1257 tablet_bootstrap.cc:654] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.300354  1092 heartbeater.cc:499] Master 127.0.107.254:46289 was elected leader, sending a full tablet report...
I20260709 12:57:58.301452  1256 tablet_bootstrap.cc:492] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.301934  1256 ts_tablet_manager.cc:1403] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:57:58.304979  1256 raft_consensus.cc:359] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.305648  1257 tablet_bootstrap.cc:492] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.305716  1256 raft_consensus.cc:385] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.306192  1257 ts_tablet_manager.cc:1403] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.017s	user 0.001s	sys 0.012s
I20260709 12:57:58.306150  1256 raft_consensus.cc:740] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.307123  1256 consensus_queue.cc:260] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.309310  1256 ts_tablet_manager.cc:1434] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:58.309366  1257 raft_consensus.cc:359] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.310171  1257 raft_consensus.cc:385] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.310282  1256 tablet_bootstrap.cc:492] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.310508  1257 raft_consensus.cc:740] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.310644  1258 ts_tablet_manager.cc:1434] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.007s
I20260709 12:57:58.311637  1258 tablet_bootstrap.cc:492] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.311432  1257 consensus_queue.cc:260] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.313807  1257 ts_tablet_manager.cc:1434] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:57:58.314719  1257 tablet_bootstrap.cc:492] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.317234  1256 tablet_bootstrap.cc:654] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.318840  1258 tablet_bootstrap.cc:654] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.321192  1257 tablet_bootstrap.cc:654] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.329509  1258 tablet_bootstrap.cc:492] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.330144  1258 ts_tablet_manager.cc:1403] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:57:58.333101  1257 tablet_bootstrap.cc:492] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.329509  1256 tablet_bootstrap.cc:492] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.333626  1257 ts_tablet_manager.cc:1403] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:57:58.333719  1256 ts_tablet_manager.cc:1403] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.016s
I20260709 12:57:58.332729  1258 raft_consensus.cc:359] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.336020  1258 raft_consensus.cc:385] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.336400  1258 raft_consensus.cc:740] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.336786  1256 raft_consensus.cc:359] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.337471  1256 raft_consensus.cc:385] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.337767  1256 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.337957  1257 raft_consensus.cc:359] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.338655  1257 raft_consensus.cc:385] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.338863  1257 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.338492  1256 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.339579  1257 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.341099  1256 ts_tablet_manager.cc:1434] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:58.340727  1258 consensus_queue.cc:260] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.342078  1256 tablet_bootstrap.cc:492] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.344956  1257 ts_tablet_manager.cc:1434] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:57:58.345868  1257 tablet_bootstrap.cc:492] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.349022  1256 tablet_bootstrap.cc:654] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.343048  1258 ts_tablet_manager.cc:1434] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:57:58.352814  1257 tablet_bootstrap.cc:654] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.353099  1258 tablet_bootstrap.cc:492] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.362534  1258 tablet_bootstrap.cc:654] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.375751  1258 tablet_bootstrap.cc:492] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.376415  1258 ts_tablet_manager.cc:1403] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.014s
I20260709 12:57:58.383486  1258 raft_consensus.cc:359] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.384204  1262 raft_consensus.cc:493] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.384615  1258 raft_consensus.cc:385] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.385082  1258 raft_consensus.cc:740] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.384888  1262 raft_consensus.cc:515] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.386204  1258 consensus_queue.cc:260] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.391359  1262 leader_election.cc:290] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.391482  1263 raft_consensus.cc:493] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.392177  1263 raft_consensus.cc:515] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.407101  1257 tablet_bootstrap.cc:492] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.407696  1257 ts_tablet_manager.cc:1403] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.062s	user 0.035s	sys 0.025s
I20260709 12:57:58.408895  1256 tablet_bootstrap.cc:492] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.409363  1256 ts_tablet_manager.cc:1403] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.042s
I20260709 12:57:58.409871  1258 ts_tablet_manager.cc:1434] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:57:58.410982  1257 raft_consensus.cc:359] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.411777  1257 raft_consensus.cc:385] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.412149  1257 raft_consensus.cc:740] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.412088  1256 raft_consensus.cc:359] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.412863  1256 raft_consensus.cc:385] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.413046  1257 consensus_queue.cc:260] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.414165  1256 raft_consensus.cc:740] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.414986  1256 consensus_queue.cc:260] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.416759  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.417424  1257 ts_tablet_manager.cc:1434] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:58.417589  1142 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.418550  1257 tablet_bootstrap.cc:492] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.418641  1263 leader_election.cc:290] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.419178  1179 leader_election.cc:304] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:57:58.420010  1262 raft_consensus.cc:2804] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.421983  1262 raft_consensus.cc:493] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.422374  1262 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.427376  1257 tablet_bootstrap.cc:654] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.429585  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
W20260709 12:57:58.431624  1182 leader_election.cc:343] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.439612  1258 tablet_bootstrap.cc:492] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.441596  1262 raft_consensus.cc:515] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.445096  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
W20260709 12:57:58.446717  1182 leader_election.cc:343] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.448799  1264 raft_consensus.cc:493] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.449404  1264 raft_consensus.cc:515] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.452840  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:58.453393  1142 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.459453  1264 leader_election.cc:290] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.467571  1258 tablet_bootstrap.cc:654] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.464062  1142 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
I20260709 12:57:58.469779  1179 leader_election.cc:304] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:58.471868  1281 raft_consensus.cc:2804] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.472514  1262 leader_election.cc:290] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.476157  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd570861fbd463080e4641319dab1ba" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.476477  1281 raft_consensus.cc:697] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
W20260709 12:57:58.491115  1108 leader_election.cc:343] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.497278  1282 raft_consensus.cc:493] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.497839  1282 raft_consensus.cc:515] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.503275  1258 tablet_bootstrap.cc:492] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.503742  1258 ts_tablet_manager.cc:1403] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.013s
I20260709 12:57:58.504010  1256 ts_tablet_manager.cc:1434] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.094s	user 0.023s	sys 0.052s
I20260709 12:57:58.504160  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49c337200e4db7acb3190c2fb37277" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.505230  1067 raft_consensus.cc:2468] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.505401  1256 tablet_bootstrap.cc:492] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.507804  1282 leader_election.cc:290] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.501155  1281 consensus_queue.cc:237] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.510488  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49c337200e4db7acb3190c2fb37277" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.511600  1182 leader_election.cc:304] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:57:58.511425  1258 raft_consensus.cc:359] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.512032  1256 tablet_bootstrap.cc:654] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:58.512838  1179 leader_election.cc:343] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.512687  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd570861fbd463080e4641319dab1ba" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.514606  1282 raft_consensus.cc:2804] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.514976  1282 raft_consensus.cc:493] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:58.515053  1105 leader_election.cc:343] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.515396  1282 raft_consensus.cc:3060] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.515506  1105 leader_election.cc:304] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9; no voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435
I20260709 12:57:58.517745  1277 raft_consensus.cc:2749] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.523988  1262 raft_consensus.cc:493] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.513863  1258 raft_consensus.cc:385] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.524647  1262 raft_consensus.cc:515] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.525992  1258 raft_consensus.cc:740] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.531461  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.532080  1142 raft_consensus.cc:2468] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.532173  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.530433  1262 leader_election.cc:290] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.532783  1258 consensus_queue.cc:260] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.533368  1179 leader_election.cc:304] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
W20260709 12:57:58.534344  1182 leader_election.cc:343] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.534693  1262 raft_consensus.cc:2804] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.535324  1262 raft_consensus.cc:493] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.535640  1262 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.537194  1258 ts_tablet_manager.cc:1434] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 12:57:58.538151  1258 tablet_bootstrap.cc:492] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.540953  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.542201  1264 raft_consensus.cc:493] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.542670  1264 raft_consensus.cc:515] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.543318   964 catalog_manager.cc:5697] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 0 to 1, leader changed from <none> to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.544771  1264 leader_election.cc:290] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.545902  1257 tablet_bootstrap.cc:492] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.546375  1257 ts_tablet_manager.cc:1403] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.128s	user 0.031s	sys 0.032s
W20260709 12:57:58.546497  1030 leader_election.cc:343] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.547725  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.548496  1256 tablet_bootstrap.cc:492] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.549031  1256 ts_tablet_manager.cc:1403] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.008s
W20260709 12:57:58.549088  1030 leader_election.cc:343] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.549358  1257 raft_consensus.cc:359] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.550184  1257 raft_consensus.cc:385] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.550524  1257 raft_consensus.cc:740] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.553401  1256 raft_consensus.cc:359] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.551481  1257 consensus_queue.cc:260] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.554152  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.557013  1258 tablet_bootstrap.cc:654] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.556888  1262 raft_consensus.cc:515] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.535009  1282 raft_consensus.cc:515] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.555455  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.559165  1257 ts_tablet_manager.cc:1434] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:57:58.559721  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:58.560199  1257 tablet_bootstrap.cc:492] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
W20260709 12:57:58.561757  1182 leader_election.cc:343] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.562939  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49c337200e4db7acb3190c2fb37277" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
W20260709 12:57:58.563174  1030 leader_election.cc:343] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.563293  1282 leader_election.cc:290] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.563511  1067 raft_consensus.cc:3060] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.563652  1030 leader_election.cc:304] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435
W20260709 12:57:58.565023  1030 leader_election.cc:343] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.565526  1030 leader_election.cc:304] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435
I20260709 12:57:58.566108  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49c337200e4db7acb3190c2fb37277" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:58.567880  1256 raft_consensus.cc:385] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.568235  1256 raft_consensus.cc:740] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.568401  1264 raft_consensus.cc:2749] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.569094  1264 raft_consensus.cc:2749] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:58.569970  1013 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:58.570108  1256 consensus_queue.cc:260] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
W20260709 12:57:58.570714  1179 leader_election.cc:343] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.571834  1258 tablet_bootstrap.cc:492] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.572520  1258 ts_tablet_manager.cc:1403] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.007s
I20260709 12:57:58.574223  1257 tablet_bootstrap.cc:654] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.576583  1258 raft_consensus.cc:359] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.577451  1256 ts_tablet_manager.cc:1434] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:57:58.577623  1258 raft_consensus.cc:385] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.578178  1258 raft_consensus.cc:740] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.579413  1258 consensus_queue.cc:260] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.578445  1256 tablet_bootstrap.cc:492] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.582063  1258 ts_tablet_manager.cc:1434] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:57:58.583267  1258 tablet_bootstrap.cc:492] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.589237  1067 raft_consensus.cc:2468] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
I20260709 12:57:58.590548  1182 leader_election.cc:304] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 510684f49c9e49a8838857869ba37ba9
I20260709 12:57:58.591343  1282 raft_consensus.cc:2804] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.591600  1258 tablet_bootstrap.cc:654] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.591781  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:58.591845  1282 raft_consensus.cc:697] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:58.592598  1142 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.593150  1282 consensus_queue.cc:237] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.593998  1257 tablet_bootstrap.cc:492] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.594492  1257 ts_tablet_manager.cc:1403] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:57:58.597259  1257 raft_consensus.cc:359] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.597937  1257 raft_consensus.cc:385] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.598225  1257 raft_consensus.cc:740] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.599776  1142 raft_consensus.cc:2468] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
I20260709 12:57:58.601063  1256 tablet_bootstrap.cc:654] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.600994  1179 leader_election.cc:304] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:58.601912  1281 raft_consensus.cc:2804] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.607843  1262 leader_election.cc:290] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.610765  1257 consensus_queue.cc:260] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.612319  1281 raft_consensus.cc:697] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:58.613415  1281 consensus_queue.cc:237] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.618646  1257 ts_tablet_manager.cc:1434] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:57:58.619386  1258 tablet_bootstrap.cc:492] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.619684  1257 tablet_bootstrap.cc:492] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.620122  1258 ts_tablet_manager.cc:1403] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.026s
I20260709 12:57:58.624019  1258 raft_consensus.cc:359] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.625146  1258 raft_consensus.cc:385] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.625607  1258 raft_consensus.cc:740] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.626742  1258 consensus_queue.cc:260] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.629347  1256 tablet_bootstrap.cc:492] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.629920  1256 ts_tablet_manager.cc:1403] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.001s
I20260709 12:57:58.630508  1258 ts_tablet_manager.cc:1434] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:57:58.631894  1258 tablet_bootstrap.cc:492] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.633388  1256 raft_consensus.cc:359] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.634130  1256 raft_consensus.cc:385] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.634434  1256 raft_consensus.cc:740] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.635375  1256 consensus_queue.cc:260] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.637792  1256 ts_tablet_manager.cc:1434] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:58.638721  1256 tablet_bootstrap.cc:492] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.636340  1281 raft_consensus.cc:493] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.640349  1281 raft_consensus.cc:515] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.641686  1258 tablet_bootstrap.cc:654] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.643407  1257 tablet_bootstrap.cc:654] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.643464  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
W20260709 12:57:58.644856  1182 leader_election.cc:343] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:58.647087  1030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36165, user_credentials={real_user=slave}} blocked reactor thread for 82095.2us
I20260709 12:57:58.648630  1256 tablet_bootstrap.cc:654] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.648509  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.649163  1142 raft_consensus.cc:2468] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.650350  1179 leader_election.cc:304] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:58.651494  1293 raft_consensus.cc:2804] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.651975  1293 raft_consensus.cc:493] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.652354  1293 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.652477  1262 raft_consensus.cc:493] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.652993  1262 raft_consensus.cc:515] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.655124  1257 tablet_bootstrap.cc:492] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.655603  1257 ts_tablet_manager.cc:1403] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 12:57:58.656414  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.657374  1067 raft_consensus.cc:2468] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.658233  1289 raft_consensus.cc:493] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.655117  1262 leader_election.cc:290] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.658712  1289 raft_consensus.cc:515] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.660449  1281 leader_election.cc:290] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.660547  1182 leader_election.cc:304] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:57:58.661375  1257 raft_consensus.cc:359] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.662353  1257 raft_consensus.cc:385] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.662453  1258 tablet_bootstrap.cc:492] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.662796  1257 raft_consensus.cc:740] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.663039  1258 ts_tablet_manager.cc:1403] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.004s
I20260709 12:57:58.662307  1281 raft_consensus.cc:2804] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.663641  1257 consensus_queue.cc:260] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.664377  1281 raft_consensus.cc:493] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.664743  1281 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.666045  1257 ts_tablet_manager.cc:1434] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:57:58.666069  1258 raft_consensus.cc:359] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.666898  1258 raft_consensus.cc:385] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.667102  1257 tablet_bootstrap.cc:492] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.667192  1258 raft_consensus.cc:740] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.667722  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.668386  1141 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 0.
I20260709 12:57:58.668172  1258 consensus_queue.cc:260] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.670503  1258 ts_tablet_manager.cc:1434] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:58.671528  1258 tablet_bootstrap.cc:492] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.666919  1293 raft_consensus.cc:515] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.674331  1257 tablet_bootstrap.cc:654] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.677597  1030 leader_election.cc:304] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:58.678504  1264 raft_consensus.cc:2804] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.678897  1258 tablet_bootstrap.cc:654] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.678529  1281 raft_consensus.cc:515] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.679039  1264 raft_consensus.cc:493] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.679478  1264 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.682649  1289 leader_election.cc:290] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.681257  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
W20260709 12:57:58.684737  1179 leader_election.cc:343] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.685491  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
W20260709 12:57:58.687458  1182 leader_election.cc:343] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.689870  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.692140  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
W20260709 12:57:58.692281  1030 leader_election.cc:343] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.690222   963 catalog_manager.cc:5697] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 0 to 1, leader changed from <none> to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.691942  1293 leader_election.cc:290] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.694236  1281 leader_election.cc:290] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.694492  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:58.695065  1067 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.695180  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
W20260709 12:57:58.696434  1179 leader_election.cc:343] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.695987   963 catalog_manager.cc:5697] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 0 to 1, leader changed from <none> to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.699048  1142 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.702785  1256 tablet_bootstrap.cc:492] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.703224  1256 ts_tablet_manager.cc:1403] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.000s
I20260709 12:57:58.703002  1067 raft_consensus.cc:2468] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
I20260709 12:57:58.704656  1182 leader_election.cc:304] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 510684f49c9e49a8838857869ba37ba9
I20260709 12:57:58.706313  1281 raft_consensus.cc:2804] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.706138  1256 raft_consensus.cc:359] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.706861  1256 raft_consensus.cc:385] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.707131  1281 raft_consensus.cc:697] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:58.707152  1256 raft_consensus.cc:740] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.708892  1281 consensus_queue.cc:237] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.709456  1256 consensus_queue.cc:260] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.714037  1257 tablet_bootstrap.cc:492] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.714617  1257 ts_tablet_manager.cc:1403] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 12:57:58.700428  1264 raft_consensus.cc:515] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.717187  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:58.717756  1141 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.717666  1257 raft_consensus.cc:359] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.718250  1257 raft_consensus.cc:385] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.718520  1257 raft_consensus.cc:740] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.718680  1256 ts_tablet_manager.cc:1434] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:57:58.719612  1256 tablet_bootstrap.cc:492] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.719271  1257 consensus_queue.cc:260] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.719959  1264 leader_election.cc:290] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.721514  1257 ts_tablet_manager.cc:1434] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:57:58.722995  1257 tablet_bootstrap.cc:492] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.723136  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:58.723680  1142 raft_consensus.cc:2468] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
W20260709 12:57:58.724610  1030 leader_election.cc:343] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.724874  1179 leader_election.cc:304] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:58.721958  1258 tablet_bootstrap.cc:492] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.725600  1293 raft_consensus.cc:2804] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.726220  1256 tablet_bootstrap.cc:654] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.726164  1293 raft_consensus.cc:697] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:58.727052  1293 consensus_queue.cc:237] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.729238  1258 ts_tablet_manager.cc:1403] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.016s
I20260709 12:57:58.729737  1141 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 1.
I20260709 12:57:58.730866  1030 leader_election.cc:304] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: a068c0f86c2a4282a961df8be5c95435
I20260709 12:57:58.731878  1264 raft_consensus.cc:2804] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.732398  1264 raft_consensus.cc:697] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:57:58.732575  1258 raft_consensus.cc:359] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.733160  1264 consensus_queue.cc:237] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.733493  1258 raft_consensus.cc:385] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.733878  1258 raft_consensus.cc:740] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.734719  1258 consensus_queue.cc:260] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.737419  1258 ts_tablet_manager.cc:1434] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:58.738581  1258 tablet_bootstrap.cc:492] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.744608  1257 tablet_bootstrap.cc:654] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.754460   965 catalog_manager.cc:5697] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.758116  1256 tablet_bootstrap.cc:492] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.758802  1256 ts_tablet_manager.cc:1403] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.005s
I20260709 12:57:58.759536  1258 tablet_bootstrap.cc:654] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.758843  1257 tablet_bootstrap.cc:492] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.760079  1257 ts_tablet_manager.cc:1403] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.002s
I20260709 12:57:58.763159  1257 raft_consensus.cc:359] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.763818  1257 raft_consensus.cc:385] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.764073  1257 raft_consensus.cc:740] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.764799  1257 consensus_queue.cc:260] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.766988  1257 ts_tablet_manager.cc:1434] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:58.766743   963 catalog_manager.cc:5697] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 0 to 1, leader changed from <none> to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.767378  1256 raft_consensus.cc:359] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.767840  1257 tablet_bootstrap.cc:492] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: Bootstrap starting.
I20260709 12:57:58.768044  1256 raft_consensus.cc:385] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.768371  1256 raft_consensus.cc:740] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.769097  1256 consensus_queue.cc:260] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.772507  1258 tablet_bootstrap.cc:492] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.773006  1258 ts_tablet_manager.cc:1403] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 12:57:58.773049  1277 raft_consensus.cc:493] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.773594  1277 raft_consensus.cc:515] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.775897  1258 raft_consensus.cc:359] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.777143  1258 raft_consensus.cc:385] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.777148  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02711afdec9640f6bd510a50bb620a1e" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.777774  1258 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.777971  1067 raft_consensus.cc:2468] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 0.
I20260709 12:57:58.778606  1256 ts_tablet_manager.cc:1434] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:57:58.778563  1258 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.779709  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02711afdec9640f6bd510a50bb620a1e" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.780879  1215 raft_consensus.cc:2468] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 0.
I20260709 12:57:58.781387  1258 ts_tablet_manager.cc:1434] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:58.782341  1258 tablet_bootstrap.cc:492] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: Bootstrap starting.
I20260709 12:57:58.782457  1108 leader_election.cc:304] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:58.783448  1263 raft_consensus.cc:2804] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.775914  1277 leader_election.cc:290] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.783828  1263 raft_consensus.cc:493] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.784184  1263 raft_consensus.cc:3060] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.779755  1256 tablet_bootstrap.cc:492] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.789408  1258 tablet_bootstrap.cc:654] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.790807  1263 raft_consensus.cc:515] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.791546  1256 tablet_bootstrap.cc:654] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.798261  1263 leader_election.cc:290] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.800004  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02711afdec9640f6bd510a50bb620a1e" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:58.800652  1215 raft_consensus.cc:3060] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.802174   965 catalog_manager.cc:5697] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 0 to 1, leader changed from <none> to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.804589  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02711afdec9640f6bd510a50bb620a1e" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:58.805146  1067 raft_consensus.cc:3060] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.809573  1256 tablet_bootstrap.cc:492] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.810006  1256 ts_tablet_manager.cc:1403] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 12:57:58.813090  1256 raft_consensus.cc:359] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.813927  1256 raft_consensus.cc:385] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.814256  1256 raft_consensus.cc:740] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.815289  1256 consensus_queue.cc:260] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.822062  1256 ts_tablet_manager.cc:1434] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:57:58.822762  1257 tablet_bootstrap.cc:654] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.822997  1293 raft_consensus.cc:493] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.823167  1256 tablet_bootstrap.cc:492] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9: Bootstrap starting.
I20260709 12:57:58.823449  1293 raft_consensus.cc:515] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.825672  1293 leader_election.cc:290] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.827872  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.827944  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.828907  1141 raft_consensus.cc:2468] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.828984  1066 raft_consensus.cc:2468] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 0.
I20260709 12:57:58.830825  1182 leader_election.cc:304] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:57:58.833612  1258 tablet_bootstrap.cc:492] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: No bootstrap required, opened a new log
I20260709 12:57:58.837016  1215 raft_consensus.cc:2468] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 1.
I20260709 12:57:58.838254  1067 raft_consensus.cc:2468] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 1.
I20260709 12:57:58.843432  1258 ts_tablet_manager.cc:1403] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.025s
I20260709 12:57:58.845623  1256 tablet_bootstrap.cc:654] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.845891  1108 leader_election.cc:304] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:58.846362  1258 raft_consensus.cc:359] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.846962  1263 raft_consensus.cc:2804] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.847195  1258 raft_consensus.cc:385] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.847451  1263 raft_consensus.cc:697] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Becoming Leader. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:57:58.847642  1258 raft_consensus.cc:740] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.848372  1263 consensus_queue.cc:237] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.848595  1258 consensus_queue.cc:260] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.851125  1293 raft_consensus.cc:2804] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.851281  1258 ts_tablet_manager.cc:1434] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:57:58.851544  1293 raft_consensus.cc:493] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.852052  1293 raft_consensus.cc:3060] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.855031  1257 tablet_bootstrap.cc:492] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: No bootstrap required, opened a new log
I20260709 12:57:58.855460  1257 ts_tablet_manager.cc:1403] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.003s
I20260709 12:57:58.858103  1257 raft_consensus.cc:359] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.858839  1257 raft_consensus.cc:385] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.859104  1257 raft_consensus.cc:740] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.859858  1257 consensus_queue.cc:260] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.865338  1257 ts_tablet_manager.cc:1434] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:57:58.871541  1256 tablet_bootstrap.cc:492] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9: No bootstrap required, opened a new log
I20260709 12:57:58.872047  1256 ts_tablet_manager.cc:1403] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.015s
I20260709 12:57:58.874755  1256 raft_consensus.cc:359] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.875452  1256 raft_consensus.cc:385] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.875819  1256 raft_consensus.cc:740] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.875370   963 catalog_manager.cc:5697] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510684f49c9e49a8838857869ba37ba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "510684f49c9e49a8838857869ba37ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.876494  1256 consensus_queue.cc:260] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.877967  1256 ts_tablet_manager.cc:1434] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:57:58.888964  1264 raft_consensus.cc:493] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.889334  1264 raft_consensus.cc:515] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.890770  1264 leader_election.cc:290] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.891433  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd570861fbd463080e4641319dab1ba" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.891958  1141 raft_consensus.cc:2468] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 0.
I20260709 12:57:58.892091  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd570861fbd463080e4641319dab1ba" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.892724  1215 raft_consensus.cc:2468] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 0.
I20260709 12:57:58.892989  1030 leader_election.cc:304] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:58.893756  1264 raft_consensus.cc:2804] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.894069  1264 raft_consensus.cc:493] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.894333  1264 raft_consensus.cc:3060] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.901883  1289 raft_consensus.cc:493] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.902348  1289 raft_consensus.cc:515] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.904043  1289 leader_election.cc:290] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.904806  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.905067  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.905654  1141 raft_consensus.cc:2393] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6be460adbebf4c9695f1ea3b6a6285cf in current term 1: Already voted for candidate a068c0f86c2a4282a961df8be5c95435 in this term.
I20260709 12:57:58.907060  1030 leader_election.cc:304] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435
I20260709 12:57:58.907794  1289 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.920933  1263 raft_consensus.cc:493] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.921583  1263 raft_consensus.cc:515] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.924067  1263 leader_election.cc:290] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.924901  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:58.925009  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.925580  1067 raft_consensus.cc:2393] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 510684f49c9e49a8838857869ba37ba9 in current term 1: Already voted for candidate a068c0f86c2a4282a961df8be5c95435 in this term.
I20260709 12:57:58.926481  1108 leader_election.cc:304] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9; no voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435
I20260709 12:57:58.927114  1263 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.941088  1067 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.942382  1293 raft_consensus.cc:515] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.945683  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:58.947336  1066 raft_consensus.cc:3060] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.947314  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:58.947962  1141 raft_consensus.cc:3060] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.946659  1293 leader_election.cc:290] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:57:58.953212  1314 raft_consensus.cc:493] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.942374  1264 raft_consensus.cc:515] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.953810  1314 raft_consensus.cc:515] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:58.942374  1263 raft_consensus.cc:2749] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.955606  1314 leader_election.cc:290] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.955623  1264 leader_election.cc:290] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:58.956796  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd570861fbd463080e4641319dab1ba" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:58.956869  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:58.956988  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:58.957461  1142 raft_consensus.cc:3060] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.957731  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd570861fbd463080e4641319dab1ba" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:58.957908  1140 raft_consensus.cc:2393] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6be460adbebf4c9695f1ea3b6a6285cf in current term 1: Already voted for candidate a068c0f86c2a4282a961df8be5c95435 in this term.
I20260709 12:57:58.958271  1216 raft_consensus.cc:3060] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.959008  1030 leader_election.cc:304] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435
I20260709 12:57:58.959692  1264 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.002810  1263 raft_consensus.cc:493] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.003319  1263 raft_consensus.cc:515] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.005221  1263 leader_election.cc:290] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.006181  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:59.006642  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435" is_pre_election: true
I20260709 12:57:59.006815  1065 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 0.
I20260709 12:57:59.007289  1215 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 0.
I20260709 12:57:59.008124  1108 leader_election.cc:304] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.008227  1140 raft_consensus.cc:3060] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.008915  1263 raft_consensus.cc:2804] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:59.009286  1263 raft_consensus.cc:493] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.009569  1263 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.044165  1141 raft_consensus.cc:2468] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
I20260709 12:57:59.045049  1289 raft_consensus.cc:2749] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:59.044170  1216 raft_consensus.cc:2468] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 1.
I20260709 12:57:59.047043  1066 raft_consensus.cc:2468] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 1.
I20260709 12:57:59.046888  1293 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.048260  1182 leader_election.cc:304] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:57:59.053375  1142 raft_consensus.cc:2468] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 1.
I20260709 12:57:59.055680  1293 raft_consensus.cc:2804] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:59.059146  1293 raft_consensus.cc:697] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:59.059548  1281 consensus_queue.cc:1048] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.056164  1030 leader_election.cc:304] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.060374  1293 consensus_queue.cc:237] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.061081  1281 consensus_queue.cc:1048] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.061303  1289 raft_consensus.cc:2804] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:59.061949  1289 raft_consensus.cc:697] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:57:59.062891  1289 consensus_queue.cc:237] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.066238  1263 raft_consensus.cc:515] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.069407  1263 leader_election.cc:290] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.070039  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:59.070858  1065 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.074672  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:59.075500  1216 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.055438  1264 raft_consensus.cc:2749] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:59.077849  1281 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:57:59.101471   962 catalog_manager.cc:5697] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.103130   965 catalog_manager.cc:5697] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 0 to 1, leader changed from <none> to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:59.111454  1065 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 1.
I20260709 12:57:59.115690  1282 consensus_queue.cc:1048] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:59.119454  1108 leader_election.cc:304] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.120335  1263 raft_consensus.cc:2804] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:59.120836  1263 raft_consensus.cc:697] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Becoming Leader. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:57:59.121702  1263 consensus_queue.cc:237] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.122822  1216 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 1.
I20260709 12:57:59.139500  1293 raft_consensus.cc:493] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.145202  1293 raft_consensus.cc:515] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.147529  1293 leader_election.cc:290] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747)
I20260709 12:57:59.150768  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" is_pre_election: true
I20260709 12:57:59.154384  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510684f49c9e49a8838857869ba37ba9" is_pre_election: true
I20260709 12:57:59.155468  1142 raft_consensus.cc:2393] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a068c0f86c2a4282a961df8be5c95435 in current term 1: Already voted for candidate 6be460adbebf4c9695f1ea3b6a6285cf in this term.
I20260709 12:57:59.158712  1179 leader_election.cc:304] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a068c0f86c2a4282a961df8be5c95435; no voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:59.160086  1262 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.164296   962 catalog_manager.cc:5697] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510684f49c9e49a8838857869ba37ba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "510684f49c9e49a8838857869ba37ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.176209  1281 consensus_queue.cc:1048] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.177635  1262 raft_consensus.cc:2749] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:59.183666  1262 consensus_queue.cc:1048] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.187443  1289 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.188285  1262 consensus_queue.cc:1048] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:59.232738  1289 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.233420  1293 consensus_queue.cc:1048] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.242794  1282 consensus_queue.cc:1048] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.289052  1216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:57:59.289765  1216 raft_consensus.cc:606] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:59.295920  1216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:57:59.296527  1216 raft_consensus.cc:606] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:59.300313  1263 consensus_queue.cc:1048] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.305303  1215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:57:59.305853  1215 raft_consensus.cc:606] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:57:59.312805  1263 consensus_queue.cc:1048] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:59.313815  1215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:57:59.314335  1215 raft_consensus.cc:606] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Received request to transfer leadership to TS 510684f49c9e49a8838857869ba37ba9
I20260709 12:57:59.319816  1215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:57:59.320411  1215 raft_consensus.cc:606] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Received request to transfer leadership to TS 510684f49c9e49a8838857869ba37ba9
I20260709 12:57:59.473891  1282 consensus_queue.cc:1048] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.483743  1328 consensus_queue.cc:1048] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.491793  1262 raft_consensus.cc:993] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:57:59.492235  1328 raft_consensus.cc:1081] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:57:59.493808  1065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38174
I20260709 12:57:59.494415  1065 raft_consensus.cc:493] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.494711  1065 raft_consensus.cc:3060] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.499562  1065 raft_consensus.cc:515] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.501088  1065 leader_election.cc:290] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.501964  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:59.502334  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501f9fa2eb1b4e60afa31547fcfc1af7" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:59.502579  1140 raft_consensus.cc:3060] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.502885  1215 raft_consensus.cc:3055] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:59.503192  1215 raft_consensus.cc:740] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:59.503978  1215 consensus_queue.cc:260] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.505188  1215 raft_consensus.cc:3060] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.509147  1140 raft_consensus.cc:2468] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:57:59.510387  1030 leader_election.cc:304] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.511091  1264 raft_consensus.cc:2804] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.511206  1215 raft_consensus.cc:2468] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:57:59.511593  1264 raft_consensus.cc:697] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:57:59.512501  1264 consensus_queue.cc:237] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.518218  1339 consensus_queue.cc:1048] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.519073   965 catalog_manager.cc:5697] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 1 to 2, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.528702  1277 consensus_queue.cc:1048] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.555265  1264 consensus_queue.cc:1048] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.567093  1314 consensus_queue.cc:1048] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:59.570276  1262 raft_consensus.cc:993] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:57:59.570705  1262 raft_consensus.cc:1081] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:57:59.572541  1065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38174
I20260709 12:57:59.573166  1065 raft_consensus.cc:493] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.573539  1065 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.585216  1065 raft_consensus.cc:515] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.587348  1065 leader_election.cc:290] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.588418  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:59.588380  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:59.589085  1140 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.589171  1215 raft_consensus.cc:3055] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:59.589522  1215 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:59.590342  1215 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.591490  1215 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.595741  1140 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:57:59.596820  1030 leader_election.cc:304] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.597563  1289 raft_consensus.cc:2804] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.597868  1215 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:57:59.597986  1289 raft_consensus.cc:697] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:57:59.598856  1289 consensus_queue.cc:237] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.604908   962 catalog_manager.cc:5697] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 1 to 2, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.614306  1293 raft_consensus.cc:993] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:57:59.614697  1328 raft_consensus.cc:1081] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:57:59.615880  1065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38174
I20260709 12:57:59.616393  1065 raft_consensus.cc:493] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.616691  1065 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.620976  1065 raft_consensus.cc:515] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.622503  1065 leader_election.cc:290] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.623270  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:57:59.623713  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:59.623955  1140 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.624284  1215 raft_consensus.cc:3055] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:59.624603  1215 raft_consensus.cc:740] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:59.625293  1293 raft_consensus.cc:993] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:57:59.625437  1215 consensus_queue.cc:260] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.625730  1328 raft_consensus.cc:1081] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Signalling peer 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:57:59.626546  1215 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.627419  1141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:52078
I20260709 12:57:59.627934  1141 raft_consensus.cc:493] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.628314  1141 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.629637  1140 raft_consensus.cc:2468] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:57:59.630542  1030 leader_election.cc:304] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.631178  1289 raft_consensus.cc:2804] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.631592  1289 raft_consensus.cc:697] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:57:59.632388  1289 consensus_queue.cc:237] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.633049  1215 raft_consensus.cc:2468] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:57:59.634788  1141 raft_consensus.cc:515] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.636608  1141 leader_election.cc:290] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 2 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.637257  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:59.637606  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:59.637792  1065 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.638142  1215 raft_consensus.cc:3055] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:59.638522  1215 raft_consensus.cc:740] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:59.638952   962 catalog_manager.cc:5697] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 1 to 2, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.639297  1215 consensus_queue.cc:260] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.640477  1215 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.642935  1065 raft_consensus.cc:2468] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 2.
I20260709 12:57:59.644176  1108 leader_election.cc:304] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.644877  1277 raft_consensus.cc:2804] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.645296  1277 raft_consensus.cc:697] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Becoming Leader. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:57:59.645515  1215 raft_consensus.cc:2468] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 2.
I20260709 12:57:59.646072  1277 consensus_queue.cc:237] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.652575   962 catalog_manager.cc:5697] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 reported cstate change: term changed from 1 to 2, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 510684f49c9e49a8838857869ba37ba9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "510684f49c9e49a8838857869ba37ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.666797  1293 raft_consensus.cc:993] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:57:59.667273  1328 raft_consensus.cc:1081] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Signalling peer 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:57:59.668642  1141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:52078
I20260709 12:57:59.669096  1141 raft_consensus.cc:493] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.669371  1141 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.674428  1141 raft_consensus.cc:515] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.675892  1141 leader_election.cc:290] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 2 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:57:59.676755  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:57:59.677053  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:57:59.677356  1065 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.677600  1215 raft_consensus.cc:3055] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:59.677920  1215 raft_consensus.cc:740] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:57:59.678740  1215 consensus_queue.cc:260] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.679920  1215 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:59.683956  1065 raft_consensus.cc:2468] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 2.
I20260709 12:57:59.685070  1108 leader_election.cc:304] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:57:59.685827  1277 raft_consensus.cc:2804] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:59.686302  1277 raft_consensus.cc:697] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Becoming Leader. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:57:59.686530  1215 raft_consensus.cc:2468] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 2.
I20260709 12:57:59.687040  1277 consensus_queue.cc:237] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:57:59.692960   962 catalog_manager.cc:5697] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 reported cstate change: term changed from 1 to 2, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 510684f49c9e49a8838857869ba37ba9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "510684f49c9e49a8838857869ba37ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.891403  1141 raft_consensus.cc:1275] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:59.892578  1289 consensus_queue.cc:1048] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:59.899783  1215 raft_consensus.cc:1275] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:59.901729  1314 consensus_queue.cc:1048] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.056700  1215 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.056824  1141 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.058240  1314 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.058866  1264 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.086200  1215 raft_consensus.cc:1275] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.087393  1289 consensus_queue.cc:1048] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.096622  1141 raft_consensus.cc:1275] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.099005  1314 consensus_queue.cc:1048] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.124714  1215 raft_consensus.cc:1275] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.125972  1277 consensus_queue.cc:1048] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.133664  1066 raft_consensus.cc:1275] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.135735  1339 consensus_queue.cc:1048] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.215929  1066 raft_consensus.cc:1275] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.216718  1215 raft_consensus.cc:1275] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:00.217289  1339 consensus_queue.cc:1048] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:00.218236  1263 consensus_queue.cc:1048] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:02.356760   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:58:02.357389   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:02.374228  1066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc66927689c49a5addaa19f63574728"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
mode: GRACEFUL
new_leader_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:38200
I20260709 12:58:02.374665  1066 raft_consensus.cc:606] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Received request to transfer leadership to TS a068c0f86c2a4282a961df8be5c95435
I20260709 12:58:02.376727  1066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
mode: GRACEFUL
new_leader_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:38200
I20260709 12:58:02.377137  1066 raft_consensus.cc:606] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Received request to transfer leadership to TS a068c0f86c2a4282a961df8be5c95435
I20260709 12:58:02.378028   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:02.378382   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:02.536847  1314 raft_consensus.cc:993] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: : Instructing follower a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:02.537307  1289 raft_consensus.cc:1081] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Signalling peer a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:02.538582  1216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fc66927689c49a5addaa19f63574728"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:40896
I20260709 12:58:02.539052  1216 raft_consensus.cc:493] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:02.539304  1216 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.543763  1216 raft_consensus.cc:515] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:02.545292  1216 leader_election.cc:290] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 2 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747)
I20260709 12:58:02.546036  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:02.546219  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:58:02.546666  1140 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.546752  1066 raft_consensus.cc:3055] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:02.547123  1066 raft_consensus.cc:740] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:02.547781  1066 consensus_queue.cc:260] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:02.548748  1066 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.551366  1140 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 2.
I20260709 12:58:02.552457  1179 leader_election.cc:304] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:02.553218  1328 raft_consensus.cc:2804] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:02.553550  1066 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 2.
I20260709 12:58:02.554242  1328 raft_consensus.cc:697] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:58:02.555040  1328 consensus_queue.cc:237] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:02.562647   962 catalog_manager.cc:5697] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 1 to 2, leader changed from 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193) to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:02.585326  1314 raft_consensus.cc:993] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: : Instructing follower a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:02.585729  1289 raft_consensus.cc:1081] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Signalling peer a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:02.586948  1216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:40896
I20260709 12:58:02.587407  1216 raft_consensus.cc:493] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:02.587693  1216 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:02.592020  1216 raft_consensus.cc:515] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:02.593629  1216 leader_election.cc:290] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 3 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:58:02.594465  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:58:02.594606  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:02.594956  1066 raft_consensus.cc:3055] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:02.595175  1140 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:02.595285  1066 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:02.596010  1066 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:02.596935  1066 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:02.599848  1140 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 3.
I20260709 12:58:02.600878  1179 leader_election.cc:304] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:02.601265  1066 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 3.
I20260709 12:58:02.601635  1328 raft_consensus.cc:2804] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:02.602135  1328 raft_consensus.cc:697] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:58:02.602871  1328 consensus_queue.cc:237] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:02.609081   962 catalog_manager.cc:5697] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 2 to 3, leader changed from 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193) to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:02.968783  1140 raft_consensus.cc:1275] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:02.970021  1349 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:02.981122  1066 raft_consensus.cc:1275] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:02.982594  1358 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:02.995513  1066 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:02.996682  1358 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:03.006733  1140 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:03.007917  1349 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:03.379071   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:03.388723  1216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc66927689c49a5addaa19f63574728"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:58:03.389195  1216 raft_consensus.cc:606] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:58:03.400454  1216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:40904
I20260709 12:58:03.400925  1216 raft_consensus.cc:606] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:58:03.416729  1140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:58:03.417198  1140 raft_consensus.cc:606] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:58:03.421674  1140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:58:03.422115  1140 raft_consensus.cc:606] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:58:03.426784  1140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
mode: GRACEFUL
new_leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:58:03.427182  1140 raft_consensus.cc:606] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Received request to transfer leadership to TS 6be460adbebf4c9695f1ea3b6a6285cf
I20260709 12:58:03.443606  1328 raft_consensus.cc:993] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.443984  1349 raft_consensus.cc:1081] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.445370  1066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38174
I20260709 12:58:03.445824  1066 raft_consensus.cc:493] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:03.446132  1066 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.450960  1066 raft_consensus.cc:515] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.452545  1066 leader_election.cc:290] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 4 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:03.453663  1140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:03.453708  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:03.454222  1140 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.454299  1216 raft_consensus.cc:3055] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:03.454648  1216 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:58:03.455328  1216 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.456187  1216 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:03.459579  1140 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 4.
I20260709 12:58:03.460639  1030 leader_election.cc:304] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:58:03.461316  1289 raft_consensus.cc:2804] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:03.462234  1216 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 4.
I20260709 12:58:03.462329  1289 raft_consensus.cc:697] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:03.463327  1289 consensus_queue.cc:237] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.469375   963 catalog_manager.cc:5697] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 3 to 4, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:03.735337  1277 raft_consensus.cc:993] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.735759  1277 raft_consensus.cc:1081] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.737166  1066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:58:03.737597  1066 raft_consensus.cc:493] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:03.737840  1066 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.742146  1066 raft_consensus.cc:515] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.744024  1066 leader_election.cc:290] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 3 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:03.744690  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:03.744942  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e7b519fdb64824a00ea8841a13789a" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:03.745340  1141 raft_consensus.cc:3055] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:03.745432  1216 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.745718  1141 raft_consensus.cc:740] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:58:03.746519  1141 consensus_queue.cc:260] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.748157  1141 raft_consensus.cc:3060] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.752674  1216 raft_consensus.cc:2468] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 3.
I20260709 12:58:03.753832  1030 leader_election.cc:304] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:03.754493  1289 raft_consensus.cc:2804] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:03.754684  1141 raft_consensus.cc:2468] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 3.
I20260709 12:58:03.755008  1289 raft_consensus.cc:697] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:03.756400  1289 consensus_queue.cc:237] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.762602   963 catalog_manager.cc:5697] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 2 to 3, leader changed from 510684f49c9e49a8838857869ba37ba9 (127.0.107.194) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:03.834383  1370 raft_consensus.cc:993] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.834797  1277 raft_consensus.cc:1081] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.836293  1066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:58:03.836730  1066 raft_consensus.cc:493] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:03.836977  1066 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.841998  1066 raft_consensus.cc:515] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.843716  1066 leader_election.cc:290] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 3 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:03.844736  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:03.844748  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9db541c34144f7ac6a4c48efbc64a3" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:03.845417  1216 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.845518  1141 raft_consensus.cc:3055] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:03.845949  1141 raft_consensus.cc:740] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:58:03.846642  1141 consensus_queue.cc:260] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.847793  1141 raft_consensus.cc:3060] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.850844  1216 raft_consensus.cc:2468] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 3.
I20260709 12:58:03.851814  1030 leader_election.cc:304] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:03.852587  1289 raft_consensus.cc:2804] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:03.852821  1141 raft_consensus.cc:2468] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 3.
I20260709 12:58:03.854058  1370 raft_consensus.cc:993] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.853735  1289 raft_consensus.cc:697] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:03.854594  1277 raft_consensus.cc:1081] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.855168  1289 consensus_queue.cc:237] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.856103  1066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:58:03.856683  1066 raft_consensus.cc:493] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:03.857036  1066 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:03.862624   963 catalog_manager.cc:5697] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 2 to 3, leader changed from 510684f49c9e49a8838857869ba37ba9 (127.0.107.194) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:03.863142  1066 raft_consensus.cc:515] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.865429  1066 leader_election.cc:290] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:03.866443  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:03.866678  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:03.867026  1216 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:03.867252  1141 raft_consensus.cc:3055] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:03.867625  1141 raft_consensus.cc:740] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:58:03.868422  1141 consensus_queue.cc:260] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.869405  1141 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:03.873294  1216 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:58:03.874197  1030 leader_election.cc:304] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be460adbebf4c9695f1ea3b6a6285cf, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:03.874812  1289 raft_consensus.cc:2804] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:03.875037  1141 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 2.
I20260709 12:58:03.875202  1289 raft_consensus.cc:697] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:03.876000  1289 consensus_queue.cc:237] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.882516   963 catalog_manager.cc:5697] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 1 to 2, leader changed from 510684f49c9e49a8838857869ba37ba9 (127.0.107.194) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:03.891256  1328 raft_consensus.cc:993] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: : Instructing follower 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.891644  1349 raft_consensus.cc:1081] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 LEADER]: Signalling peer 6be460adbebf4c9695f1ea3b6a6285cf to start an election
I20260709 12:58:03.893390  1066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fc66927689c49a5addaa19f63574728"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
 from {username='slave'} at 127.0.0.1:38174
I20260709 12:58:03.893803  1066 raft_consensus.cc:493] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:03.894080  1066 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.898109  1066 raft_consensus.cc:515] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.899529  1066 leader_election.cc:290] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 3 election: Requested vote from peers 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:03.900530  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:03.900625  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:03.901044  1216 raft_consensus.cc:3055] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:03.901134  1141 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.901341  1216 raft_consensus.cc:740] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:58:03.902109  1216 consensus_queue.cc:260] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.902949  1216 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.905813  1141 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 3.
I20260709 12:58:03.906750  1030 leader_election.cc:304] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, 6be460adbebf4c9695f1ea3b6a6285cf; no voters: 
I20260709 12:58:03.907114  1216 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be460adbebf4c9695f1ea3b6a6285cf in term 3.
I20260709 12:58:03.908025  1289 raft_consensus.cc:2804] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:03.908514  1289 raft_consensus.cc:697] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Becoming Leader. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:03.909214  1289 consensus_queue.cc:237] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:03.914855   963 catalog_manager.cc:5697] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf reported cstate change: term changed from 2 to 3, leader changed from a068c0f86c2a4282a961df8be5c95435 (127.0.107.195) to 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:03.921425  1216 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:03.922607  1289 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:03.930083  1141 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 4 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:03.931348  1289 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:04.199616  1141 raft_consensus.cc:1275] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.200995  1289 consensus_queue.cc:1048] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:04.210264  1216 raft_consensus.cc:1275] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.212318  1289 consensus_queue.cc:1048] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:04.255944  1141 raft_consensus.cc:1275] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.257347  1289 consensus_queue.cc:1048] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:04.265676  1216 raft_consensus.cc:1275] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.267537  1215 raft_consensus.cc:1275] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:04.268179  1366 consensus_queue.cc:1048] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:04.268981  1378 consensus_queue.cc:1048] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:04.280652  1141 raft_consensus.cc:1275] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:04.282437  1366 consensus_queue.cc:1048] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:04.307724  1141 raft_consensus.cc:1275] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.308879  1289 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:04.317489  1216 raft_consensus.cc:1275] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Refusing update from remote peer 6be460adbebf4c9695f1ea3b6a6285cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:04.319375  1366 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:06.433917   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:06.441561  1066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
mode: GRACEFUL
new_leader_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:38200
I20260709 12:58:06.442341  1066 raft_consensus.cc:606] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Received request to transfer leadership to TS 510684f49c9e49a8838857869ba37ba9
I20260709 12:58:06.445092  1066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
mode: GRACEFUL
new_leader_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:38200
I20260709 12:58:06.445600  1066 raft_consensus.cc:606] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Received request to transfer leadership to TS a068c0f86c2a4282a961df8be5c95435
I20260709 12:58:06.447934  1066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc66927689c49a5addaa19f63574728"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
mode: GRACEFUL
new_leader_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:38200
I20260709 12:58:06.448392  1066 raft_consensus.cc:606] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Received request to transfer leadership to TS 510684f49c9e49a8838857869ba37ba9
I20260709 12:58:06.450742  1066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
mode: GRACEFUL
new_leader_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:38200
I20260709 12:58:06.451228  1066 raft_consensus.cc:606] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 LEADER]: Received request to transfer leadership to TS a068c0f86c2a4282a961df8be5c95435
I20260709 12:58:06.452333   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:06.452819   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:06.481242  1366 raft_consensus.cc:993] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: : Instructing follower 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:58:06.481789  1387 raft_consensus.cc:1081] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Signalling peer 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:58:06.483363  1141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:58:06.483832  1141 raft_consensus.cc:493] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:06.484148  1141 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.489797  1141 raft_consensus.cc:515] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.491467  1141 leader_election.cc:290] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 3 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:06.492739  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:06.492787  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199ccdada50342ec82e4dc5eca71c861" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:58:06.493451  1215 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.493526  1065 raft_consensus.cc:3055] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:06.493923  1065 raft_consensus.cc:740] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:06.494822  1065 consensus_queue.cc:260] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.495995  1065 raft_consensus.cc:3060] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.499943  1215 raft_consensus.cc:2468] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 3.
I20260709 12:58:06.501318  1105 leader_election.cc:304] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:06.501773  1065 raft_consensus.cc:2468] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 3.
I20260709 12:58:06.502164  1277 raft_consensus.cc:2804] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:06.503290  1277 raft_consensus.cc:697] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 3 LEADER]: Becoming Leader. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:58:06.504096  1277 consensus_queue.cc:237] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.508826  1366 raft_consensus.cc:993] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: : Instructing follower a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:06.509289  1387 raft_consensus.cc:1081] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 LEADER]: Signalling peer a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:06.510704  1215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:40896
I20260709 12:58:06.511178  1215 raft_consensus.cc:493] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:06.511471  1215 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.511934   963 catalog_manager.cc:5697] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 reported cstate change: term changed from 2 to 3, leader changed from 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193) to 510684f49c9e49a8838857869ba37ba9 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "510684f49c9e49a8838857869ba37ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.515836  1215 raft_consensus.cc:515] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.517772  1215 leader_election.cc:290] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 5 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:58:06.518654  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:58:06.519044  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65593693dd449d9f907e6ea29b6890" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:06.519346  1065 raft_consensus.cc:3055] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:06.519595  1141 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.519793  1065 raft_consensus.cc:740] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:06.520797  1065 consensus_queue.cc:260] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.522176  1065 raft_consensus.cc:3060] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:06.526116  1141 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 5.
I20260709 12:58:06.527427  1179 leader_election.cc:304] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:06.528447  1349 raft_consensus.cc:2804] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:06.529640  1349 raft_consensus.cc:697] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 5 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:58:06.529564  1065 raft_consensus.cc:2468] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 5.
I20260709 12:58:06.530649  1349 consensus_queue.cc:237] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.536875   963 catalog_manager.cc:5697] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 4 to 5, leader changed from 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193) to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:06.726751  1366 raft_consensus.cc:993] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: : Instructing follower a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:06.727238  1387 raft_consensus.cc:1081] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Signalling peer a068c0f86c2a4282a961df8be5c95435 to start an election
I20260709 12:58:06.728581  1215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354"
dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
 from {username='slave'} at 127.0.0.1:40896
I20260709 12:58:06.728999  1215 raft_consensus.cc:493] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:06.729265  1215 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.733781  1215 raft_consensus.cc:515] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.735154  1215 leader_election.cc:290] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 3 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), 510684f49c9e49a8838857869ba37ba9 (127.0.107.194:38341)
I20260709 12:58:06.735932  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:58:06.736124  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95edc2809d4ae79842ca4aed05c354" candidate_uuid: "a068c0f86c2a4282a961df8be5c95435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510684f49c9e49a8838857869ba37ba9"
I20260709 12:58:06.736485  1065 raft_consensus.cc:3055] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:06.736688  1141 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.736810  1065 raft_consensus.cc:740] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:06.737587  1065 consensus_queue.cc:260] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.738448  1065 raft_consensus.cc:3060] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:06.741093  1141 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 3.
I20260709 12:58:06.742022  1179 leader_election.cc:304] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:06.742753  1349 raft_consensus.cc:2804] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:06.743233  1349 raft_consensus.cc:697] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Becoming Leader. State: Replica: a068c0f86c2a4282a961df8be5c95435, State: Running, Role: LEADER
I20260709 12:58:06.743938  1065 raft_consensus.cc:2468] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a068c0f86c2a4282a961df8be5c95435 in term 3.
I20260709 12:58:06.744118  1349 consensus_queue.cc:237] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.751405   963 catalog_manager.cc:5697] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 reported cstate change: term changed from 2 to 3, leader changed from 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193) to a068c0f86c2a4282a961df8be5c95435 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a068c0f86c2a4282a961df8be5c95435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:06.891969  1366 raft_consensus.cc:993] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: : Instructing follower 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:58:06.892439  1387 raft_consensus.cc:1081] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Signalling peer 510684f49c9e49a8838857869ba37ba9 to start an election
I20260709 12:58:06.893730  1141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fc66927689c49a5addaa19f63574728"
dest_uuid: "510684f49c9e49a8838857869ba37ba9"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:58:06.894181  1141 raft_consensus.cc:493] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:06.894460  1141 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.898474  1141 raft_consensus.cc:515] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.900075  1141 leader_election.cc:290] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 4 election: Requested vote from peers 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747), a068c0f86c2a4282a961df8be5c95435 (127.0.107.195:36165)
I20260709 12:58:06.901185  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a068c0f86c2a4282a961df8be5c95435"
I20260709 12:58:06.901566  1066 raft_consensus.cc:1275] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:06.901176  1065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc66927689c49a5addaa19f63574728" candidate_uuid: "510684f49c9e49a8838857869ba37ba9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6be460adbebf4c9695f1ea3b6a6285cf"
I20260709 12:58:06.901937  1215 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.902122  1065 raft_consensus.cc:3055] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:06.902482  1065 raft_consensus.cc:740] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6be460adbebf4c9695f1ea3b6a6285cf, State: Running, Role: LEADER
I20260709 12:58:06.902896  1277 consensus_queue.cc:1048] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:06.903301  1065 consensus_queue.cc:260] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.904651  1065 raft_consensus.cc:3060] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:06.908980  1215 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 4.
I20260709 12:58:06.910143  1105 leader_election.cc:304] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510684f49c9e49a8838857869ba37ba9, a068c0f86c2a4282a961df8be5c95435; no voters: 
I20260709 12:58:06.911147  1388 raft_consensus.cc:2804] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:06.912482  1065 raft_consensus.cc:2468] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510684f49c9e49a8838857869ba37ba9 in term 4.
I20260709 12:58:06.915526  1388 raft_consensus.cc:697] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 4 LEADER]: Becoming Leader. State: Replica: 510684f49c9e49a8838857869ba37ba9, State: Running, Role: LEADER
I20260709 12:58:06.916752  1388 consensus_queue.cc:237] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } }
I20260709 12:58:06.919275  1215 raft_consensus.cc:1275] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:06.921061  1399 consensus_queue.cc:1048] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:06.928390   963 catalog_manager.cc:5697] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 reported cstate change: term changed from 3 to 4, leader changed from 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193) to 510684f49c9e49a8838857869ba37ba9 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "510684f49c9e49a8838857869ba37ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.992596  1141 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 5 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:06.993788  1349 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:07.005723  1065 raft_consensus.cc:1275] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 5 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:07.007095  1406 consensus_queue.cc:1048] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:07.133955  1141 raft_consensus.cc:1275] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:07.135144  1406 consensus_queue.cc:1048] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510684f49c9e49a8838857869ba37ba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:07.144078  1065 raft_consensus.cc:1275] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Refusing update from remote peer a068c0f86c2a4282a961df8be5c95435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:07.145385  1406 consensus_queue.cc:1048] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be460adbebf4c9695f1ea3b6a6285cf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:07.453804   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:07.459762   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:07.485109   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:07.485947   431 tablet_replica.cc:333] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.486868   431 raft_consensus.cc:2243] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.487486   431 raft_consensus.cc:2272] T 199ccdada50342ec82e4dc5eca71c861 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.489656   431 tablet_replica.cc:333] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.490131   431 raft_consensus.cc:2243] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.490823   431 raft_consensus.cc:2272] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 6be460adbebf4c9695f1ea3b6a6285cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.492599   431 tablet_replica.cc:333] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.493255   431 raft_consensus.cc:2243] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.493852   431 raft_consensus.cc:2272] T 02711afdec9640f6bd510a50bb620a1e P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.496199   431 tablet_replica.cc:333] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.496721   431 raft_consensus.cc:2243] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.497375   431 raft_consensus.cc:2272] T fbd570861fbd463080e4641319dab1ba P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.499046   431 tablet_replica.cc:333] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.499475   431 raft_consensus.cc:2243] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.499797   431 raft_consensus.cc:2272] T dd65593693dd449d9f907e6ea29b6890 P 6be460adbebf4c9695f1ea3b6a6285cf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.501756   431 tablet_replica.cc:333] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.502202   431 raft_consensus.cc:2243] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.502815   431 raft_consensus.cc:2272] T c5e7b519fdb64824a00ea8841a13789a P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.504472   431 tablet_replica.cc:333] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.504917   431 raft_consensus.cc:2243] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.505244   431 raft_consensus.cc:2272] T 2c95edc2809d4ae79842ca4aed05c354 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.507256   431 tablet_replica.cc:333] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.507786   431 raft_consensus.cc:2243] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.508147   431 raft_consensus.cc:2272] T 3fc66927689c49a5addaa19f63574728 P 6be460adbebf4c9695f1ea3b6a6285cf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.509718   431 tablet_replica.cc:333] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.510159   431 raft_consensus.cc:2243] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.510838   431 raft_consensus.cc:2272] T 1c9db541c34144f7ac6a4c48efbc64a3 P 6be460adbebf4c9695f1ea3b6a6285cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.512472   431 tablet_replica.cc:333] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf: stopping tablet replica
I20260709 12:58:07.513065   431 raft_consensus.cc:2243] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.513556   431 raft_consensus.cc:2272] T 1c49c337200e4db7acb3190c2fb37277 P 6be460adbebf4c9695f1ea3b6a6285cf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:07.522405  1108 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:58:07.525812  1108 consensus_peers.cc:597] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 -> Peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Couldn't send request to peer 6be460adbebf4c9695f1ea3b6a6285cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:07.535357  1215 raft_consensus.cc:1275] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Refusing update from remote peer 510684f49c9e49a8838857869ba37ba9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:07.536468  1277 consensus_queue.cc:1048] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a068c0f86c2a4282a961df8be5c95435" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:07.546613   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:58:07.569108   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:07.595719   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:07.596451   431 tablet_replica.cc:333] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.597044   431 raft_consensus.cc:2243] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.597522   431 raft_consensus.cc:2272] T 1c49c337200e4db7acb3190c2fb37277 P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.599265   431 tablet_replica.cc:333] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.599763   431 raft_consensus.cc:2243] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.600189   431 raft_consensus.cc:2272] T 1c9db541c34144f7ac6a4c48efbc64a3 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.601832   431 tablet_replica.cc:333] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.602329   431 raft_consensus.cc:2243] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.602720   431 raft_consensus.cc:2272] T 501f9fa2eb1b4e60afa31547fcfc1af7 P 510684f49c9e49a8838857869ba37ba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.604430   431 tablet_replica.cc:333] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.604916   431 raft_consensus.cc:2243] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.605340   431 raft_consensus.cc:2272] T 2c95edc2809d4ae79842ca4aed05c354 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.607268   431 tablet_replica.cc:333] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.607791   431 raft_consensus.cc:2243] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.608592   431 raft_consensus.cc:2272] T 3fc66927689c49a5addaa19f63574728 P 510684f49c9e49a8838857869ba37ba9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.610554   431 tablet_replica.cc:333] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.611061   431 raft_consensus.cc:2243] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.611490   431 raft_consensus.cc:2272] T c5e7b519fdb64824a00ea8841a13789a P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.613344   431 tablet_replica.cc:333] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.613839   431 raft_consensus.cc:2243] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.614275   431 raft_consensus.cc:2272] T dd65593693dd449d9f907e6ea29b6890 P 510684f49c9e49a8838857869ba37ba9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.616464   431 tablet_replica.cc:333] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.616966   431 raft_consensus.cc:2243] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.617630   431 raft_consensus.cc:2272] T 199ccdada50342ec82e4dc5eca71c861 P 510684f49c9e49a8838857869ba37ba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.619624   431 tablet_replica.cc:333] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.620111   431 raft_consensus.cc:2243] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.620893   431 raft_consensus.cc:2272] T 02711afdec9640f6bd510a50bb620a1e P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.622519   431 tablet_replica.cc:333] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9: stopping tablet replica
I20260709 12:58:07.622997   431 raft_consensus.cc:2243] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.623394   431 raft_consensus.cc:2272] T fbd570861fbd463080e4641319dab1ba P 510684f49c9e49a8838857869ba37ba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:07.643399  1182 consensus_peers.cc:597] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 -> Peer 6be460adbebf4c9695f1ea3b6a6285cf (127.0.107.193:38747): Couldn't send request to peer 6be460adbebf4c9695f1ea3b6a6285cf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:07.651959   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:07.669751   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:07.693226   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:07.693949   431 tablet_replica.cc:333] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.694525   431 raft_consensus.cc:2243] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.695000   431 raft_consensus.cc:2272] T 501f9fa2eb1b4e60afa31547fcfc1af7 P a068c0f86c2a4282a961df8be5c95435 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.696813   431 tablet_replica.cc:333] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.697322   431 raft_consensus.cc:2243] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.697781   431 raft_consensus.cc:2272] T 1c9db541c34144f7ac6a4c48efbc64a3 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.699484   431 tablet_replica.cc:333] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.699978   431 raft_consensus.cc:2243] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.700410   431 raft_consensus.cc:2272] T 3fc66927689c49a5addaa19f63574728 P a068c0f86c2a4282a961df8be5c95435 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.703050   431 tablet_replica.cc:333] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.703552   431 raft_consensus.cc:2243] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.704356   431 raft_consensus.cc:2272] T 2c95edc2809d4ae79842ca4aed05c354 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.706712   431 tablet_replica.cc:333] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.707206   431 raft_consensus.cc:2243] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.707597   431 raft_consensus.cc:2272] T c5e7b519fdb64824a00ea8841a13789a P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.709270   431 tablet_replica.cc:333] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.709740   431 raft_consensus.cc:2243] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.710397   431 raft_consensus.cc:2272] T dd65593693dd449d9f907e6ea29b6890 P a068c0f86c2a4282a961df8be5c95435 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.712175   431 tablet_replica.cc:333] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.712749   431 raft_consensus.cc:2243] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.713261   431 raft_consensus.cc:2272] T 199ccdada50342ec82e4dc5eca71c861 P a068c0f86c2a4282a961df8be5c95435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.715112   431 tablet_replica.cc:333] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.715595   431 raft_consensus.cc:2243] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.715969   431 raft_consensus.cc:2272] T fbd570861fbd463080e4641319dab1ba P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.717537   431 tablet_replica.cc:333] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.717983   431 raft_consensus.cc:2243] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:07.718350   431 raft_consensus.cc:2272] T 02711afdec9640f6bd510a50bb620a1e P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.719916   431 tablet_replica.cc:333] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435: stopping tablet replica
I20260709 12:58:07.720410   431 raft_consensus.cc:2243] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.721135   431 raft_consensus.cc:2272] T 1c49c337200e4db7acb3190c2fb37277 P a068c0f86c2a4282a961df8be5c95435 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.739907   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:07.756680   431 master.cc:562] Master@127.0.107.254:46289 shutting down...
I20260709 12:58:07.775601   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:07.776144   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:07.776535   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 87cfbadb0eb44812a8eeaf40850a2b12: stopping tablet replica
I20260709 12:58:07.795682   431 master.cc:584] Master@127.0.107.254:46289 shutdown complete.
510684f49c9e49a8838857869ba37ba9  4
6be460adbebf4c9695f1ea3b6a6285cf  5
a068c0f86c2a4282a961df8be5c95435  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10388 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:58:07.833981   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33233
I20260709 12:58:07.835129   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:07.840754  1415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:07.840853  1414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:07.841369  1417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:07.842662   431 server_base.cc:1061] running on GCE node
I20260709 12:58:07.843494   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:07.843700   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:07.843860   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601887843842 us; error 0 us; skew 500 ppm
I20260709 12:58:07.844448   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:07.846763   431 webserver.cc:533] Webserver started at http://127.0.107.254:45965/ using document root <none> and password file <none>
I20260709 12:58:07.847260   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:07.847462   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:07.847738   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:07.848907   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "a34435529147466db8abc42dc6329534"
format_stamp: "Formatted at 2026-07-09 12:58:07 on dist-test-slave-vcr9"
I20260709 12:58:07.853272   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:07.856629  1422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:07.857472   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:58:07.857714   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "a34435529147466db8abc42dc6329534"
format_stamp: "Formatted at 2026-07-09 12:58:07 on dist-test-slave-vcr9"
I20260709 12:58:07.857949   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:07.867594   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:07.868781   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:07.905385   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33233
I20260709 12:58:07.905488  1473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33233 every 8 connection(s)
I20260709 12:58:07.909144  1474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:07.918715  1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Bootstrap starting.
I20260709 12:58:07.923290  1474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:07.927461  1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: No bootstrap required, opened a new log
I20260709 12:58:07.929564  1474 raft_consensus.cc:359] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34435529147466db8abc42dc6329534" member_type: VOTER }
I20260709 12:58:07.929937  1474 raft_consensus.cc:385] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:07.930177  1474 raft_consensus.cc:740] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a34435529147466db8abc42dc6329534, State: Initialized, Role: FOLLOWER
I20260709 12:58:07.930711  1474 consensus_queue.cc:260] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34435529147466db8abc42dc6329534" member_type: VOTER }
I20260709 12:58:07.931161  1474 raft_consensus.cc:399] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:07.931393  1474 raft_consensus.cc:493] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:07.931655  1474 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:07.935675  1474 raft_consensus.cc:515] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34435529147466db8abc42dc6329534" member_type: VOTER }
I20260709 12:58:07.936179  1474 leader_election.cc:304] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a34435529147466db8abc42dc6329534; no voters: 
I20260709 12:58:07.937325  1474 leader_election.cc:290] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:07.937683  1477 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:07.939014  1477 raft_consensus.cc:697] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 1 LEADER]: Becoming Leader. State: Replica: a34435529147466db8abc42dc6329534, State: Running, Role: LEADER
I20260709 12:58:07.939678  1477 consensus_queue.cc:237] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34435529147466db8abc42dc6329534" member_type: VOTER }
I20260709 12:58:07.940383  1474 sys_catalog.cc:565] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:07.944751  1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a34435529147466db8abc42dc6329534. Latest consensus state: current_term: 1 leader_uuid: "a34435529147466db8abc42dc6329534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34435529147466db8abc42dc6329534" member_type: VOTER } }
I20260709 12:58:07.945470  1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:07.945961  1478 sys_catalog.cc:455] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a34435529147466db8abc42dc6329534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a34435529147466db8abc42dc6329534" member_type: VOTER } }
I20260709 12:58:07.946362  1478 sys_catalog.cc:458] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:07.947614  1484 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:07.952216  1484 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:07.956595   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:07.960505  1484 catalog_manager.cc:1383] Generated new cluster ID: 48081d8c4eda48edb1c12bb2a560fb4b
I20260709 12:58:07.960788  1484 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:07.979398  1484 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:07.980705  1484 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:07.994305  1484 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Generated new TSK 0
I20260709 12:58:07.994881  1484 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:08.023764   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:08.029570  1495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:08.031222  1496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:08.034118   431 server_base.cc:1061] running on GCE node
W20260709 12:58:08.034418  1498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:08.035521   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:08.035709   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:08.035830   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601888035818 us; error 0 us; skew 500 ppm
I20260709 12:58:08.036361   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:08.038475   431 webserver.cc:533] Webserver started at http://127.0.107.193:41779/ using document root <none> and password file <none>
I20260709 12:58:08.038877   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:08.039032   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:08.039240   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:08.040205   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
format_stamp: "Formatted at 2026-07-09 12:58:08 on dist-test-slave-vcr9"
I20260709 12:58:08.044544   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:58:08.047499  1503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.048602   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:08.048889   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
format_stamp: "Formatted at 2026-07-09 12:58:08 on dist-test-slave-vcr9"
I20260709 12:58:08.049196   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:08.059537   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:08.060763   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:08.062201   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:08.064369   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:08.064575   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.064810   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:08.064994   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.102653   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34321
I20260709 12:58:08.102748  1565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34321 every 8 connection(s)
I20260709 12:58:08.107553   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:08.114101  1570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:08.115006  1571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:08.117775  1573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:08.117898   431 server_base.cc:1061] running on GCE node
I20260709 12:58:08.119037   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:08.119315   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:08.119529   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601888119510 us; error 0 us; skew 500 ppm
I20260709 12:58:08.120079   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:08.120690  1566 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33233
I20260709 12:58:08.121073  1566 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:08.121878  1566 heartbeater.cc:507] Master 127.0.107.254:33233 requested a full tablet report, sending...
I20260709 12:58:08.122936   431 webserver.cc:533] Webserver started at http://127.0.107.194:35589/ using document root <none> and password file <none>
I20260709 12:58:08.123498   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:08.123710   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:08.123984   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:08.124115  1439 ts_manager.cc:194] Registered new tserver with Master: 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:08.125222   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
format_stamp: "Formatted at 2026-07-09 12:58:08 on dist-test-slave-vcr9"
I20260709 12:58:08.125972  1439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50788
I20260709 12:58:08.129675   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:58:08.132807  1578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.133627   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:08.133859   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
format_stamp: "Formatted at 2026-07-09 12:58:08 on dist-test-slave-vcr9"
I20260709 12:58:08.134097   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:08.145192   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:08.146273   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:08.147624   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:08.149778   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:08.149972   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.150229   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:08.150403   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.188602   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33617
I20260709 12:58:08.188711  1640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33617 every 8 connection(s)
I20260709 12:58:08.193197   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:08.200352  1644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:08.201650  1645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:08.204869  1647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:08.204989   431 server_base.cc:1061] running on GCE node
I20260709 12:58:08.205861  1641 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33233
I20260709 12:58:08.206214  1641 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:08.206234   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:08.206684   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:08.206881   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601888206863 us; error 0 us; skew 500 ppm
I20260709 12:58:08.207173  1641 heartbeater.cc:507] Master 127.0.107.254:33233 requested a full tablet report, sending...
I20260709 12:58:08.207547   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:08.209182  1439 ts_manager.cc:194] Registered new tserver with Master: d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:08.210420   431 webserver.cc:533] Webserver started at http://127.0.107.195:45811/ using document root <none> and password file <none>
I20260709 12:58:08.210918   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:08.210852  1439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50794
I20260709 12:58:08.211241   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:08.211553   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:08.212797   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "631fb66c0070402b8f78fd74633dae6f"
format_stamp: "Formatted at 2026-07-09 12:58:08 on dist-test-slave-vcr9"
I20260709 12:58:08.217597   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:08.221145  1652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.222012   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:58:08.222358   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "631fb66c0070402b8f78fd74633dae6f"
format_stamp: "Formatted at 2026-07-09 12:58:08 on dist-test-slave-vcr9"
I20260709 12:58:08.222679   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:08.249769   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:08.251034   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:08.252516   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:08.254652   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:08.254884   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.255123   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:08.255295   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:08.293367   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43205
I20260709 12:58:08.293457  1714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43205 every 8 connection(s)
I20260709 12:58:08.306536  1715 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33233
I20260709 12:58:08.306859  1715 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:08.307579  1715 heartbeater.cc:507] Master 127.0.107.254:33233 requested a full tablet report, sending...
I20260709 12:58:08.309369  1439 ts_manager.cc:194] Registered new tserver with Master: 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:08.309652   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013128315s
I20260709 12:58:08.310707  1439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50804
I20260709 12:58:08.334996  1439 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50816:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:08.341284  1439 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:08.539312  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 25da6efa74464e65b8319c8230d379fc (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:08.540752  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da6efa74464e65b8319c8230d379fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.540560  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 33d9e592d41d477fb881a9c29cc45de1 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:08.541889  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9e592d41d477fb881a9c29cc45de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.543124  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:08.544450  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.544828  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 113c4345626841658cc1c3aa19853e2a (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:08.546090  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c4345626841658cc1c3aa19853e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.548240  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 018c063cc2cf4b4aa09be2b8d7067e61 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:08.549520  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c063cc2cf4b4aa09be2b8d7067e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.552856  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3d048f5d2644a6b635da71cc6c7a8b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:08.554199  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3d048f5d2644a6b635da71cc6c7a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.557454  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 32066347a26c4c6a94cbe8e9b624cb23 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:08.558799  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32066347a26c4c6a94cbe8e9b624cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.558569  1671 tablet_service.cc:1511] Processing CreateTablet for tablet f5f65122cec34901839f22a448343dca (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:08.560334  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f65122cec34901839f22a448343dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.561424  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 3306db491bf34b228d1100fd9c826528 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:08.562687  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3306db491bf34b228d1100fd9c826528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.565032  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 396314c408674415abb66b1625b8a308 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:08.566246  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396314c408674415abb66b1625b8a308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.575693  1676 tablet_service.cc:1511] Processing CreateTablet for tablet bdbc1ad76ba949aba54340f33a210d0d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:08.577075  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbc1ad76ba949aba54340f33a210d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.592907  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 3f37c8720262488fbc2c2923a7e60e16 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:08.594260  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f37c8720262488fbc2c2923a7e60e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.596751  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 25da6efa74464e65b8319c8230d379fc (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:08.597271  1730 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:08.598100  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da6efa74464e65b8319c8230d379fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.610499  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:08.610703  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 33d9e592d41d477fb881a9c29cc45de1 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:08.611907  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb16b93f1fe47b4be38ae591c62b564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.612035  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9e592d41d477fb881a9c29cc45de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.618806  1730 tablet_bootstrap.cc:654] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:08.621023  1680 tablet_service.cc:1511] Processing CreateTablet for tablet fc3f11a4a382403ca1e1f14d5fd731db (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:08.622275  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 710eea1b85d441dcabbb12e33e31ae6b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:08.625078  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710eea1b85d441dcabbb12e33e31ae6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.624874  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbf1e27410e4984b453b68cb9b08bd6 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:08.626163  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf1e27410e4984b453b68cb9b08bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.627667  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 339ceb86dfa74bca9b98f5bc6947143e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:08.628932  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339ceb86dfa74bca9b98f5bc6947143e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.629323  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 018c063cc2cf4b4aa09be2b8d7067e61 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:08.631026  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 396314c408674415abb66b1625b8a308 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:08.632668  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3f11a4a382403ca1e1f14d5fd731db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.633795  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3d048f5d2644a6b635da71cc6c7a8b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:08.636627  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 32066347a26c4c6a94cbe8e9b624cb23 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:08.639608  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 3306db491bf34b228d1100fd9c826528 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:08.627991  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 113c4345626841658cc1c3aa19853e2a (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:08.643138  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:08.631004  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c063cc2cf4b4aa09be2b8d7067e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.645567  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396314c408674415abb66b1625b8a308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.648156  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c4345626841658cc1c3aa19853e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.649328  1597 tablet_service.cc:1511] Processing CreateTablet for tablet f5f65122cec34901839f22a448343dca (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:08.650699  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f65122cec34901839f22a448343dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.650766  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 25da6efa74464e65b8319c8230d379fc (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:08.652074  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da6efa74464e65b8319c8230d379fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.661492  1522 tablet_service.cc:1511] Processing CreateTablet for tablet f5f65122cec34901839f22a448343dca (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:08.662838  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f65122cec34901839f22a448343dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.653244  1671 tablet_service.cc:1511] Processing CreateTablet for tablet ff79ac342d91424db634ca7802846535 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:08.664321  1676 tablet_service.cc:1511] Processing CreateTablet for tablet a95518ca56c246da9d064efb1f0fb391 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:08.665139  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff79ac342d91424db634ca7802846535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.665187  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 39ed37d8a3924f28925dbe22d17e11b3 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:08.665786  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95518ca56c246da9d064efb1f0fb391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.653328  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3d048f5d2644a6b635da71cc6c7a8b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:08.666453  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ed37d8a3924f28925dbe22d17e11b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.666985  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3d048f5d2644a6b635da71cc6c7a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.654554  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 113c4345626841658cc1c3aa19853e2a (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:08.671841  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 4588cb2170964d9888521712ee881700 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:08.660012  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 396314c408674415abb66b1625b8a308 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:08.654906  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 312ab9d000ac4b1c82c590d2ea787c2d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:08.673187  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c4345626841658cc1c3aa19853e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.673236  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4588cb2170964d9888521712ee881700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.656322  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 018c063cc2cf4b4aa09be2b8d7067e61 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:08.674309  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c063cc2cf4b4aa09be2b8d7067e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.674561  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3d048f5d2644a6b635da71cc6c7a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.656589  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 32066347a26c4c6a94cbe8e9b624cb23 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:08.653373  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 33d9e592d41d477fb881a9c29cc45de1 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:08.676968  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32066347a26c4c6a94cbe8e9b624cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.658228  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 3306db491bf34b228d1100fd9c826528 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:08.680559  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9e592d41d477fb881a9c29cc45de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.658181  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:08.681509  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.681703  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32066347a26c4c6a94cbe8e9b624cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.682509  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312ab9d000ac4b1c82c590d2ea787c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.682715  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3306db491bf34b228d1100fd9c826528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.683735  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.684085  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396314c408674415abb66b1625b8a308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.685128  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3306db491bf34b228d1100fd9c826528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.709870  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 65a88b4c57e043e39d00e6e3f02b64fe (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:08.722637  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a88b4c57e043e39d00e6e3f02b64fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.745344  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 07fbe913c7484df18b86408c13eabaad (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:08.746699  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fbe913c7484df18b86408c13eabaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.791302  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 3f37c8720262488fbc2c2923a7e60e16 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:08.799238  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 3f37c8720262488fbc2c2923a7e60e16 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:08.802362  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f37c8720262488fbc2c2923a7e60e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.805073  1522 tablet_service.cc:1511] Processing CreateTablet for tablet bdbc1ad76ba949aba54340f33a210d0d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:08.820565  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f37c8720262488fbc2c2923a7e60e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.835760  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbc1ad76ba949aba54340f33a210d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.837952  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:08.839179  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb16b93f1fe47b4be38ae591c62b564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.787992  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4ac1b152f343b3b3d211b9061e8c4e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:08.842561  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4ac1b152f343b3b3d211b9061e8c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.846139  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:08.847499  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb16b93f1fe47b4be38ae591c62b564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.849325  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 710eea1b85d441dcabbb12e33e31ae6b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:08.851487  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 710eea1b85d441dcabbb12e33e31ae6b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:08.768290  1606 tablet_service.cc:1511] Processing CreateTablet for tablet bdbc1ad76ba949aba54340f33a210d0d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:08.860945  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710eea1b85d441dcabbb12e33e31ae6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.864789  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710eea1b85d441dcabbb12e33e31ae6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.863461  1679 tablet_service.cc:1511] Processing CreateTablet for tablet f94c71168cb04e9eaa1fdc0b7a131d9c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:08.871917  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94c71168cb04e9eaa1fdc0b7a131d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.873266  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbf1e27410e4984b453b68cb9b08bd6 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:08.874858  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 339ceb86dfa74bca9b98f5bc6947143e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:08.875263  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf1e27410e4984b453b68cb9b08bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.875375  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 31d2293f596d4cefaf1a169b3a79ba46 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:08.876112  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339ceb86dfa74bca9b98f5bc6947143e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.876652  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d2293f596d4cefaf1a169b3a79ba46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.876895  1603 tablet_service.cc:1511] Processing CreateTablet for tablet fc3f11a4a382403ca1e1f14d5fd731db (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:08.878070  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3f11a4a382403ca1e1f14d5fd731db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.887253  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbc1ad76ba949aba54340f33a210d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.889124  1528 tablet_service.cc:1511] Processing CreateTablet for tablet fc3f11a4a382403ca1e1f14d5fd731db (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:08.890355  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3f11a4a382403ca1e1f14d5fd731db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.894845  1730 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:08.894923  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbf1e27410e4984b453b68cb9b08bd6 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:08.895411  1730 ts_tablet_manager.cc:1403] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.298s	user 0.027s	sys 0.022s
I20260709 12:58:08.896652  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf1e27410e4984b453b68cb9b08bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.898317  1730 raft_consensus.cc:359] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:08.899065  1730 raft_consensus.cc:385] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:08.898859  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 339ceb86dfa74bca9b98f5bc6947143e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:08.899374  1730 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:08.900146  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339ceb86dfa74bca9b98f5bc6947143e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.900795  1732 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:08.903515  1602 tablet_service.cc:1511] Processing CreateTablet for tablet ff79ac342d91424db634ca7802846535 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:08.909713  1531 tablet_service.cc:1511] Processing CreateTablet for tablet ff79ac342d91424db634ca7802846535 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:08.911934  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff79ac342d91424db634ca7802846535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.904532  1730 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:08.915206  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 08d3893a9300428592d3ce769b91a4db (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:08.933065  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d3893a9300428592d3ce769b91a4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.937778  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 781a7e0898fc40c4a08fd46ca3bf5f17 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:08.939069  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781a7e0898fc40c4a08fd46ca3bf5f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.916200  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 312ab9d000ac4b1c82c590d2ea787c2d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:08.917594  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 39ed37d8a3924f28925dbe22d17e11b3 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:08.918380  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 312ab9d000ac4b1c82c590d2ea787c2d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:08.920461  1732 tablet_bootstrap.cc:654] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:08.920632  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 65a88b4c57e043e39d00e6e3f02b64fe (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:08.945122  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312ab9d000ac4b1c82c590d2ea787c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.925836  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 39ed37d8a3924f28925dbe22d17e11b3 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:08.931244  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff79ac342d91424db634ca7802846535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.948464  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ed37d8a3924f28925dbe22d17e11b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.949200  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a88b4c57e043e39d00e6e3f02b64fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:08.952075  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:08.959792  1524 tablet_service.cc:1511] Processing CreateTablet for tablet a95518ca56c246da9d064efb1f0fb391 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:08.964990  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312ab9d000ac4b1c82c590d2ea787c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.965538  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95518ca56c246da9d064efb1f0fb391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.973610  1673 tablet_service.cc:1511] Processing CreateTablet for tablet c43a3d11aec04f86a107e64e2a5bc263 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:08.975210  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43a3d11aec04f86a107e64e2a5bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.980471  1715 heartbeater.cc:499] Master 127.0.107.254:33233 was elected leader, sending a full tablet report...
I20260709 12:58:08.980679  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 4588cb2170964d9888521712ee881700 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:08.981220  1733 tablet_bootstrap.cc:492] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:08.982033  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4588cb2170964d9888521712ee881700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.987589  1733 tablet_bootstrap.cc:654] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:08.980681  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 65a88b4c57e043e39d00e6e3f02b64fe (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:08.988441  1598 tablet_service.cc:1511] Processing CreateTablet for tablet a95518ca56c246da9d064efb1f0fb391 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:08.990027  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ed37d8a3924f28925dbe22d17e11b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.997663  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 07fbe913c7484df18b86408c13eabaad (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:08.999464  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fbe913c7484df18b86408c13eabaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:08.963065  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 4588cb2170964d9888521712ee881700 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:09.019730  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 1246638ecc3b4bf59847dec07f61fd3d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:09.024391  1527 tablet_service.cc:1511] Processing CreateTablet for tablet f94c71168cb04e9eaa1fdc0b7a131d9c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:09.014600  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 07fbe913c7484df18b86408c13eabaad (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:09.029006  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 08d3893a9300428592d3ce769b91a4db (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:09.017499  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a88b4c57e043e39d00e6e3f02b64fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.035418  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246638ecc3b4bf59847dec07f61fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.040730  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95518ca56c246da9d064efb1f0fb391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.016824  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4ac1b152f343b3b3d211b9061e8c4e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:09.045665  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94c71168cb04e9eaa1fdc0b7a131d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.055810  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 048bebee007041bf8db6f1bdbcf60a16 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:09.056406  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4ac1b152f343b3b3d211b9061e8c4e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:09.059259  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fbe913c7484df18b86408c13eabaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.054332  1730 ts_tablet_manager.cc:1434] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.159s	user 0.005s	sys 0.008s
I20260709 12:58:09.062080  1734 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.064404  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048bebee007041bf8db6f1bdbcf60a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.072530  1734 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.075110  1734 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:09.064556  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4588cb2170964d9888521712ee881700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.076344  1730 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:09.065877  1732 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:09.080655  1732 ts_tablet_manager.cc:1403] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.029s
I20260709 12:58:09.081143  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 31d2293f596d4cefaf1a169b3a79ba46 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:09.083304  1529 tablet_service.cc:1511] Processing CreateTablet for tablet c43a3d11aec04f86a107e64e2a5bc263 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:09.070490  1601 tablet_service.cc:1511] Processing CreateTablet for tablet f94c71168cb04e9eaa1fdc0b7a131d9c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:09.089534  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94c71168cb04e9eaa1fdc0b7a131d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.066969  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 781a7e0898fc40c4a08fd46ca3bf5f17 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:09.083521  1732 raft_consensus.cc:359] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.089330  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 08d3893a9300428592d3ce769b91a4db (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:09.097632  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d3893a9300428592d3ce769b91a4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.098938  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 1246638ecc3b4bf59847dec07f61fd3d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:09.092278  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 781a7e0898fc40c4a08fd46ca3bf5f17 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:09.109169  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781a7e0898fc40c4a08fd46ca3bf5f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.095348  1606 tablet_service.cc:1511] Processing CreateTablet for tablet c43a3d11aec04f86a107e64e2a5bc263 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:09.114652  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43a3d11aec04f86a107e64e2a5bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.101612  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 048bebee007041bf8db6f1bdbcf60a16 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:09.103024  1671 tablet_service.cc:1511] Processing CreateTablet for tablet cf01b8ced3144c0289c4f428fc24ead7 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:09.120669  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d3893a9300428592d3ce769b91a4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.121258  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf01b8ced3144c0289c4f428fc24ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.089994  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 31d2293f596d4cefaf1a169b3a79ba46 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:09.125301  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d2293f596d4cefaf1a169b3a79ba46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.127410  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4ac1b152f343b3b3d211b9061e8c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.103655  1732 raft_consensus.cc:385] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.128412  1566 heartbeater.cc:499] Master 127.0.107.254:33233 was elected leader, sending a full tablet report...
I20260709 12:58:09.132668  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4ac1b152f343b3b3d211b9061e8c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.136605  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43a3d11aec04f86a107e64e2a5bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.137351  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781a7e0898fc40c4a08fd46ca3bf5f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.128360  1732 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.140503  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d2293f596d4cefaf1a169b3a79ba46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.140829  1732 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.144518  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246638ecc3b4bf59847dec07f61fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.113668  1730 tablet_bootstrap.cc:654] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.164244  1528 tablet_service.cc:1511] Processing CreateTablet for tablet cf01b8ced3144c0289c4f428fc24ead7 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:09.186406  1641 heartbeater.cc:499] Master 127.0.107.254:33233 was elected leader, sending a full tablet report...
I20260709 12:58:09.186839  1732 ts_tablet_manager.cc:1434] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.013s
I20260709 12:58:09.188064  1732 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:09.208316  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048bebee007041bf8db6f1bdbcf60a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.209465  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 2f362fd54b48400ba3c9fb8b8a405a93 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:09.210023  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf01b8ced3144c0289c4f428fc24ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.210747  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f362fd54b48400ba3c9fb8b8a405a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.218132  1604 tablet_service.cc:1511] Processing CreateTablet for tablet cf01b8ced3144c0289c4f428fc24ead7 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:09.219314  1733 tablet_bootstrap.cc:492] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:09.219492  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf01b8ced3144c0289c4f428fc24ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.219822  1733 ts_tablet_manager.cc:1403] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.239s	user 0.008s	sys 0.033s
I20260709 12:58:09.221547  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 048bebee007041bf8db6f1bdbcf60a16 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:09.223215  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048bebee007041bf8db6f1bdbcf60a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.222920  1733 raft_consensus.cc:359] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.223690  1733 raft_consensus.cc:385] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.245138  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 1246638ecc3b4bf59847dec07f61fd3d (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:09.246477  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1246638ecc3b4bf59847dec07f61fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.249804  1732 tablet_bootstrap.cc:654] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.252117  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 2f362fd54b48400ba3c9fb8b8a405a93 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:09.253137  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f362fd54b48400ba3c9fb8b8a405a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.224002  1733 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
W20260709 12:58:09.256018  1425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47830.8us
I20260709 12:58:09.261063  1600 tablet_service.cc:1511] Processing CreateTablet for tablet bb61d39ca56d420fbee59be16467e2ec (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:09.266916  1733 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.273473  1676 tablet_service.cc:1511] Processing CreateTablet for tablet bb61d39ca56d420fbee59be16467e2ec (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:09.274823  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61d39ca56d420fbee59be16467e2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.282167  1531 tablet_service.cc:1511] Processing CreateTablet for tablet bb61d39ca56d420fbee59be16467e2ec (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:09.283457  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61d39ca56d420fbee59be16467e2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.292840  1672 tablet_service.cc:1511] Processing CreateTablet for tablet c877c15208b54931ba86acd6c47658c2 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:09.294193  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c877c15208b54931ba86acd6c47658c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.294889  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:09.296517  1656 leader_election.cc:343] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.296602  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 2f362fd54b48400ba3c9fb8b8a405a93 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:09.300302  1739 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.300822  1739 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.301467  1523 tablet_service.cc:1511] Processing CreateTablet for tablet f38b9a36dae0409c8200773ccf754d04 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:09.303532  1739 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:09.279769  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61d39ca56d420fbee59be16467e2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.321074  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f362fd54b48400ba3c9fb8b8a405a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.316284  1673 tablet_service.cc:1511] Processing CreateTablet for tablet f38b9a36dae0409c8200773ccf754d04 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:09.341892  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38b9a36dae0409c8200773ccf754d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.349630  1605 tablet_service.cc:1511] Processing CreateTablet for tablet c877c15208b54931ba86acd6c47658c2 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:09.351071  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c877c15208b54931ba86acd6c47658c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.358310  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:09.358922  1730 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:09.359042  1616 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:09.359724  1730 ts_tablet_manager.cc:1403] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.284s	user 0.015s	sys 0.000s
I20260709 12:58:09.359695  1524 tablet_service.cc:1511] Processing CreateTablet for tablet c877c15208b54931ba86acd6c47658c2 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:09.360747  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:09.361910  1734 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:09.362241  1734 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.362573  1734 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:09.364084  1730 raft_consensus.cc:359] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.365077  1730 raft_consensus.cc:385] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.365437  1730 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.372715  1529 tablet_service.cc:1511] Processing CreateTablet for tablet f7d180faf3bc4436ad4c3b4b4805e7b9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:09.373464  1597 tablet_service.cc:1511] Processing CreateTablet for tablet f7d180faf3bc4436ad4c3b4b4805e7b9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:09.374683  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d180faf3bc4436ad4c3b4b4805e7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.375756  1679 tablet_service.cc:1511] Processing CreateTablet for tablet f7d180faf3bc4436ad4c3b4b4805e7b9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:09.377322  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d180faf3bc4436ad4c3b4b4805e7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.384501  1598 tablet_service.cc:1511] Processing CreateTablet for tablet f38b9a36dae0409c8200773ccf754d04 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:09.384284  1525 tablet_service.cc:1511] Processing CreateTablet for tablet faff66e63c5547ae8e8132a1465a5a30 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:09.390043  1732 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:09.390283  1730 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.403494  1732 ts_tablet_manager.cc:1403] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.214s	user 0.024s	sys 0.007s
I20260709 12:58:09.408556  1677 tablet_service.cc:1511] Processing CreateTablet for tablet faff66e63c5547ae8e8132a1465a5a30 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:09.409397  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3e95209267412dbc539c57519c1a37 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:09.409930  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faff66e63c5547ae8e8132a1465a5a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.403086  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d180faf3bc4436ad4c3b4b4805e7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.403370  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38b9a36dae0409c8200773ccf754d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.410409  1732 raft_consensus.cc:359] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:09.413259  1732 raft_consensus.cc:385] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.413650  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3e95209267412dbc539c57519c1a37 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:09.417917  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3e95209267412dbc539c57519c1a37 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:09.413571  1732 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.419257  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3e95209267412dbc539c57519c1a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.419718  1732 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:09.420804  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38b9a36dae0409c8200773ccf754d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.421738  1526 tablet_service.cc:1511] Processing CreateTablet for tablet b36f171d98ea4aedbd87b5f98c2c0127 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:09.423031  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f171d98ea4aedbd87b5f98c2c0127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.424525  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3e95209267412dbc539c57519c1a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.428061  1732 ts_tablet_manager.cc:1434] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:58:09.428514  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3e95209267412dbc539c57519c1a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.437302  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faff66e63c5547ae8e8132a1465a5a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.440511  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c877c15208b54931ba86acd6c47658c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.442283  1674 tablet_service.cc:1511] Processing CreateTablet for tablet b36f171d98ea4aedbd87b5f98c2c0127 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:09.443573  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f171d98ea4aedbd87b5f98c2c0127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.448695  1732 tablet_bootstrap.cc:492] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:09.463727  1527 tablet_service.cc:1511] Processing CreateTablet for tablet d1a3569684e442e0a362c5e9412961ec (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:09.464329  1734 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.465075  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a3569684e442e0a362c5e9412961ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.464995  1675 tablet_service.cc:1511] Processing CreateTablet for tablet d1a3569684e442e0a362c5e9412961ec (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:09.466305  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a3569684e442e0a362c5e9412961ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.467039  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:09.467247  1734 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:09.468809  1656 leader_election.cc:343] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.464995  1602 tablet_service.cc:1511] Processing CreateTablet for tablet faff66e63c5547ae8e8132a1465a5a30 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:09.475054  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:09.476629  1582 leader_election.cc:343] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.477232  1739 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.477689  1739 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:09.479646  1739 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:09.481303  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:09.482722  1582 leader_election.cc:343] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.472615  1732 tablet_bootstrap.cc:654] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.496400  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:09.497490  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faff66e63c5547ae8e8132a1465a5a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.499861  1730 ts_tablet_manager.cc:1434] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.003s
I20260709 12:58:09.500883  1730 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:09.503147  1599 tablet_service.cc:1511] Processing CreateTablet for tablet b36f171d98ea4aedbd87b5f98c2c0127 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:09.507489  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 96265149c6c844b48c46f6df62cc9162 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:09.508340  1616 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:09.508913  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96265149c6c844b48c46f6df62cc9162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.509449  1733 ts_tablet_manager.cc:1434] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.286s	user 0.031s	sys 0.048s
I20260709 12:58:09.517479  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f171d98ea4aedbd87b5f98c2c0127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.530707  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:09.532011  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.532202  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 96265149c6c844b48c46f6df62cc9162 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:09.534121  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96265149c6c844b48c46f6df62cc9162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.535455  1730 tablet_bootstrap.cc:654] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.539534  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:09.540865  1744 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.541814  1601 tablet_service.cc:1511] Processing CreateTablet for tablet d1a3569684e442e0a362c5e9412961ec (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:09.542488  1744 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.543255  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a3569684e442e0a362c5e9412961ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.543944  1528 tablet_service.cc:1511] Processing CreateTablet for tablet f4058bbcb74442ac872f33138d7075c8 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:09.545192  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4058bbcb74442ac872f33138d7075c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.541576  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:09.549118  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.547299  1733 tablet_bootstrap.cc:492] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:09.586921  1673 tablet_service.cc:1511] Processing CreateTablet for tablet f4058bbcb74442ac872f33138d7075c8 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:09.547473  1744 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:09.588667  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4058bbcb74442ac872f33138d7075c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.588943  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 96265149c6c844b48c46f6df62cc9162 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:09.599152  1616 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:09.602326  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:09.603447  1690 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:09.604825  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:09.607195  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:09.610496  1739 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:09.616645  1581 leader_election.cc:343] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.617079  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:09.617703  1739 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:09.624045  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:09.625159  1748 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:09.625681  1748 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:09.626185  1606 tablet_service.cc:1511] Processing CreateTablet for tablet a0a666caa35f4005a9f1bd6c9797300c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:09.626518  1748 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.632480  1732 tablet_bootstrap.cc:492] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:09.633114  1732 ts_tablet_manager.cc:1403] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.201s	user 0.019s	sys 0.001s
I20260709 12:58:09.636188  1732 raft_consensus.cc:359] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.640519  1732 raft_consensus.cc:385] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.640817  1732 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.641548  1732 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.642776  1679 tablet_service.cc:1511] Processing CreateTablet for tablet a0a666caa35f4005a9f1bd6c9797300c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:09.643705  1732 ts_tablet_manager.cc:1434] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.001s
I20260709 12:58:09.644698  1732 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:09.644991  1597 tablet_service.cc:1511] Processing CreateTablet for tablet f4058bbcb74442ac872f33138d7075c8 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:09.639775  1530 tablet_service.cc:1511] Processing CreateTablet for tablet a0a666caa35f4005a9f1bd6c9797300c (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:09.646332  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a666caa35f4005a9f1bd6c9797300c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.647843  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.648880  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4058bbcb74442ac872f33138d7075c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.644111  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a666caa35f4005a9f1bd6c9797300c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.649894  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb908b69c2e4ea19d87384e95f694ce (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:09.650986  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96265149c6c844b48c46f6df62cc9162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.651086  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb908b69c2e4ea19d87384e95f694ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.652973  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a666caa35f4005a9f1bd6c9797300c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.656533  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb908b69c2e4ea19d87384e95f694ce (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:09.657749  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb908b69c2e4ea19d87384e95f694ce (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:09.658192  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb908b69c2e4ea19d87384e95f694ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.686517  1677 tablet_service.cc:1511] Processing CreateTablet for tablet ea39a99a63554d4dbb26f49a38585b4e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:09.687801  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea39a99a63554d4dbb26f49a38585b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.688977  1436 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.691954  1733 tablet_bootstrap.cc:654] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.693413  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:09.695744  1507 leader_election.cc:343] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.698769  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5f5933777f457e99f4a6b1781ec12b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:09.700052  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5f5933777f457e99f4a6b1781ec12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.704569  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb908b69c2e4ea19d87384e95f694ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.704355  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5f5933777f457e99f4a6b1781ec12b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:09.705628  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5f5933777f457e99f4a6b1781ec12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.711091  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 57b6d9fb4551488e978e5e62c1c59485 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:09.712491  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6d9fb4551488e978e5e62c1c59485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.714342  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 57b6d9fb4551488e978e5e62c1c59485 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:09.682968  1531 tablet_service.cc:1511] Processing CreateTablet for tablet ea39a99a63554d4dbb26f49a38585b4e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:09.716429  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 57b6d9fb4551488e978e5e62c1c59485 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:09.717044  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6d9fb4551488e978e5e62c1c59485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.717418  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea39a99a63554d4dbb26f49a38585b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.718092  1600 tablet_service.cc:1511] Processing CreateTablet for tablet ea39a99a63554d4dbb26f49a38585b4e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:09.721803  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea39a99a63554d4dbb26f49a38585b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.718585  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5f5933777f457e99f4a6b1781ec12b (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:09.744513  1732 tablet_bootstrap.cc:654] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.746991  1528 tablet_service.cc:1511] Processing CreateTablet for tablet ef7b3cac6dd7435096e3efbed87d6eda (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:09.744930  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6d9fb4551488e978e5e62c1c59485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.751432  1674 tablet_service.cc:1511] Processing CreateTablet for tablet ef7b3cac6dd7435096e3efbed87d6eda (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:09.752027  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7b3cac6dd7435096e3efbed87d6eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.755527  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5f5933777f457e99f4a6b1781ec12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.757989  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7b3cac6dd7435096e3efbed87d6eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.770068  1530 tablet_service.cc:1511] Processing CreateTablet for tablet ef459e67de67444fad0fff119d7885c0 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:09.771428  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef459e67de67444fad0fff119d7885c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.771019  1605 tablet_service.cc:1511] Processing CreateTablet for tablet ef459e67de67444fad0fff119d7885c0 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:09.772773  1748 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.773388  1748 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.774509  1673 tablet_service.cc:1511] Processing CreateTablet for tablet ef459e67de67444fad0fff119d7885c0 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:09.772857  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef459e67de67444fad0fff119d7885c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.775593  1748 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:09.778292  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:09.779670  1526 tablet_service.cc:1511] Processing CreateTablet for tablet fe01230b6e6e4a119346bdaa29d78b55 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:09.785583  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe01230b6e6e4a119346bdaa29d78b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.781265  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:09.789182  1597 tablet_service.cc:1511] Processing CreateTablet for tablet ef7b3cac6dd7435096e3efbed87d6eda (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:09.793541  1730 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
W20260709 12:58:09.789819  1656 leader_election.cc:343] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:09.797225  1656 leader_election.cc:343] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.797641  1656 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:09.798334  1606 tablet_service.cc:1511] Processing CreateTablet for tablet fe01230b6e6e4a119346bdaa29d78b55 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:09.798771  1748 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:09.799664  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe01230b6e6e4a119346bdaa29d78b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.799809  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:09.804800  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7b3cac6dd7435096e3efbed87d6eda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:09.806177  1506 leader_election.cc:343] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.806658  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:09.806922  1733 tablet_bootstrap.cc:492] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:09.807451  1744 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:09.808282  1733 ts_tablet_manager.cc:1403] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.286s	user 0.014s	sys 0.001s
I20260709 12:58:09.811156  1733 raft_consensus.cc:359] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.811867  1733 raft_consensus.cc:385] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.812161  1733 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.813479  1730 ts_tablet_manager.cc:1403] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.313s	user 0.008s	sys 0.028s
I20260709 12:58:09.813935  1733 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.822346  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef459e67de67444fad0fff119d7885c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.842888  1730 raft_consensus.cc:359] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.843667  1730 raft_consensus.cc:385] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.843493  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 79180ee33a124de7a839155b4a30086e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:09.843950  1730 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.844919  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79180ee33a124de7a839155b4a30086e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.844832  1730 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.847004  1730 ts_tablet_manager.cc:1434] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 12:58:09.847966  1730 tablet_bootstrap.cc:492] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:09.853874  1733 ts_tablet_manager.cc:1434] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:58:09.854929  1733 tablet_bootstrap.cc:492] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:09.863476  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 79180ee33a124de7a839155b4a30086e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:09.865540  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 79180ee33a124de7a839155b4a30086e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:09.867348  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79180ee33a124de7a839155b4a30086e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.873232  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 1bea0da863664ef78c27cd81d07e53d9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:09.874516  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bea0da863664ef78c27cd81d07e53d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.888866  1680 tablet_service.cc:1511] Processing CreateTablet for tablet fe01230b6e6e4a119346bdaa29d78b55 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:09.889427  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 1bea0da863664ef78c27cd81d07e53d9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:09.890218  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe01230b6e6e4a119346bdaa29d78b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.891141  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bea0da863664ef78c27cd81d07e53d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.897691  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 9059b4be41c340278068c13696d1000e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:09.899456  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9059b4be41c340278068c13696d1000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.902307  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 9059b4be41c340278068c13696d1000e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:09.903628  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9059b4be41c340278068c13696d1000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.903335  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 9059b4be41c340278068c13696d1000e (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:09.904544  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9059b4be41c340278068c13696d1000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.906383  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab255080f74412f87943c46e12f9f06 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:09.907610  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab255080f74412f87943c46e12f9f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.921267  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79180ee33a124de7a839155b4a30086e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.923090  1732 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:09.923596  1732 ts_tablet_manager.cc:1403] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.279s	user 0.007s	sys 0.009s
I20260709 12:58:09.926489  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee88b04047243b6b9ee3653189f3969 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:09.927945  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee88b04047243b6b9ee3653189f3969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.930716  1748 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.930474  1732 raft_consensus.cc:359] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.931211  1732 raft_consensus.cc:385] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:09.931164  1748 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.931634  1732 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:09.938954  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:09.940567  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:09.941533  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee88b04047243b6b9ee3653189f3969 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:58:09.941999  1656 leader_election.cc:343] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.942703  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee88b04047243b6b9ee3653189f3969. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:09.943042  1656 leader_election.cc:343] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:09.943460  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:09.944334  1734 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:09.936522  1748 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:09.946769  1730 tablet_bootstrap.cc:654] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.949607  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 1bea0da863664ef78c27cd81d07e53d9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:09.950861  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bea0da863664ef78c27cd81d07e53d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.951331  1732 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.953856  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea53f766b5a4fd081983e46c7fd5da9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:58:09.954268  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:09.955121  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea53f766b5a4fd081983e46c7fd5da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.960655  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea53f766b5a4fd081983e46c7fd5da9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:09.961874  1732 ts_tablet_manager.cc:1434] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.038s	user 0.000s	sys 0.008s
I20260709 12:58:09.962060  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea53f766b5a4fd081983e46c7fd5da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.962898  1732 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:09.959384  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea53f766b5a4fd081983e46c7fd5da9 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:09.970021  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea53f766b5a4fd081983e46c7fd5da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.958819  1733 tablet_bootstrap.cc:654] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:09.960754  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee88b04047243b6b9ee3653189f3969 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:09.992586  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab255080f74412f87943c46e12f9f06 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:09.990952  1739 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.994082  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee88b04047243b6b9ee3653189f3969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.994403  1739 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:09.995819  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab255080f74412f87943c46e12f9f06 (DEFAULT_TABLE table=test-workload [id=1e34fbe609e9487882b5ca35c2718a57]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:09.997483  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab255080f74412f87943c46e12f9f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:09.994082  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab255080f74412f87943c46e12f9f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:10.021049  1748 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:10.033552  1730 tablet_bootstrap.cc:492] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.034255  1730 ts_tablet_manager.cc:1403] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.005s
I20260709 12:58:10.038359  1730 raft_consensus.cc:359] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.039381  1730 raft_consensus.cc:385] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.039774  1730 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.043241  1739 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.044067  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.044728  1541 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.046159  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:10.047842  1581 leader_election.cc:343] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.049187  1582 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:10.050711  1739 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.051182  1739 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.051807  1739 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.053277  1733 tablet_bootstrap.cc:492] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.053799  1733 ts_tablet_manager.cc:1403] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.004s
I20260709 12:58:10.056797  1733 raft_consensus.cc:359] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.057523  1733 raft_consensus.cc:385] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.057818  1733 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.058542  1733 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.059219  1739 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.062559  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.063143  1541 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.070900  1541 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:10.072171  1582 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.078106  1733 ts_tablet_manager.cc:1434] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:58:10.080312  1744 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.080842  1744 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.083041  1744 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.083429  1733 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.084398  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.084897  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:10.085953  1507 leader_election.cc:343] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:10.086553  1506 leader_election.cc:343] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.086977  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:10.088075  1744 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.089037  1739 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.089605  1739 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.090430  1739 raft_consensus.cc:697] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:10.090590  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.091235  1739 consensus_queue.cc:237] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:10.091928  1581 leader_election.cc:343] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.100704  1730 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.108067  1730 ts_tablet_manager.cc:1434] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 12:58:10.109171  1730 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.106268  1732 tablet_bootstrap.cc:654] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.120393  1730 tablet_bootstrap.cc:654] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.130574  1730 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.131165  1730 ts_tablet_manager.cc:1403] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.002s
I20260709 12:58:10.133833  1730 raft_consensus.cc:359] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.134405  1730 raft_consensus.cc:385] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.134657  1730 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.135365  1730 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.137545  1730 ts_tablet_manager.cc:1434] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:10.138266  1732 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.138602  1730 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.138885  1732 ts_tablet_manager.cc:1403] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.008s
I20260709 12:58:10.144340  1730 tablet_bootstrap.cc:654] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.147115  1732 raft_consensus.cc:359] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.147719  1732 raft_consensus.cc:385] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.147967  1732 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.148721  1732 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.150965  1732 ts_tablet_manager.cc:1434] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:58:10.151748  1732 tablet_bootstrap.cc:492] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.154568  1730 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.155159  1730 ts_tablet_manager.cc:1403] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.005s
I20260709 12:58:10.158567  1732 tablet_bootstrap.cc:654] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.158514  1730 raft_consensus.cc:359] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.136083  1733 tablet_bootstrap.cc:654] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.159459  1730 raft_consensus.cc:385] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.160305  1730 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.161281  1730 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.164731  1730 ts_tablet_manager.cc:1434] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:10.167522  1730 tablet_bootstrap.cc:492] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.170898  1732 tablet_bootstrap.cc:492] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.171473  1732 ts_tablet_manager.cc:1403] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:58:10.176441  1748 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.176937  1748 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.178158  1732 raft_consensus.cc:359] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.178721  1732 raft_consensus.cc:385] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.178985  1732 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.179085  1748 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.175271  1730 tablet_bootstrap.cc:654] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.179435  1436 catalog_manager.cc:5697] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.182636  1732 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.185508  1732 ts_tablet_manager.cc:1434] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:58:10.186777  1732 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.192764  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.193506  1540 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.194197  1730 tablet_bootstrap.cc:492] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.194553  1733 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.194679  1730 ts_tablet_manager.cc:1403] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.012s
I20260709 12:58:10.194751  1732 tablet_bootstrap.cc:654] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.195259  1733 ts_tablet_manager.cc:1403] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.008s
I20260709 12:58:10.195288  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.196518  1616 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.198119  1730 raft_consensus.cc:359] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.198832  1730 raft_consensus.cc:385] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.199340  1730 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.198694  1733 raft_consensus.cc:359] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.200131  1733 raft_consensus.cc:385] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.200752  1733 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.200098  1730 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.198993  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.202507  1734 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.202876  1734 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.203205  1734 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.202049  1733 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:10.204185  1656 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:10.205979  1733 ts_tablet_manager.cc:1434] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:10.210731  1734 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.203204  1730 ts_tablet_manager.cc:1434] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:58:10.217172  1730 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.224980  1734 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.226140  1733 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.227104  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.227429  1732 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.227519  1730 tablet_bootstrap.cc:654] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.227721  1616 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.227936  1732 ts_tablet_manager.cc:1403] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.027s
I20260709 12:58:10.228372  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.229008  1541 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.231307  1732 raft_consensus.cc:359] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.232017  1732 raft_consensus.cc:385] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.232331  1732 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.233471  1732 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.235198  1733 tablet_bootstrap.cc:654] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.235837  1732 ts_tablet_manager.cc:1434] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:10.236882  1732 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.244995  1732 tablet_bootstrap.cc:654] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.245957  1541 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:10.247442  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:10.248534  1734 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.249007  1734 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:10.249677  1616 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:10.249840  1734 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.249652  1730 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.251421  1730 ts_tablet_manager.cc:1403] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.015s
I20260709 12:58:10.253420  1733 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.253958  1733 ts_tablet_manager.cc:1403] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 12:58:10.254140  1730 raft_consensus.cc:359] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.254891  1730 raft_consensus.cc:385] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.255199  1730 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.255890  1730 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.256647  1774 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.257543  1733 raft_consensus.cc:359] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.257337  1774 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.258627  1730 ts_tablet_manager.cc:1434] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:10.259572  1730 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.260403  1774 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.260557  1739 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.260943  1733 raft_consensus.cc:385] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.261438  1733 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.261270  1739 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.262475  1733 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.265218  1730 tablet_bootstrap.cc:654] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.265120  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.266031  1541 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.267810  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.269488  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.269861  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.269577  1763 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.270462  1616 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
W20260709 12:58:10.271395  1656 leader_election.cc:343] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.271531  1733 ts_tablet_manager.cc:1434] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:58:10.274286  1733 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.270480  1763 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.276213  1763 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.280876  1732 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.281471  1732 ts_tablet_manager.cc:1403] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.014s
I20260709 12:58:10.282315  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.282944  1690 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.283111  1733 tablet_bootstrap.cc:654] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.280792  1739 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.284355  1732 raft_consensus.cc:359] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.285388  1732 raft_consensus.cc:385] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.285694  1732 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.272567  1656 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:10.286480  1732 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.287395  1774 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.287762  1774 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.288089  1774 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.288959  1732 ts_tablet_manager.cc:1434] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:58:10.289911  1732 tablet_bootstrap.cc:492] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.295753  1732 tablet_bootstrap.cc:654] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.297645  1733 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.298314  1733 ts_tablet_manager.cc:1403] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 12:58:10.302467  1733 raft_consensus.cc:359] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.303460  1733 raft_consensus.cc:385] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.303834  1733 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.305028  1733 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.312804  1733 ts_tablet_manager.cc:1434] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:58:10.313849  1733 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.317047  1732 tablet_bootstrap.cc:492] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.316949  1763 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.317570  1732 ts_tablet_manager.cc:1403] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.005s
I20260709 12:58:10.320641  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.320533  1732 raft_consensus.cc:359] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.321218  1541 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.321319  1732 raft_consensus.cc:385] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.321703  1732 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.322479  1732 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.324424  1732 ts_tablet_manager.cc:1434] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:10.325301  1732 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.331423  1732 tablet_bootstrap.cc:654] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.336201  1764 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.336978  1764 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.339017  1541 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:10.340399  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.340574  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.341289  1739 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.341197  1616 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:10.342324  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.342828  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.343171  1690 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:10.343941  1744 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.344413  1744 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.341028  1764 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.344810  1744 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.345682  1739 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:10.346704  1739 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.349682  1732 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.350193  1732 ts_tablet_manager.cc:1403] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:58:10.350725  1730 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.351215  1730 ts_tablet_manager.cc:1403] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.092s	user 0.048s	sys 0.026s
I20260709 12:58:10.351473  1774 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.353477  1774 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.353392  1732 raft_consensus.cc:359] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.353811  1730 raft_consensus.cc:359] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:10.354408  1732 raft_consensus.cc:385] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.354518  1730 raft_consensus.cc:385] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.354915  1732 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.354940  1730 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.355767  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.356033  1730 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:10.356820  1616 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.356942  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.357470  1690 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.358076  1730 ts_tablet_manager.cc:1434] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:10.358328  1733 tablet_bootstrap.cc:654] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.358958  1730 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.359822  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:10.361194  1656 leader_election.cc:343] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.353689  1744 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.364566  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.364665  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.365120  1615 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.365549  1763 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.365655  1689 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.367834  1730 tablet_bootstrap.cc:654] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.367790  1690 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:10.373661  1616 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:10.374028  1689 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:10.374392  1744 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.375361  1732 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.378448  1615 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:10.380429  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.382135  1744 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.382916  1744 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:10.383608  1436 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:10.385437  1744 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.389420  1732 ts_tablet_manager.cc:1434] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:58:10.391423  1732 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.393496  1656 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:10.398072  1734 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.398639  1734 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:10.398674  1732 tablet_bootstrap.cc:654] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.399398  1730 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.400022  1730 ts_tablet_manager.cc:1403] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.010s
I20260709 12:58:10.399775  1734 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.403924  1730 raft_consensus.cc:359] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.406698  1730 raft_consensus.cc:385] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.407080  1730 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.408093  1730 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.411175  1730 ts_tablet_manager.cc:1434] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:10.412358  1730 tablet_bootstrap.cc:492] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.420032  1730 tablet_bootstrap.cc:654] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.420082  1732 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.424387  1732 ts_tablet_manager.cc:1403] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.003s
I20260709 12:58:10.425321  1437 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:10.427977  1732 raft_consensus.cc:359] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.428894  1732 raft_consensus.cc:385] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.429214  1732 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.429925  1732 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.429888  1436 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.431331  1733 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.431967  1733 ts_tablet_manager.cc:1403] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.118s	user 0.018s	sys 0.027s
I20260709 12:58:10.432032  1732 ts_tablet_manager.cc:1434] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:10.432988  1732 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.435343  1733 raft_consensus.cc:359] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.436165  1733 raft_consensus.cc:385] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.436554  1733 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.437510  1733 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.435207  1438 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.440547  1733 ts_tablet_manager.cc:1434] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:58:10.441808  1733 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.444818  1732 tablet_bootstrap.cc:654] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.445123  1764 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.445585  1764 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.447634  1764 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.449051  1733 tablet_bootstrap.cc:654] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.449209  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.449796  1730 tablet_bootstrap.cc:492] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.450207  1730 ts_tablet_manager.cc:1403] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 12:58:10.451303  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.452131  1616 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:10.452845  1730 raft_consensus.cc:359] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.453473  1730 raft_consensus.cc:385] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.453734  1730 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.454305  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.454340  1730 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:10.456590  1506 leader_election.cc:343] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.456795  1732 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.457335  1732 ts_tablet_manager.cc:1403] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 12:58:10.460384  1732 raft_consensus.cc:359] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.461165  1732 raft_consensus.cc:385] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.461403  1732 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.462064  1732 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.462977  1733 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.462929  1764 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.463513  1764 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.463910  1764 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.464022  1732 ts_tablet_manager.cc:1434] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:58:10.472718  1732 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.456844  1730 ts_tablet_manager.cc:1434] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:58:10.470458  1733 ts_tablet_manager.cc:1403] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.005s
I20260709 12:58:10.477140  1730 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.478935  1733 raft_consensus.cc:359] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.479607  1733 raft_consensus.cc:385] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.479884  1733 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.471302  1764 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.481930  1764 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.482800  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.483388  1616 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.484167  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.484557  1730 tablet_bootstrap.cc:654] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.485680  1732 tablet_bootstrap.cc:654] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:10.485718  1506 leader_election.cc:343] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.483407  1733 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.489406  1733 ts_tablet_manager.cc:1434] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 12:58:10.490325  1733 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.491747  1616 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:10.493013  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:10.494272  1764 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.494743  1764 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:10.495543  1764 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.496759  1733 tablet_bootstrap.cc:654] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.510516  1437 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.512651  1730 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.512887  1733 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.513134  1730 ts_tablet_manager.cc:1403] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.008s
I20260709 12:58:10.513443  1733 ts_tablet_manager.cc:1403] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:58:10.515851  1730 raft_consensus.cc:359] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.516594  1730 raft_consensus.cc:385] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.515988  1733 raft_consensus.cc:359] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.516894  1730 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.517138  1733 raft_consensus.cc:385] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.517318  1732 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.517436  1733 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.517788  1732 ts_tablet_manager.cc:1403] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.013s
I20260709 12:58:10.518544  1733 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.519977  1739 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.520300  1732 raft_consensus.cc:359] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.520452  1739 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.520967  1732 raft_consensus.cc:385] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.521273  1732 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.522027  1732 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.522507  1739 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.524511  1732 ts_tablet_manager.cc:1434] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:10.525213  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.525748  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.526331  1689 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.526505  1541 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.528519  1689 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.528378  1581 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.529810  1785 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.530223  1785 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.530498  1785 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.532555  1734 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.533020  1734 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.535465  1733 ts_tablet_manager.cc:1434] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:58:10.535442  1734 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.536528  1733 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.537456  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.538039  1541 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.539081  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:10.539330  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.540428  1734 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.540364  1615 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.542353  1734 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.542811  1734 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.543382  1732 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.544777  1733 tablet_bootstrap.cc:654] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.517647  1730 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.547709  1730 ts_tablet_manager.cc:1434] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:58:10.553253  1732 tablet_bootstrap.cc:654] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.556519  1764 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.557051  1764 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.557701  1739 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.559119  1764 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.562417  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.559847  1785 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.566027  1785 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.567524  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.568105  1541 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.568286  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.568913  1689 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.558287  1739 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.571588  1785 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:10.574030  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.574649  1540 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.576681  1748 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.577235  1748 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.577863  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.579133  1763 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.579496  1763 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.579834  1748 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.581377  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.576053  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.588006  1688 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.588348  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:10.589536  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.590230  1539 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.591990  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.579849  1763 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.580677  1774 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.593233  1774 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.566051  1733 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.589566  1764 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.596820  1733 ts_tablet_manager.cc:1403] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.008s
I20260709 12:58:10.596519  1785 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:10.595872  1774 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.596342  1739 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.598346  1785 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.599004  1785 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.603367  1730 tablet_bootstrap.cc:492] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.603977  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:10.602986  1733 raft_consensus.cc:359] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:10.605698  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.607466  1615 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.607695  1774 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.608160  1774 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.606593  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.608702  1774 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.608599  1733 raft_consensus.cc:385] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.609702  1733 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.610373  1733 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:10.615520  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:10.612886  1733 ts_tablet_manager.cc:1434] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
W20260709 12:58:10.616641  1656 leader_election.cc:343] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.621167  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:10.623787  1689 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:10.625531  1581 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.627029  1730 tablet_bootstrap.cc:654] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.628727  1803 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.628841  1541 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:10.629325  1803 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:10.629869  1763 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.631493  1616 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:10.632328  1763 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.633899  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.630283  1803 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.634218  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.634790  1785 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.635334  1541 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.617192  1688 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:10.618216  1732 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.620011  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.636905  1732 ts_tablet_manager.cc:1403] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.041s
W20260709 12:58:10.637614  1582 leader_election.cc:343] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.617249  1733 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.641515  1732 raft_consensus.cc:359] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.642556  1732 raft_consensus.cc:385] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.642943  1732 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.643927  1732 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.647337  1748 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.656764  1732 ts_tablet_manager.cc:1434] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.002s
I20260709 12:58:10.658358  1732 tablet_bootstrap.cc:492] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.655751  1581 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:10.665444  1785 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.665858  1785 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.666198  1785 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.667992  1807 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.668680  1807 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:10.671555  1807 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.681494  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.682448  1540 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.683765  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.684677  1616 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:10.686846  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:10.688203  1808 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:10.688761  1808 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.689213  1808 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.692142  1540 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.692716  1730 tablet_bootstrap.cc:492] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.693427  1730 ts_tablet_manager.cc:1403] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.026s
I20260709 12:58:10.703931  1748 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.708810  1807 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:10.711442  1748 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.715624  1733 tablet_bootstrap.cc:654] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.715862  1436 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.722350  1730 raft_consensus.cc:359] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.723562  1730 raft_consensus.cc:385] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.724018  1730 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.724720  1785 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.725067  1734 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.726828  1785 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.726891  1734 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.727757  1730 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.724720  1774 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.734699  1774 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.734725  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:10.735602  1689 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:10.739845  1730 ts_tablet_manager.cc:1434] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:58:10.740607  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.740922  1730 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.741273  1538 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.743525  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:10.746455  1582 leader_election.cc:343] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.747496  1732 tablet_bootstrap.cc:654] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.772132  1733 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:10.772645  1733 ts_tablet_manager.cc:1403] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.007s
I20260709 12:58:10.776618  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.777518  1615 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.778688  1730 tablet_bootstrap.cc:654] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.783838  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.787794  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.788971  1616 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:10.797159  1763 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.797688  1763 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.800058  1763 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:10.801849  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:10.803841  1581 leader_election.cc:343] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.804997  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:10.806905  1582 leader_election.cc:343] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.807504  1582 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:10.808945  1763 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.821535  1541 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:10.821566  1808 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:10.823989  1808 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.823916  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:10.825450  1785 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.826072  1763 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:10.826352  1785 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:10.819666  1733 raft_consensus.cc:359] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.827965  1733 raft_consensus.cc:385] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.828433  1733 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.830485  1733 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.824848  1748 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.839934  1785 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.847949  1690 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:10.868825  1581 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:10.871942  1763 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.900095  1733 ts_tablet_manager.cc:1434] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.003s
I20260709 12:58:10.901901  1733 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:10.905486  1748 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.908175  1732 tablet_bootstrap.cc:492] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:10.911072  1732 ts_tablet_manager.cc:1403] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.253s	user 0.015s	sys 0.015s
I20260709 12:58:10.913363  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:10.914746  1748 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.915808  1748 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:10.916376  1732 raft_consensus.cc:359] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.917075  1732 raft_consensus.cc:385] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.917320  1732 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:10.920140  1732 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.923076  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.923375  1744 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:10.923681  1541 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.927635  1615 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:10.929256  1732 ts_tablet_manager.cc:1434] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:58:10.930289  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:10.931161  1732 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:10.934649  1744 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:10.930281  1538 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:10.938541  1748 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.939780  1748 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.940363  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.941105  1615 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:10.941936  1748 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:10.942057  1803 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:10.947000  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:10.948050  1808 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:10.948577  1808 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:10.949440  1808 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.955034  1537 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:10.932621  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:10.960482  1730 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:10.960994  1730 ts_tablet_manager.cc:1403] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.220s	user 0.024s	sys 0.017s
I20260709 12:58:10.961417  1614 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:10.971344  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:10.973398  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:10.975606  1730 raft_consensus.cc:359] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.976118  1730 raft_consensus.cc:385] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:10.976410  1730 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
W20260709 12:58:10.974291  1656 leader_election.cc:343] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.978304  1730 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.976384  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:10.979583  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:10.984834  1774 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.986128  1730 ts_tablet_manager.cc:1434] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
W20260709 12:58:10.986291  1656 leader_election.cc:343] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:10.987097  1656 leader_election.cc:343] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:10.987397  1730 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:10.990396  1733 tablet_bootstrap.cc:654] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:10.987517  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:10.994870  1734 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:10.995586  1803 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.996032  1803 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:10.996671  1437 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.999095  1803 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.000514  1730 tablet_bootstrap.cc:654] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.015501  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.023703  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.025851  1689 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:11.032346  1541 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:11.033870  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:11.035228  1774 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.021361  1808 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.025864  1582 leader_election.cc:343] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.035791  1774 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:11.039635  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:11.040647  1785 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.041008  1785 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.041326  1785 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.041591  1774 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:11.047077  1732 tablet_bootstrap.cc:654] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.038617  1808 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.050155  1808 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:11.050092  1734 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:11.052207  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.052428  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.053025  1616 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:11.075035  1656 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:11.075021  1436 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:11.088690  1827 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:58:11.110422  1436 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:11.111269  1774 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.114075  1733 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.114557  1733 ts_tablet_manager.cc:1403] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.213s	user 0.022s	sys 0.040s
I20260709 12:58:11.117262  1733 raft_consensus.cc:359] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.117956  1733 raft_consensus.cc:385] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.118223  1733 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.118885  1733 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.120258  1739 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:11.121738  1733 ts_tablet_manager.cc:1434] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:11.122994  1733 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:11.130609  1614 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:11.131831  1785 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.134366  1785 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.136317  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:11.136933  1690 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.137243  1825 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.137686  1825 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.143100  1748 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.145066  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:11.162789  1582 leader_election.cc:343] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.167562  1785 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.168406  1825 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.172989  1732 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.173647  1732 ts_tablet_manager.cc:1403] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.244s	user 0.016s	sys 0.005s
I20260709 12:58:11.181656  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.186571  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.188614  1507 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:11.195374  1733 tablet_bootstrap.cc:654] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.198913  1732 raft_consensus.cc:359] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.200356  1732 raft_consensus.cc:385] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.200753  1825 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:11.200754  1732 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.202482  1732 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.205590  1732 ts_tablet_manager.cc:1434] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:58:11.206677  1732 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:11.221441  1730 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:11.222046  1730 ts_tablet_manager.cc:1403] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.235s	user 0.022s	sys 0.024s
I20260709 12:58:11.227686  1732 tablet_bootstrap.cc:654] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.233101  1733 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.233192  1690 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:11.233666  1733 ts_tablet_manager.cc:1403] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.003s
I20260709 12:58:11.230470  1730 raft_consensus.cc:359] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.234509  1730 raft_consensus.cc:385] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.234524  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:11.235478  1739 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.234822  1730 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.235951  1739 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:11.246745  1739 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.240195  1733 raft_consensus.cc:359] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.248998  1733 raft_consensus.cc:385] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.249740  1733 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.250466  1733 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.251559  1732 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.252030  1732 ts_tablet_manager.cc:1403] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.003s
I20260709 12:58:11.254724  1733 ts_tablet_manager.cc:1434] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:58:11.254571  1732 raft_consensus.cc:359] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.255244  1732 raft_consensus.cc:385] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.255512  1732 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.255678  1733 tablet_bootstrap.cc:492] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:11.256155  1732 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.258405  1732 ts_tablet_manager.cc:1434] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:11.260349  1732 tablet_bootstrap.cc:492] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:11.251559  1730 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.262075  1730 ts_tablet_manager.cc:1434] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.002s
I20260709 12:58:11.265605  1733 tablet_bootstrap.cc:654] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.265745  1730 tablet_bootstrap.cc:492] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:11.266927  1732 tablet_bootstrap.cc:654] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.274956  1744 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.275507  1744 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.280382  1732 tablet_bootstrap.cc:492] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.280874  1732 ts_tablet_manager.cc:1403] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 12:58:11.281265  1733 tablet_bootstrap.cc:492] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.281737  1733 ts_tablet_manager.cc:1403] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
I20260709 12:58:11.281975  1730 tablet_bootstrap.cc:654] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.283677  1732 raft_consensus.cc:359] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.284364  1732 raft_consensus.cc:385] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.284212  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.285811  1733 raft_consensus.cc:359] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.286345  1732 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.286579  1733 raft_consensus.cc:385] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.286768  1613 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:11.286937  1733 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.287611  1733 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.287393  1732 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.285627  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.289718  1690 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:11.290252  1733 ts_tablet_manager.cc:1434] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:58:11.290758  1732 ts_tablet_manager.cc:1434] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:11.291344  1733 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:11.292146  1732 tablet_bootstrap.cc:492] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:11.278059  1744 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.299050  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:11.302814  1438 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:11.304478  1733 tablet_bootstrap.cc:654] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.304576  1732 tablet_bootstrap.cc:654] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.305230  1744 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.319319  1732 tablet_bootstrap.cc:492] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.319849  1732 ts_tablet_manager.cc:1403] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 12:58:11.320561  1733 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.321000  1733 ts_tablet_manager.cc:1403] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.010s
I20260709 12:58:11.322929  1732 raft_consensus.cc:359] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.323671  1732 raft_consensus.cc:385] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.323455  1733 raft_consensus.cc:359] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.323982  1732 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.324467  1733 raft_consensus.cc:385] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.324792  1733 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.325104  1732 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.325429  1733 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.327462  1732 ts_tablet_manager.cc:1434] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:11.327535  1733 ts_tablet_manager.cc:1434] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:58:11.331883  1733 tablet_bootstrap.cc:492] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:11.333845  1732 tablet_bootstrap.cc:492] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:11.336447  1774 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.337949  1733 tablet_bootstrap.cc:654] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.342773  1732 tablet_bootstrap.cc:654] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.342622  1744 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.345002  1825 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.345458  1739 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:11.361786  1774 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.362556  1774 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.369735  1739 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.378852  1730 tablet_bootstrap.cc:492] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:11.378556  1739 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.379587  1730 ts_tablet_manager.cc:1403] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.023s
I20260709 12:58:11.382575  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.383315  1541 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:11.384049  1739 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.384344  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.386726  1582 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.390450  1774 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:11.386966  1730 raft_consensus.cc:359] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.450841  1730 raft_consensus.cc:385] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.451725  1730 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.453017  1733 tablet_bootstrap.cc:492] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.452630  1730 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.453521  1733 ts_tablet_manager.cc:1403] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.023s
I20260709 12:58:11.456341  1730 ts_tablet_manager.cc:1434] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:58:11.457501  1730 tablet_bootstrap.cc:492] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:11.457921  1732 tablet_bootstrap.cc:492] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.458380  1732 ts_tablet_manager.cc:1403] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.024s
I20260709 12:58:11.458280  1733 raft_consensus.cc:359] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.459110  1733 raft_consensus.cc:385] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.459408  1733 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.460276  1733 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.461400  1732 raft_consensus.cc:359] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.462544  1732 raft_consensus.cc:385] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.462653  1733 ts_tablet_manager.cc:1434] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:58:11.462862  1732 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.463692  1733 tablet_bootstrap.cc:492] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:11.463588  1732 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.466264  1732 ts_tablet_manager.cc:1434] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:58:11.464970  1730 tablet_bootstrap.cc:654] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.468384  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.395495  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:11.473217  1656 leader_election.cc:343] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.473896  1739 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.474301  1739 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.474638  1739 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:11.476119  1581 leader_election.cc:343] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.477281  1732 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
W20260709 12:58:11.479177  1656 leader_election.cc:343] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.480213  1656 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:11.482381  1774 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.483089  1774 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:11.480357  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 93725.1us
W20260709 12:58:11.485409  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 97052.2us
I20260709 12:58:11.489979  1733 tablet_bootstrap.cc:654] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.496299  1763 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.498755  1808 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.499656  1732 tablet_bootstrap.cc:654] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.508694  1730 tablet_bootstrap.cc:492] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:11.509307  1730 ts_tablet_manager.cc:1403] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:58:11.513126  1730 raft_consensus.cc:359] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.514125  1730 raft_consensus.cc:385] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.514474  1730 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.516176  1744 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.516933  1744 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.518062  1808 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.521725  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.522583  1615 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:11.522636  1744 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.524940  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.525751  1689 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:11.526962  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.540592  1744 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.541121  1744 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.541574  1744 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.542603  1739 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.544824  1739 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.547819  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:11.515365  1730 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:11.552356  1581 leader_election.cc:343] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.554205  1763 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.554906  1763 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.557658  1763 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.565349  1730 ts_tablet_manager.cc:1434] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:58:11.566532  1803 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.569862  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:11.570792  1536 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.571525  1732 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.572086  1732 ts_tablet_manager.cc:1403] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.029s
I20260709 12:58:11.573992  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.577275  1732 raft_consensus.cc:359] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.580242  1732 raft_consensus.cc:385] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.581292  1732 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
W20260709 12:58:11.581903  1582 leader_election.cc:343] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.567349  1803 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.583240  1732 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.585848  1803 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.587563  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.590051  1732 ts_tablet_manager.cc:1434] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:11.591786  1732 tablet_bootstrap.cc:492] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:11.595005  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.598512  1730 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:11.603456  1732 tablet_bootstrap.cc:654] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.611531  1730 tablet_bootstrap.cc:654] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:11.607950  1581 leader_election.cc:343] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.611965  1734 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.612990  1734 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:11.613618  1581 leader_election.cc:343] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.614210  1581 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:11.615168  1734 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:11.615305  1763 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.618434  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.619321  1615 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:11.620981  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.621791  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.621012  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.622429  1539 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:11.623768  1808 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.624143  1808 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.624513  1808 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:11.628587  1656 leader_election.cc:343] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.615720  1734 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.630128  1732 tablet_bootstrap.cc:492] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.630642  1732 ts_tablet_manager.cc:1403] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.009s
I20260709 12:58:11.631405  1730 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:11.631856  1730 ts_tablet_manager.cc:1403] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.003s
I20260709 12:58:11.633526  1732 raft_consensus.cc:359] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.634353  1732 raft_consensus.cc:385] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.635083  1732 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.638298  1732 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.639163  1744 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.641808  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:11.642961  1744 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.643234  1803 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.640075  1808 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.643678  1803 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.644160  1803 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.645155  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:11.645462  1808 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:11.645793  1616 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.646672  1785 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.647549  1785 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.648602  1739 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.649286  1739 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.650342  1732 ts_tablet_manager.cc:1434] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:58:11.649987  1785 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.652359  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:11.653964  1732 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:11.654639  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.653837  1614 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.654304  1739 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:11.670446  1581 leader_election.cc:343] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.676367  1744 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.677117  1744 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.679668  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:11.690128  1730 raft_consensus.cc:359] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.690729  1730 raft_consensus.cc:385] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.691051  1730 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.692775  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.692034  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:11.693754  1744 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:11.694319  1582 leader_election.cc:343] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.695852  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.695231  1730 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:11.691552  1656 leader_election.cc:343] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.699105  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:11.703156  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.703554  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.703837  1687 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:11.704337  1689 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:11.701239  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.706067  1732 tablet_bootstrap.cc:654] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.700094  1690 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.719208  1506 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:11.720044  1744 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.721467  1733 tablet_bootstrap.cc:492] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.722122  1733 ts_tablet_manager.cc:1403] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.259s	user 0.071s	sys 0.048s
I20260709 12:58:11.723567  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.714190  1785 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.726974  1730 ts_tablet_manager.cc:1434] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.095s	user 0.015s	sys 0.014s
I20260709 12:58:11.729799  1730 tablet_bootstrap.cc:492] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:11.725821  1763 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.732366  1763 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.732743  1763 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.737221  1616 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:11.738567  1803 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.741359  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.742244  1825 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.744436  1803 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.751078  1536 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
W20260709 12:58:11.728345  1582 leader_election.cc:343] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.762624  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:11.766776  1582 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:11.767746  1739 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.767236  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:11.768437  1536 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:11.772878  1581 leader_election.cc:343] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.789168  1733 raft_consensus.cc:359] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.789906  1733 raft_consensus.cc:385] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.790189  1733 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.790831  1733 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.782327  1825 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:11.797272  1739 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:11.816809  1733 ts_tablet_manager.cc:1434] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.094s	user 0.013s	sys 0.004s
I20260709 12:58:11.817870  1733 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:11.819648  1739 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.820792  1825 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.833508  1730 tablet_bootstrap.cc:654] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.837888  1614 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:11.838279  1536 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:11.838553  1690 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:11.839308  1763 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.844575  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:11.845117  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:11.845469  1763 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.845989  1763 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.846141  1808 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.846495  1763 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:11.846755  1808 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:11.847482  1763 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.849426  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:11.849469  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:11.840286  1744 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.852975  1690 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.854533  1438 catalog_manager.cc:5697] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:11.847678  1808 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.852977  1732 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:11.859395  1732 ts_tablet_manager.cc:1403] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.206s	user 0.009s	sys 0.009s
I20260709 12:58:11.860396  1733 tablet_bootstrap.cc:654] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.853114  1536 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.860766  1739 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:11.863641  1785 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:11.892969  1436 catalog_manager.cc:5697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:11.894555  1739 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.895678  1739 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.899189  1732 raft_consensus.cc:359] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.900395  1732 raft_consensus.cc:385] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.900833  1732 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.901839  1732 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.905387  1732 ts_tablet_manager.cc:1434] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:58:11.905236  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.906528  1732 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
W20260709 12:58:11.907462  1582 leader_election.cc:343] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.909184  1739 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:11.911465  1730 tablet_bootstrap.cc:492] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:11.912000  1730 ts_tablet_manager.cc:1403] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.007s
I20260709 12:58:11.913239  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:11.925777  1859 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.926036  1581 leader_election.cc:343] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.926537  1859 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.932090  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:11.926563  1581 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:11.933465  1730 raft_consensus.cc:359] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.933969  1862 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:11.934222  1730 raft_consensus.cc:385] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.934379  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:11.935030  1614 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:11.934571  1730 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.936079  1730 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.936882  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.938228  1730 ts_tablet_manager.cc:1434] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 12:58:11.938047  1734 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:11.938324  1859 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:11.939138  1734 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.939559  1730 tablet_bootstrap.cc:492] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:11.939532  1734 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:11.940033  1656 leader_election.cc:343] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:11.956120  1690 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:11.957293  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:11.958016  1536 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:11.958178  1785 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.958747  1785 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:11.959578  1785 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.975098  1437 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:11.978766  1436 catalog_manager.cc:5697] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:11.985334  1730 tablet_bootstrap.cc:654] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.985517  1732 tablet_bootstrap.cc:654] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.986353  1733 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:11.987026  1733 ts_tablet_manager.cc:1403] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.021s
I20260709 12:58:11.993709  1733 raft_consensus.cc:359] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:11.994541  1733 raft_consensus.cc:385] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.997464  1436 catalog_manager.cc:5697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:12.003432  1733 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.005131  1733 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.009153  1733 ts_tablet_manager.cc:1434] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:58:12.010080  1733 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.028272  1730 tablet_bootstrap.cc:492] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.028810  1730 ts_tablet_manager.cc:1403] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.006s
I20260709 12:58:12.031530  1730 raft_consensus.cc:359] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:12.024011  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:12.032724  1730 raft_consensus.cc:385] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.033100  1730 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.033860  1730 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.036275  1733 tablet_bootstrap.cc:654] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.037216  1730 ts_tablet_manager.cc:1434] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:12.038661  1730 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.039655  1732 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.045369  1730 tablet_bootstrap.cc:654] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.049196  1732 ts_tablet_manager.cc:1403] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.034s
I20260709 12:58:12.054334  1732 raft_consensus.cc:359] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.055176  1732 raft_consensus.cc:385] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.055553  1732 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.056531  1732 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.057850  1733 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.058321  1733 ts_tablet_manager.cc:1403] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 12:58:12.060516  1732 ts_tablet_manager.cc:1434] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:58:12.061587  1732 tablet_bootstrap.cc:492] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.061380  1733 raft_consensus.cc:359] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.062089  1733 raft_consensus.cc:385] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.062373  1733 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.062973  1733 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.067101  1734 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.069396  1732 tablet_bootstrap.cc:654] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.071395  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:12.074159  1656 leader_election.cc:343] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.069365  1734 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.075794  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.076486  1614 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.082271  1730 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.082810  1730 ts_tablet_manager.cc:1403] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.005s
I20260709 12:58:12.085958  1730 raft_consensus.cc:359] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.086431  1733 ts_tablet_manager.cc:1434] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:58:12.086660  1730 raft_consensus.cc:385] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.086935  1730 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.087689  1730 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.089718  1730 ts_tablet_manager.cc:1434] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:12.091413  1733 tablet_bootstrap.cc:492] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.093302  1730 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.107081  1732 tablet_bootstrap.cc:492] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.107460  1733 tablet_bootstrap.cc:654] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.107717  1732 ts_tablet_manager.cc:1403] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.009s
I20260709 12:58:12.107913  1730 tablet_bootstrap.cc:654] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.111068  1732 raft_consensus.cc:359] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.111989  1732 raft_consensus.cc:385] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.112363  1732 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.113384  1732 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.116899  1733 tablet_bootstrap.cc:492] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.117465  1733 ts_tablet_manager.cc:1403] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.001s
I20260709 12:58:12.119503  1732 ts_tablet_manager.cc:1434] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:12.120503  1732 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.120893  1733 raft_consensus.cc:359] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.121647  1733 raft_consensus.cc:385] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.123021  1733 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.123835  1733 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.125279  1730 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.125718  1730 ts_tablet_manager.cc:1403] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.014s
I20260709 12:58:12.127426  1732 tablet_bootstrap.cc:654] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.129204  1730 raft_consensus.cc:359] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.129887  1730 raft_consensus.cc:385] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.130155  1730 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.130939  1730 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.133087  1730 ts_tablet_manager.cc:1434] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:12.133978  1730 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.140900  1730 tablet_bootstrap.cc:654] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.142266  1733 ts_tablet_manager.cc:1434] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:58:12.146890  1733 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.150398  1730 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.150940  1730 ts_tablet_manager.cc:1403] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 12:58:12.155658  1733 tablet_bootstrap.cc:654] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.157429  1730 raft_consensus.cc:359] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.158936  1730 raft_consensus.cc:385] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.159152  1730 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.159950  1730 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.161156  1614 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.162344  1730 ts_tablet_manager.cc:1434] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:58:12.163262  1730 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.162889  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:12.164461  1734 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.165117  1734 raft_consensus.cc:697] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:12.166201  1734 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.167004  1733 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.168951  1733 ts_tablet_manager.cc:1403] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:58:12.170217  1732 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.170902  1732 ts_tablet_manager.cc:1403] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.021s
I20260709 12:58:12.171617  1730 tablet_bootstrap.cc:654] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.171914  1733 raft_consensus.cc:359] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.172645  1733 raft_consensus.cc:385] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.173342  1733 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.174085  1763 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.174002  1733 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.174561  1763 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.174674  1732 raft_consensus.cc:359] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.175402  1732 raft_consensus.cc:385] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.175745  1732 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.176823  1763 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.176506  1732 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.178471  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.178681  1732 ts_tablet_manager.cc:1434] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:12.179667  1732 tablet_bootstrap.cc:492] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.180498  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:12.184124  1582 leader_election.cc:343] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.184484  1733 ts_tablet_manager.cc:1434] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
W20260709 12:58:12.184967  1581 leader_election.cc:343] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.185426  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:12.185813  1733 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.186805  1732 tablet_bootstrap.cc:654] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.186769  1785 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.196480  1733 tablet_bootstrap.cc:654] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.199146  1732 tablet_bootstrap.cc:492] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.199731  1732 ts_tablet_manager.cc:1403] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:58:12.202524  1732 raft_consensus.cc:359] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.203372  1732 raft_consensus.cc:385] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.203686  1732 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.204478  1732 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.206692  1732 ts_tablet_manager.cc:1434] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:12.209694  1438 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.210503  1730 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.211102  1730 ts_tablet_manager.cc:1403] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.025s
I20260709 12:58:12.213924  1730 raft_consensus.cc:359] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.214671  1730 raft_consensus.cc:385] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.215013  1730 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.215129  1732 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.215952  1730 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.218321  1730 ts_tablet_manager.cc:1434] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:12.219095  1734 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.219594  1734 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.224066  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.224769  1614 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.225903  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.221901  1734 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:12.227576  1656 leader_election.cc:343] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.228595  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:12.229616  1732 tablet_bootstrap.cc:654] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.229903  1734 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.230727  1734 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.231158  1734 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.241973  1732 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.242654  1732 ts_tablet_manager.cc:1403] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 12:58:12.244379  1730 tablet_bootstrap.cc:492] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.245641  1732 raft_consensus.cc:359] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.246346  1732 raft_consensus.cc:385] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.246621  1732 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.247419  1732 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.248731  1859 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.249445  1859 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.251763  1730 tablet_bootstrap.cc:654] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.253664  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.254190  1732 ts_tablet_manager.cc:1434] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:12.254320  1536 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.255559  1825 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:12.256038  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:12.256934  1808 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.257418  1808 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.258704  1808 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.259881  1859 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.264988  1734 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.267210  1734 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.268174  1689 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.271492  1733 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.272475  1733 ts_tablet_manager.cc:1403] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.015s
I20260709 12:58:12.275200  1808 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.275193  1733 raft_consensus.cc:359] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.277470  1808 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.277465  1733 raft_consensus.cc:385] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.278159  1733 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.278589  1687 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.278863  1733 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.281118  1733 ts_tablet_manager.cc:1434] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:58:12.282035  1733 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.285243  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.286455  1614 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.287855  1733 tablet_bootstrap.cc:654] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.288499  1734 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.290832  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.291515  1536 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.296574  1825 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.297114  1825 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.298496  1763 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.300645  1825 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.301873  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.302501  1614 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:12.303683  1507 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:12.310758  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.311383  1537 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.312706  1739 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.314338  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.314308  1862 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:12.315006  1616 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.317469  1744 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.317874  1744 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.318215  1744 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.327234  1744 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.333904  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.334774  1614 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.335691  1733 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.336599  1733 ts_tablet_manager.cc:1403] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.006s
I20260709 12:58:12.331995  1744 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.341030  1536 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.343372  1732 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.345597  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.355309  1739 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.363601  1613 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.357976  1614 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:12.359813  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.364578  1688 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:12.362967  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:12.366879  1808 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.367372  1808 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:12.362633  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:12.368809  1808 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.369510  1689 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.372730  1537 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.367295  1507 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:12.374634  1744 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.375120  1744 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:12.376698  1785 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:12.376942  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:12.378376  1734 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.378878  1732 tablet_bootstrap.cc:654] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.378851  1734 raft_consensus.cc:697] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:12.386379  1734 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.389782  1689 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:12.391616  1613 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.350692  1616 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.391968  1733 raft_consensus.cc:359] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.396467  1744 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.394410  1730 tablet_bootstrap.cc:492] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.396488  1763 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.397933  1730 ts_tablet_manager.cc:1403] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.154s	user 0.023s	sys 0.041s
I20260709 12:58:12.397434  1733 raft_consensus.cc:385] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.399017  1733 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.397840  1763 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.399905  1733 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.412261  1763 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.414366  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.414361  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:12.417526  1581 leader_election.cc:343] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:12.419098  1582 leader_election.cc:343] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.419536  1582 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:12.422242  1785 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.423398  1730 raft_consensus.cc:359] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.424085  1730 raft_consensus.cc:385] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.424377  1730 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.426911  1730 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.429510  1733 ts_tablet_manager.cc:1434] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.000s
I20260709 12:58:12.430366  1733 tablet_bootstrap.cc:492] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.430923  1730 ts_tablet_manager.cc:1434] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:58:12.431797  1730 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.436929  1733 tablet_bootstrap.cc:654] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.451398  1436 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.453766  1436 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.439868  1763 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:58:12.456583  1730 tablet_bootstrap.cc:654] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.451078  1825 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.453532  1864 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:58:12.465344  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:12.466781  1897 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:58:12.466742  1763 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.467108  1825 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.475351  1825 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.468747  1860 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.476342  1860 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.476961  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.477589  1688 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:12.486253  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.486569  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:12.486986  1613 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:12.472496  1763 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.486299  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.488598  1537 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.490036  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:12.492169  1734 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.492537  1734 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.492945  1734 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.493979  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.494608  1613 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.496644  1860 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.497692  1825 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.501731  1825 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.500291  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.502929  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:12.511093  1581 leader_election.cc:343] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.503997  1733 tablet_bootstrap.cc:492] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.512259  1733 ts_tablet_manager.cc:1403] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.012s
W20260709 12:58:12.512784  1582 leader_election.cc:343] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.513435  1582 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:12.514634  1785 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.514724  1825 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.504194  1439 catalog_manager.cc:5697] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:12.525430  1733 raft_consensus.cc:359] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.526512  1733 raft_consensus.cc:385] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.526788  1733 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.527405  1733 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.507802  1732 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.508373  1763 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.531440  1732 ts_tablet_manager.cc:1403] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.276s	user 0.008s	sys 0.017s
I20260709 12:58:12.533157  1734 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.524143  1912 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.543794  1912 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.553606  1730 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.554100  1730 ts_tablet_manager.cc:1403] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.123s	user 0.040s	sys 0.020s
I20260709 12:58:12.555128  1915 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.556687  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.556751  1730 raft_consensus.cc:359] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.563515  1730 raft_consensus.cc:385] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.563808  1730 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.564479  1730 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.566550  1730 ts_tablet_manager.cc:1434] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:58:12.559556  1733 ts_tablet_manager.cc:1434] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 12:58:12.567449  1730 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.568049  1733 tablet_bootstrap.cc:492] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.571025  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.571673  1615 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.572981  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:12.562523  1864 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.562870  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.573859  1730 tablet_bootstrap.cc:654] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.574256  1864 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:12.574744  1656 leader_election.cc:343] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.573935  1860 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.575555  1860 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.575877  1860 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.554093  1732 raft_consensus.cc:359] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.577257  1732 raft_consensus.cc:385] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.577646  1732 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.578998  1864 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.580543  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.579864  1732 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.581321  1615 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:12.585479  1808 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.585959  1808 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.587435  1732 ts_tablet_manager.cc:1434] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.004s
I20260709 12:58:12.588518  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.589118  1538 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.590255  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:12.590973  1859 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:12.591328  1859 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.591653  1859 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:12.594358  1733 tablet_bootstrap.cc:654] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.598572  1732 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.565019  1915 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.609707  1733 tablet_bootstrap.cc:492] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.600200  1734 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.610618  1734 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.601506  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.610841  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.618889  1615 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.623371  1734 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.603688  1859 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.614365  1862 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.628168  1862 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.629249  1616 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:12.630445  1862 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.605576  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.604413  1860 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.607120  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.631456  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.632153  1613 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.632369  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:12.626689  1915 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.632419  1536 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:12.633968  1864 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.634310  1864 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.634639  1864 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.634924  1860 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.636394  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.636096  1582 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:12.648774  1656 leader_election.cc:343] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.638069  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.648782  1912 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.639919  1859 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.642117  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.642342  1864 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.643132  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:12.606143  1808 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.647007  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.649592  1613 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.638746  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.650247  1734 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.651041  1785 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.610993  1733 ts_tablet_manager.cc:1403] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 12:58:12.652776  1732 tablet_bootstrap.cc:654] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.657829  1785 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.657343  1538 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:12.659485  1616 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:12.659843  1690 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:12.663311  1785 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.659323  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.659375  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:12.660626  1915 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.670531  1733 raft_consensus.cc:359] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.671252  1733 raft_consensus.cc:385] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.671612  1733 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.671275  1689 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:12.672178  1733 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.666812  1825 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:12.676365  1656 leader_election.cc:343] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.677317  1825 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.680177  1730 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.680495  1541 raft_consensus.cc:2393] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:12.682669  1785 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.678354  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:12.686837  1689 raft_consensus.cc:2393] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:12.688319  1785 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.684356  1730 ts_tablet_manager.cc:1403] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.117s	user 0.051s	sys 0.041s
I20260709 12:58:12.688517  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.689827  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.691102  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.691211  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:12.691457  1541 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 1: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:12.692137  1613 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.692281  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.701609  1611 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:12.738730  1733 ts_tablet_manager.cc:1434] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 12:58:12.740341  1733 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.689821  1864 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.692181  1689 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.736588  1825 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.701381  1616 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:12.739522  1538 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:12.745930  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:12.745878  1825 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.755493  1914 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.759678  1825 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.762300  1689 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:12.746614  1612 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:12.762646  1730 raft_consensus.cc:359] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.764364  1730 raft_consensus.cc:385] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.764607  1730 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.763422  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:12.766283  1808 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.763420  1581 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:12.766939  1732 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.767228  1785 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.767356  1732 ts_tablet_manager.cc:1403] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.005s
I20260709 12:58:12.767769  1785 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:12.769055  1785 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.765331  1730 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.773593  1732 raft_consensus.cc:359] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.774228  1732 raft_consensus.cc:385] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.774479  1732 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.775023  1732 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.763178  1615 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.777619  1730 ts_tablet_manager.cc:1434] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.001s
I20260709 12:58:12.778544  1730 tablet_bootstrap.cc:492] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.772480  1808 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:12.780573  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:12.784127  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.784531  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:12.787767  1689 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:12.787338  1808 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.789027  1734 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:12.786273  1732 ts_tablet_manager.cc:1434] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 12:58:12.790316  1732 tablet_bootstrap.cc:492] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:12.790807  1612 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:12.792006  1506 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:12.792307  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:12.793862  1825 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.795284  1919 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:12.795791  1919 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:12.797044  1919 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.798243  1733 tablet_bootstrap.cc:654] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.801447  1437 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:12.804083  1507 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:12.805234  1825 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.807924  1730 tablet_bootstrap.cc:654] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.800602  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:12.811015  1734 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:12.811421  1734 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.811746  1734 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.815758  1825 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.823472  1734 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.828902  1733 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:12.829402  1733 ts_tablet_manager.cc:1403] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.006s
I20260709 12:58:12.833400  1915 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:12.834131  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:12.836027  1859 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:12.836555  1859 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:12.842334  1734 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:12.844789  1859 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.851907  1732 tablet_bootstrap.cc:654] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.855705  1437 catalog_manager.cc:5697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.869089  1859 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.870173  1915 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.874413  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:12.882582  1733 raft_consensus.cc:359] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.883380  1733 raft_consensus.cc:385] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.883657  1733 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.886269  1859 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.886511  1808 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.887769  1859 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:12.890362  1825 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.890784  1733 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.891852  1536 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.892254  1730 tablet_bootstrap.cc:492] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:12.892704  1730 ts_tablet_manager.cc:1403] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.005s
I20260709 12:58:12.903393  1436 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 2, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.903393  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:12.906447  1615 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:12.907780  1436 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.911841  1732 tablet_bootstrap.cc:492] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:12.912675  1732 ts_tablet_manager.cc:1403] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.009s
I20260709 12:58:12.908468  1730 raft_consensus.cc:359] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.916821  1730 raft_consensus.cc:385] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.917178  1730 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.918048  1730 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.930056  1730 ts_tablet_manager.cc:1434] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:58:12.948906  1730 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:12.963615  1615 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.965649  1860 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:12.971731  1536 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:12.980540  1733 ts_tablet_manager.cc:1434] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.151s	user 0.007s	sys 0.003s
I20260709 12:58:12.981499  1733 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:12.983879  1730 tablet_bootstrap.cc:654] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.986860  1785 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.987393  1785 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:12.990515  1785 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:12.993989  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:12.995878  1730 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
W20260709 12:58:12.996950  1581 leader_election.cc:343] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:12.998972  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:12.999810  1860 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.000640  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.001736  1860 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:58:13.002144  1582 leader_election.cc:343] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.002517  1732 raft_consensus.cc:359] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.003243  1732 raft_consensus.cc:385] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.002590  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.003527  1732 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.004654  1730 ts_tablet_manager.cc:1403] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.001s
I20260709 12:58:13.004182  1732 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.002631  1860 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.004256  1763 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.009392  1733 tablet_bootstrap.cc:654] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.011085  1732 ts_tablet_manager.cc:1434] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.001s
I20260709 12:58:13.012634  1732 tablet_bootstrap.cc:492] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.018244  1732 tablet_bootstrap.cc:654] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.024801  1541 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.031046  1732 tablet_bootstrap.cc:492] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.054136  1732 ts_tablet_manager.cc:1403] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.004s
I20260709 12:58:13.072363  1730 raft_consensus.cc:359] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.073148  1730 raft_consensus.cc:385] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.073438  1730 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.074076  1730 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.076004  1730 ts_tablet_manager.cc:1434] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:58:13.077684  1730 tablet_bootstrap.cc:492] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.091414  1732 raft_consensus.cc:359] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.092139  1732 raft_consensus.cc:385] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.095273  1732 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.095348  1733 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.095865  1733 ts_tablet_manager.cc:1403] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.115s	user 0.030s	sys 0.024s
I20260709 12:58:13.096102  1732 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.093091  1734 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.097344  1734 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.098536  1732 ts_tablet_manager.cc:1434] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:58:13.100165  1438 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.100834  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:13.102450  1656 leader_election.cc:343] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.103017  1730 tablet_bootstrap.cc:654] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.107236  1825 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:13.107810  1825 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.112857  1732 tablet_bootstrap.cc:492] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.106536  1733 raft_consensus.cc:359] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.115738  1733 raft_consensus.cc:385] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.116057  1733 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.120625  1734 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.124306  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:13.124548  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:13.125121  1613 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:13.126235  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:13.129218  1734 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.129663  1734 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.130066  1734 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.132537  1733 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.140039  1825 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.140935  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.142550  1733 ts_tablet_manager.cc:1434] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:58:13.142609  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:13.143723  1733 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.143807  1825 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:13.144766  1732 tablet_bootstrap.cc:654] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.146627  1785 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.147135  1785 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.151505  1730 tablet_bootstrap.cc:492] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.152076  1730 ts_tablet_manager.cc:1403] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.020s
I20260709 12:58:13.154722  1730 raft_consensus.cc:359] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.155226  1785 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.155516  1730 raft_consensus.cc:385] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.155938  1730 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.156678  1730 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.156862  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:13.158676  1581 leader_election.cc:343] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.158953  1730 ts_tablet_manager.cc:1434] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:58:13.160104  1730 tablet_bootstrap.cc:492] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
W20260709 12:58:13.160956  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:13.156916  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.163527  1733 tablet_bootstrap.cc:654] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.154850  1734 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.166874  1730 tablet_bootstrap.cc:654] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:13.167171  1582 leader_election.cc:343] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.167668  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.168751  1785 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.168927  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:13.170271  1656 leader_election.cc:343] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.172350  1734 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.173039  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:13.173834  1613 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.176964  1733 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.177487  1730 tablet_bootstrap.cc:492] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.177678  1733 ts_tablet_manager.cc:1403] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.009s
I20260709 12:58:13.178033  1730 ts_tablet_manager.cc:1403] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:58:13.180558  1730 raft_consensus.cc:359] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.180712  1733 raft_consensus.cc:359] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.181522  1733 raft_consensus.cc:385] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.181509  1730 raft_consensus.cc:385] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.181934  1733 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.182026  1730 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.182533  1763 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.182680  1733 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.182776  1730 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.183822  1912 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.184283  1912 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.186264  1912 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.187408  1733 ts_tablet_manager.cc:1434] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:13.188156  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.188385  1733 tablet_bootstrap.cc:492] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.188797  1541 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:13.189713  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:13.190469  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:13.190352  1612 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:13.191306  1734 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.193040  1912 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.193408  1912 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.193769  1912 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.208560  1825 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.209420  1730 ts_tablet_manager.cc:1434] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:58:13.210507  1730 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.212564  1825 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.216351  1912 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.218003  1825 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.219208  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.220688  1690 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:13.222417  1506 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:13.223546  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:13.223834  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:13.224277  1612 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:13.224501  1615 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.225986  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:13.226557  1541 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.232029  1615 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:13.232393  1825 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.232832  1825 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.233213  1825 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.233588  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.234366  1734 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.234776  1734 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:13.235491  1734 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.238214  1862 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.239377  1541 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:13.242847  1733 tablet_bootstrap.cc:654] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.247033  1732 tablet_bootstrap.cc:492] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.247534  1732 ts_tablet_manager.cc:1403] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.135s	user 0.028s	sys 0.020s
I20260709 12:58:13.219792  1613 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:13.250828  1860 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.255398  1912 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.257274  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:13.258111  1912 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.258852  1912 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:13.261798  1825 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.250088  1732 raft_consensus.cc:359] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.266040  1732 raft_consensus.cc:385] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.266460  1732 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.267033  1730 tablet_bootstrap.cc:654] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.267594  1732 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.265232  1912 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.272854  1825 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.272707  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:13.273634  1689 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.272794  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:13.274601  1613 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.273640  1732 ts_tablet_manager.cc:1434] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:58:13.277729  1732 tablet_bootstrap.cc:492] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.281682  1689 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:13.283595  1506 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:13.284621  1825 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.284608  1613 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:13.285166  1825 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:13.286369  1825 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.294705  1732 tablet_bootstrap.cc:654] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.300354  1437 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.303282  1437 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.320963  1730 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.321647  1730 ts_tablet_manager.cc:1403] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.006s
I20260709 12:58:13.324883  1732 tablet_bootstrap.cc:492] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.325341  1732 ts_tablet_manager.cc:1403] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 12:58:13.325954  1612 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:13.326325  1860 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.327327  1734 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.328639  1733 tablet_bootstrap.cc:492] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.329355  1733 ts_tablet_manager.cc:1403] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.006s
I20260709 12:58:13.327862  1732 raft_consensus.cc:359] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.338997  1732 raft_consensus.cc:385] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.339789  1732 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.339444  1733 raft_consensus.cc:359] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.341097  1537 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:13.344828  1734 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.341986  1732 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.346033  1733 raft_consensus.cc:385] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.346338  1733 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.347002  1733 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.345319  1734 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.353842  1732 ts_tablet_manager.cc:1434] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:58:13.357745  1734 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.345500  1912 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:58:13.360289  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:13.362569  1656 leader_election.cc:343] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.363376  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.369870  1732 tablet_bootstrap.cc:492] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.375761  1733 ts_tablet_manager.cc:1434] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 12:58:13.377696  1730 raft_consensus.cc:359] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.381834  1730 raft_consensus.cc:385] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:13.381883  1656 leader_election.cc:343] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.382153  1730 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.382381  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:13.382905  1730 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.383782  1734 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.385506  1733 tablet_bootstrap.cc:492] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.385866  1437 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.388370  1730 ts_tablet_manager.cc:1434] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.066s	user 0.003s	sys 0.004s
I20260709 12:58:13.389303  1730 tablet_bootstrap.cc:492] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.403756  1862 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.404313  1862 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.404989  1808 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.406985  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.407615  1536 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:13.408793  1582 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.410959  1763 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.411089  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.411345  1763 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.411680  1763 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.411712  1689 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:13.413194  1862 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.417904  1730 tablet_bootstrap.cc:654] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.423609  1732 tablet_bootstrap.cc:654] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.426496  1733 tablet_bootstrap.cc:654] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.435595  1763 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.444254  1862 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.444824  1862 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.449816  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.450453  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:13.451124  1541 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.453447  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:13.455823  1581 leader_election.cc:343] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:13.460784  1582 leader_election.cc:343] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.461344  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.462217  1785 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.464833  1763 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.465144  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:13.466754  1919 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.472275  1541 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:13.463903  1862 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.466668  1689 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.476866  1733 tablet_bootstrap.cc:492] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.477897  1733 ts_tablet_manager.cc:1403] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.028s
I20260709 12:58:13.476879  1582 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.478567  1732 tablet_bootstrap.cc:492] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.481294  1732 ts_tablet_manager.cc:1403] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.001s
I20260709 12:58:13.484055  1732 raft_consensus.cc:359] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.484799  1732 raft_consensus.cc:385] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.484902  1862 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.485116  1732 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.485639  1862 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:13.485939  1732 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.489303  1862 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.490098  1730 tablet_bootstrap.cc:492] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.490553  1730 ts_tablet_manager.cc:1403] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.006s
I20260709 12:58:13.489636  1733 raft_consensus.cc:359] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.491932  1733 raft_consensus.cc:385] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.488124  1732 ts_tablet_manager.cc:1434] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:13.492192  1733 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.497399  1732 tablet_bootstrap.cc:492] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.498212  1733 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.500698  1733 ts_tablet_manager.cc:1434] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:58:13.495497  1730 raft_consensus.cc:359] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.495820  1689 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:13.496861  1912 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.501871  1733 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.507453  1785 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.502272  1730 raft_consensus.cc:385] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.511475  1730 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.511265  1785 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.512507  1730 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.526364  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:13.527788  1582 leader_election.cc:343] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.529003  1785 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.532068  1733 tablet_bootstrap.cc:654] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.534757  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.532104  1730 ts_tablet_manager.cc:1434] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
W20260709 12:58:13.536669  1581 leader_election.cc:343] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.537470  1730 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.537385  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.538440  1785 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.540304  1732 tablet_bootstrap.cc:654] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.547241  1733 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.547857  1733 ts_tablet_manager.cc:1403] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.005s
I20260709 12:58:13.551481  1733 raft_consensus.cc:359] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.552268  1733 raft_consensus.cc:385] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.552575  1733 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.553224  1733 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.554181  1732 tablet_bootstrap.cc:492] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.554674  1732 ts_tablet_manager.cc:1403] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.015s
I20260709 12:58:13.554991  1733 ts_tablet_manager.cc:1434] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:13.557289  1785 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.557746  1785 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.558190  1733 tablet_bootstrap.cc:492] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.559760  1785 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.561888  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:13.563366  1581 leader_election.cc:343] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.564570  1733 tablet_bootstrap.cc:654] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.564841  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:13.566291  1582 leader_election.cc:343] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.566723  1582 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.566730  1732 raft_consensus.cc:359] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.567731  1732 raft_consensus.cc:385] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.567816  1785 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.568378  1732 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.569443  1732 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.570597  1825 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.571034  1825 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.572150  1732 ts_tablet_manager.cc:1434] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:58:13.573154  1732 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.575749  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:13.576395  1613 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:13.578589  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.579159  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.579975  1864 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.580333  1864 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.580680  1864 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.579195  1689 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:13.573029  1825 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.588901  1732 tablet_bootstrap.cc:654] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.589764  1864 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.592862  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:13.593597  1613 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.597254  1730 tablet_bootstrap.cc:654] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.601994  1439 catalog_manager.cc:5697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.603159  1732 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.603580  1732 ts_tablet_manager.cc:1403] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.013s
I20260709 12:58:13.605784  1730 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.606210  1730 ts_tablet_manager.cc:1403] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.002s
I20260709 12:58:13.606125  1732 raft_consensus.cc:359] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.606841  1732 raft_consensus.cc:385] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.607110  1732 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.607784  1732 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.609740  1732 ts_tablet_manager.cc:1434] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:58:13.610602  1732 tablet_bootstrap.cc:492] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.613062  1613 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:13.614261  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.615075  1825 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.615512  1825 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:13.616302  1825 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.609517  1730 raft_consensus.cc:359] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.618800  1730 raft_consensus.cc:385] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.619081  1730 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.619792  1730 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.621102  1732 tablet_bootstrap.cc:654] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.626196  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:13.626626  1732 tablet_bootstrap.cc:492] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.626801  1689 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.627079  1732 ts_tablet_manager.cc:1403] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:58:13.627946  1439 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.630189  1732 raft_consensus.cc:359] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.630858  1732 raft_consensus.cc:385] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.631119  1732 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.631858  1732 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.633173  1689 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:13.633975  1732 ts_tablet_manager.cc:1434] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:13.634644  1864 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.634915  1732 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.641674  1733 tablet_bootstrap.cc:492] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.642289  1733 ts_tablet_manager.cc:1403] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.003s
I20260709 12:58:13.645146  1732 tablet_bootstrap.cc:654] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.645335  1733 raft_consensus.cc:359] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.646018  1733 raft_consensus.cc:385] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.646216  1730 ts_tablet_manager.cc:1434] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:58:13.646303  1733 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.647369  1730 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.647261  1733 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.653955  1733 ts_tablet_manager.cc:1434] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:58:13.654943  1733 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.658578  1732 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.658872  1730 tablet_bootstrap.cc:654] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.659430  1859 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.659894  1732 ts_tablet_manager.cc:1403] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 12:58:13.661486  1733 tablet_bootstrap.cc:654] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.662515  1732 raft_consensus.cc:359] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.663175  1732 raft_consensus.cc:385] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.663447  1732 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.664283  1732 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.666446  1732 ts_tablet_manager.cc:1434] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:13.667289  1732 tablet_bootstrap.cc:492] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.680158  1785 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.680747  1785 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.684252  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.685402  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:13.685593  1582 leader_election.cc:343] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:13.686720  1581 leader_election.cc:343] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.687196  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.688437  1862 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.689137  1785 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.690459  1732 tablet_bootstrap.cc:654] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.701674  1734 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.703816  1538 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.704597  1733 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.705111  1733 ts_tablet_manager.cc:1403] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.012s
I20260709 12:58:13.710155  1733 raft_consensus.cc:359] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.713554  1733 raft_consensus.cc:385] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.713795  1734 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.714375  1860 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.713913  1733 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.714831  1860 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.716979  1860 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.715286  1733 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.719550  1733 ts_tablet_manager.cc:1434] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:58:13.719224  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.722630  1536 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:13.722343  1733 tablet_bootstrap.cc:492] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.722971  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:13.725003  1613 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:13.726562  1862 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.727013  1862 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.727769  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.728909  1912 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.729624  1912 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.729790  1862 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.729976  1912 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.731761  1733 tablet_bootstrap.cc:654] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.735944  1825 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:13.741361  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:13.743103  1582 leader_election.cc:343] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.747632  1732 tablet_bootstrap.cc:492] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.751106  1732 ts_tablet_manager.cc:1403] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.008s
I20260709 12:58:13.749279  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:13.753360  1581 leader_election.cc:343] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.753840  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.738991  1912 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.758203  1730 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.758817  1730 ts_tablet_manager.cc:1403] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.029s
I20260709 12:58:13.759912  1862 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.760795  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:13.761296  1538 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.763441  1730 raft_consensus.cc:359] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.764361  1730 raft_consensus.cc:385] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.764685  1730 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.766140  1912 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.766258  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:13.767055  1611 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.775811  1942 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.777985  1611 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:13.781977  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:13.781231  1730 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.783027  1734 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.783459  1734 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:13.784106  1734 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.784747  1730 ts_tablet_manager.cc:1434] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 12:58:13.785915  1730 tablet_bootstrap.cc:492] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.793464  1732 raft_consensus.cc:359] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.794440  1732 raft_consensus.cc:385] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.794778  1732 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.797855  1732 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.799072  1538 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:13.799952  1732 ts_tablet_manager.cc:1434] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 12:58:13.802006  1732 tablet_bootstrap.cc:492] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.817117  1730 tablet_bootstrap.cc:654] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.819810  1732 tablet_bootstrap.cc:654] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.821079  1785 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.821280  1733 tablet_bootstrap.cc:492] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.821758  1733 ts_tablet_manager.cc:1403] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.047s
I20260709 12:58:13.821568  1785 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.824256  1733 raft_consensus.cc:359] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.824918  1733 raft_consensus.cc:385] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.825186  1733 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.828157  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.829754  1919 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:13.830217  1582 leader_election.cc:343] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.830605  1733 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.831405  1437 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.823997  1785 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.833542  1733 ts_tablet_manager.cc:1434] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:13.833418  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.834424  1733 tablet_bootstrap.cc:492] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:13.834122  1690 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:13.835798  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:13.839397  1785 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.839785  1785 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.840118  1785 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.844350  1733 tablet_bootstrap.cc:654] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.850054  1732 tablet_bootstrap.cc:492] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:13.850536  1732 ts_tablet_manager.cc:1403] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:58:13.847427  1785 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.853627  1785 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.856012  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:13.858140  1732 raft_consensus.cc:359] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:13.858639  1582 leader_election.cc:343] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.858875  1732 raft_consensus.cc:385] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.859721  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:13.861626  1730 tablet_bootstrap.cc:492] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:13.863345  1730 ts_tablet_manager.cc:1403] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.007s
I20260709 12:58:13.863231  1690 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.863067  1732 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.865087  1732 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.867199  1732 ts_tablet_manager.cc:1434] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:13.868052  1732 tablet_bootstrap.cc:492] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:13.874066  1690 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:13.875344  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:13.869396  1785 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.870975  1730 raft_consensus.cc:359] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.873016  1733 tablet_bootstrap.cc:492] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.876734  1733 ts_tablet_manager.cc:1403] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 12:58:13.876523  1730 raft_consensus.cc:385] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.876585  1763 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.878831  1763 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:13.879740  1763 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.880877  1730 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.881260  1732 tablet_bootstrap.cc:654] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.881647  1730 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.885033  1730 ts_tablet_manager.cc:1434] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 12:58:13.886096  1730 tablet_bootstrap.cc:492] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:13.886646  1733 raft_consensus.cc:359] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.887306  1733 raft_consensus.cc:385] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.887593  1733 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.878634  1785 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.888376  1733 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.890094  1785 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:13.890936  1733 ts_tablet_manager.cc:1434] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:13.891240  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.891829  1733 tablet_bootstrap.cc:492] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
W20260709 12:58:13.893172  1582 leader_election.cc:343] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.895859  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:13.897768  1733 tablet_bootstrap.cc:654] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:13.898378  1581 leader_election.cc:343] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.887557  1990 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:58:13.908501  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:13.909554  1990 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.907434  1730 tablet_bootstrap.cc:654] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.988386  1734 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.988924  1734 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.990682  1734 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.991366  1734 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.991739  1734 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:13.993558  1734 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:13.998358  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:13.998783  1733 tablet_bootstrap.cc:492] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:13.999076  1537 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:13.999409  1733 ts_tablet_manager.cc:1403] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.013s
I20260709 12:58:14.068608  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:14.069334  1537 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:14.084901  1862 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.086638  1862 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.086923  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.087325  1733 raft_consensus.cc:359] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.087977  1733 raft_consensus.cc:385] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.088287  1733 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.088936  1733 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.090972  1733 ts_tablet_manager.cc:1434] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 12:58:14.087566  1611 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:14.092391  1733 tablet_bootstrap.cc:492] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:14.086028  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:14.100899  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:14.104806  1919 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.105245  1919 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.105624  1919 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:14.113154  1993 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:58:14.107349  1912 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.107219  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.119825  1912 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.134272  1912 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.137440  1732 tablet_bootstrap.cc:492] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:14.138005  1732 ts_tablet_manager.cc:1403] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.270s	user 0.041s	sys 0.083s
I20260709 12:58:14.135931  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:14.155638  1730 tablet_bootstrap.cc:492] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:14.157143  1732 raft_consensus.cc:359] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.162197  1732 raft_consensus.cc:385] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.162472  1732 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.162214  1730 ts_tablet_manager.cc:1403] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.276s	user 0.025s	sys 0.014s
I20260709 12:58:14.163049  1732 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.173552  1732 ts_tablet_manager.cc:1434] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.006s
I20260709 12:58:14.174618  1732 tablet_bootstrap.cc:492] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
W20260709 12:58:14.172432  1582 leader_election.cc:343] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.200243  1862 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.179693  1999 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.220198  1785 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.220780  1785 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.221906  1999 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.228776  1999 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.234786  1732 tablet_bootstrap.cc:654] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.295423  1785 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:14.301949  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 121776us
I20260709 12:58:14.304834  1733 tablet_bootstrap.cc:654] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.283496  1919 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.304901  1996 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.308928  1730 raft_consensus.cc:359] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.311271  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.311493  1730 raft_consensus.cc:385] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.311774  1730 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.313177  1730 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.315812  1730 ts_tablet_manager.cc:1434] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.152s	user 0.006s	sys 0.008s
W20260709 12:58:14.315783  1656 leader_election.cc:343] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.316854  1730 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:14.331354  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.334903  1616 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:14.308823  1996 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.340488  1438 catalog_manager.cc:5697] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.341045  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:14.339983  1506 leader_election.cc:343] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.355595  1763 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.354339  1999 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:58:14.374729  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:14.375334  1540 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.378093  1919 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:14.380616  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:14.381206  1582 leader_election.cc:343] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:14.384274  1656 leader_election.cc:343] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.384085  1999 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.392163  1999 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.395229  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.396281  1996 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:14.398231  1999 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.391918  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:14.398669  1730 tablet_bootstrap.cc:654] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.398919  2001 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.392503  1912 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.400557  1999 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.399395  2001 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.402863  1999 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.414842  1732 tablet_bootstrap.cc:492] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:14.415251  1732 ts_tablet_manager.cc:1403] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.026s
I20260709 12:58:14.409017  1999 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:14.409345  1581 leader_election.cc:343] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.417845  1581 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:14.422432  1912 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:14.422819  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:14.423403  1616 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.422348  1733 tablet_bootstrap.cc:492] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:14.424012  1785 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:14.424331  1733 ts_tablet_manager.cc:1403] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.332s	user 0.014s	sys 0.004s
I20260709 12:58:14.432914  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.430163  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.423743  1825 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:58:14.454139  2001 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.440995  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.443173  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.461619  1614 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:14.445600  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:14.513182  1733 raft_consensus.cc:359] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.514863  1733 raft_consensus.cc:385] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.515400  1733 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.455840  1540 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
W20260709 12:58:14.466709  1581 leader_election.cc:343] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.516067  1733 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.519784  1734 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.520334  1734 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.522635  1541 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.524181  1733 ts_tablet_manager.cc:1434] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.005s
I20260709 12:58:14.525300  1733 tablet_bootstrap.cc:492] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:14.527582  1734 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:14.523950  1688 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:14.524392  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:14.545609  1732 raft_consensus.cc:359] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.546986  1732 raft_consensus.cc:385] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.547226  1732 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.547763  1732 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.519258  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:14.557813  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:14.558486  1535 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.561805  1732 ts_tablet_manager.cc:1434] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.146s	user 0.008s	sys 0.000s
I20260709 12:58:14.564673  1730 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:14.565192  1730 ts_tablet_manager.cc:1403] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.249s	user 0.027s	sys 0.023s
W20260709 12:58:14.554059  1582 leader_election.cc:343] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.567572  1763 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.569787  1730 raft_consensus.cc:359] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.570451  1730 raft_consensus.cc:385] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.570706  1730 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.571297  1730 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.572774  1730 ts_tablet_manager.cc:1434] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:14.573614  1730 tablet_bootstrap.cc:492] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:14.574911  1732 tablet_bootstrap.cc:492] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:14.562826  1862 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:14.582131  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 115458us
I20260709 12:58:14.593752  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.563839  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:14.611235  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:14.612272  1734 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.612712  1734 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.612982  1734 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:14.613322  1656 leader_election.cc:343] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.592139  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.628083  1616 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:14.617838  1919 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:58:14.633071  2002 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.633569  2002 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.636955  1734 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.637794  1733 tablet_bootstrap.cc:654] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.638746  1734 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:14.637179  1999 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.642508  2002 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:14.690573  1535 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
W20260709 12:58:14.692832  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:14.695199  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:14.620615  1613 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:14.706542  1825 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.718604  1825 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.713133  2000 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:14.730525  1732 tablet_bootstrap.cc:654] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.735373  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:58:14.732650  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 43796.7us
W20260709 12:58:14.737986  1581 leader_election.cc:343] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.738629  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:14.740837  1785 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:14.741858  1999 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.750252  1613 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.761029  1730 tablet_bootstrap.cc:654] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.768325  1763 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.762521  1825 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.768962  1763 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.775674  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:14.782804  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:14.784668  1998 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:14.784847  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.785429  1998 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:14.786063  1612 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:14.786818  1998 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.792546  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:14.840454  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:14.841917  1734 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.842295  1734 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.842657  1734 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.845419  1997 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:14.858835  1656 leader_election.cc:343] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:14.860735  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 68084.1us
I20260709 12:58:14.872551  1732 tablet_bootstrap.cc:492] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:14.873399  1732 ts_tablet_manager.cc:1403] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.299s	user 0.012s	sys 0.007s
I20260709 12:58:14.850088  1763 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:14.878394  1730 tablet_bootstrap.cc:492] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:14.879051  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:14.879317  1730 ts_tablet_manager.cc:1403] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.306s	user 0.018s	sys 0.009s
I20260709 12:58:14.879469  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:14.879828  1607 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.880218  1611 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:14.886401  1613 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:14.889910  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:14.892481  2002 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:14.892977  2002 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:14.893930  2002 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.891335  1730 raft_consensus.cc:359] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.896876  1730 raft_consensus.cc:385] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.897501  1730 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
W20260709 12:58:14.896929  1656 leader_election.cc:343] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.889041  1734 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.900209  1730 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.902678  1507 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:14.912173  1734 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:14.912706  1656 leader_election.cc:343] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.915393  2021 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.915577  1730 ts_tablet_manager.cc:1434] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.002s
I20260709 12:58:14.915871  2021 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.916308  2021 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.917176  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:14.920683  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.933233  1730 tablet_bootstrap.cc:492] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:14.939916  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:14.940725  1611 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.943186  2011 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:14.950196  1733 tablet_bootstrap.cc:492] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:14.950054  1732 raft_consensus.cc:359] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.951084  1732 raft_consensus.cc:385] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:14.951149  1581 leader_election.cc:343] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.951468  1732 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.959944  1732 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.962848  1732 ts_tablet_manager.cc:1434] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.001s
I20260709 12:58:14.964139  1732 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:14.964994  1611 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:14.950766  1733 ts_tablet_manager.cc:1403] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.426s	user 0.037s	sys 0.017s
I20260709 12:58:14.967593  1607 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:14.974749  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:14.979238  2024 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:14.979839  2024 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:14.980198  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:14.980865  2024 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.985047  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:14.986171  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:14.986910  1582 leader_election.cc:343] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.987432  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:14.989012  2001 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:14.989882  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:14.994333  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:14.995257  1732 tablet_bootstrap.cc:654] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.995404  1437 catalog_manager.cc:5697] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:14.987008  2021 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.997761  2002 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.997609  1437 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:14.998876  2002 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:14.999361  1919 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.000119  2021 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.001925  1919 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.002398  1919 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.001904  1998 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.003157  2002 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.003547  1998 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:15.004678  1998 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.008450  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:15.012023  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.012894  1616 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:15.013640  1912 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.014146  1912 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:15.014807  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.015065  1912 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:15.013676  1506 leader_election.cc:343] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:15.018988  1506 leader_election.cc:343] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.022096  1919 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.026894  1919 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.001951  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:15.029960  1732 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.035621  1730 tablet_bootstrap.cc:654] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.036208  1732 ts_tablet_manager.cc:1403] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.008s
I20260709 12:58:15.033577  1607 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:15.040896  1656 leader_election.cc:343] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:15.042204  1656 leader_election.cc:343] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.044817  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:15.056130  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:15.059119  1506 leader_election.cc:343] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.057747  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:15.061342  1611 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.062310  1732 raft_consensus.cc:359] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.063020  1732 raft_consensus.cc:385] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.063289  1732 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.063926  1732 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.066032  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:15.068459  2004 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.068838  2004 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.068964  1732 ts_tablet_manager.cc:1434] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:58:15.069193  2004 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:15.070597  1656 leader_election.cc:343] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.078131  1611 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:15.086462  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:15.083964  1607 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:15.094849  1507 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.095928  2000 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.101162  1732 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.096277  1912 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.099689  2000 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:15.106946  1730 tablet_bootstrap.cc:492] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.108806  1438 catalog_manager.cc:5697] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.112988  1730 ts_tablet_manager.cc:1403] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.007s
I20260709 12:58:15.113561  1912 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:15.113896  2000 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.114416  1912 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.115078  1733 raft_consensus.cc:359] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.115795  1733 raft_consensus.cc:385] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.116081  1733 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.117699  1733 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.121675  2004 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.125878  1862 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.127844  1862 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.128695  1733 ts_tablet_manager.cc:1434] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.000s
I20260709 12:58:15.130040  1733 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.128342  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:15.132434  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.132615  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:15.133863  1582 leader_election.cc:343] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:15.134575  1581 leader_election.cc:343] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:15.134934  1656 leader_election.cc:343] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.135249  1581 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.136428  1763 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.138880  1862 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.142239  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:15.142894  1607 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.141494  2004 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.150671  1730 raft_consensus.cc:359] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.151437  1730 raft_consensus.cc:385] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.151728  1730 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.152901  1730 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.155953  1730 ts_tablet_manager.cc:1434] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.003s
I20260709 12:58:15.160349  1607 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:15.161559  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:15.162760  2002 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.162956  1730 tablet_bootstrap.cc:492] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.163316  2002 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:15.164212  2002 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.168800  1733 tablet_bootstrap.cc:654] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.171496  1732 tablet_bootstrap.cc:654] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.189950  1730 tablet_bootstrap.cc:654] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.209918  1732 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.210649  1732 ts_tablet_manager.cc:1403] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.112s	user 0.006s	sys 0.019s
I20260709 12:58:15.214325  1732 raft_consensus.cc:359] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.215529  1732 raft_consensus.cc:385] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.215993  1732 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.217044  1732 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.219365  1732 ts_tablet_manager.cc:1434] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:15.219420  1733 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.220489  1732 tablet_bootstrap.cc:492] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.220579  1733 ts_tablet_manager.cc:1403] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.008s
I20260709 12:58:15.223274  1733 raft_consensus.cc:359] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.223914  1733 raft_consensus.cc:385] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.224171  1733 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.224902  1733 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.227356  1732 tablet_bootstrap.cc:654] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.227777  1733 ts_tablet_manager.cc:1434] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:15.226724  1437 catalog_manager.cc:5697] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.228905  1733 tablet_bootstrap.cc:492] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.229043  1437 catalog_manager.cc:5697] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.231034  1437 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.233134  1437 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.235129  1733 tablet_bootstrap.cc:654] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.238215  1730 tablet_bootstrap.cc:492] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.239396  1730 ts_tablet_manager.cc:1403] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.004s
I20260709 12:58:15.243183  1730 raft_consensus.cc:359] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.244025  1730 raft_consensus.cc:385] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.244340  1730 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.245030  1730 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.246390  1733 tablet_bootstrap.cc:492] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.246833  1733 ts_tablet_manager.cc:1403] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 12:58:15.247377  1730 ts_tablet_manager.cc:1434] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:58:15.248759  1730 tablet_bootstrap.cc:492] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.251199  1733 raft_consensus.cc:359] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.251840  1733 raft_consensus.cc:385] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.252105  1733 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.252724  1733 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.255151  2000 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.255577  2000 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.257690  2000 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.259052  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.259671  1687 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:15.260087  1733 ts_tablet_manager.cc:1434] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:58:15.260622  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.261188  1733 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.261274  1607 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:15.262491  1507 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:15.262761  1732 tablet_bootstrap.cc:492] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.263239  2000 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.263595  2000 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.263938  2000 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.264850  1732 ts_tablet_manager.cc:1403] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.045s	user 0.030s	sys 0.011s
I20260709 12:58:15.267886  1732 raft_consensus.cc:359] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.268532  1732 raft_consensus.cc:385] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.268798  1732 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.269352  1733 tablet_bootstrap.cc:654] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.269538  1732 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.270907  2000 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.271677  1732 ts_tablet_manager.cc:1434] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:15.275197  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:15.275774  1687 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.275712  1438 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.281289  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:15.281857  1607 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.282955  1687 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:15.289722  2000 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.291074  1732 tablet_bootstrap.cc:492] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
W20260709 12:58:15.291308  1656 consensus_peers.cc:597] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:15.293093  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:15.293550  1862 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.293910  2000 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.293991  1862 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.294433  2000 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:15.295222  2000 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.298190  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.296092  1862 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:15.300494  1582 leader_election.cc:343] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.305697  1732 tablet_bootstrap.cc:654] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.310087  1733 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.309968  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.310678  1733 ts_tablet_manager.cc:1403] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.015s
I20260709 12:58:15.315558  1607 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
W20260709 12:58:15.316926  1581 leader_election.cc:343] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.318276  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.316826  1733 raft_consensus.cc:359] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.258312  1730 tablet_bootstrap.cc:654] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.319423  1862 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.319432  1733 raft_consensus.cc:385] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.321610  2004 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:15.330724  2002 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:15.320160  1733 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.336747  1733 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.338909  1733 ts_tablet_manager.cc:1434] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:58:15.339911  1733 tablet_bootstrap.cc:492] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.339785  2002 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.338716  1437 catalog_manager.cc:5697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.353605  1733 tablet_bootstrap.cc:654] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.362098  1732 tablet_bootstrap.cc:492] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.362545  1732 ts_tablet_manager.cc:1403] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.025s
I20260709 12:58:15.362710  1730 tablet_bootstrap.cc:492] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.363145  1730 ts_tablet_manager.cc:1403] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.002s
I20260709 12:58:15.365690  1732 raft_consensus.cc:359] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.366361  1732 raft_consensus.cc:385] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.366616  1732 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.366595  1730 raft_consensus.cc:359] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.367349  1730 raft_consensus.cc:385] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.367663  1730 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.367425  1732 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.368410  1730 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.369647  1732 ts_tablet_manager.cc:1434] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:58:15.370555  1730 ts_tablet_manager.cc:1434] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:15.370635  1732 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.371512  1730 tablet_bootstrap.cc:492] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.377007  1732 tablet_bootstrap.cc:654] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.392419  2000 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:15.396384  1730 tablet_bootstrap.cc:654] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.409950  1733 tablet_bootstrap.cc:492] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.410398  1733 ts_tablet_manager.cc:1403] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:58:15.410442  1730 tablet_bootstrap.cc:492] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.410946  1730 ts_tablet_manager.cc:1403] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.004s
I20260709 12:58:15.412068  1862 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.412544  1862 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.413082  1733 raft_consensus.cc:359] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.413755  1733 raft_consensus.cc:385] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.414007  1733 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.413975  1730 raft_consensus.cc:359] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.414762  1730 raft_consensus.cc:385] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.415076  1730 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.414825  1733 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.415699  1730 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.417670  1733 ts_tablet_manager.cc:1434] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:15.418713  1733 tablet_bootstrap.cc:492] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.418758  1730 ts_tablet_manager.cc:1434] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:15.419854  1730 tablet_bootstrap.cc:492] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.422578  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.423247  1690 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:15.424533  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.429369  1537 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:15.425617  2000 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.428795  1733 tablet_bootstrap.cc:654] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.428736  1687 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.433122  2000 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.435130  1785 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.435534  1540 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.435540  1785 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.437399  1785 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.439158  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.425307  1862 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.431943  1541 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.435156  2000 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:15.442636  1582 leader_election.cc:343] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.446861  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.447629  1614 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:15.456557  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.457273  1732 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.457687  1732 ts_tablet_manager.cc:1403] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.019s
I20260709 12:58:15.461513  1732 raft_consensus.cc:359] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.462404  1732 raft_consensus.cc:385] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.462618  1730 tablet_bootstrap.cc:654] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.462749  1732 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.463766  1732 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.466596  1732 ts_tablet_manager.cc:1434] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:15.456636  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:15.470602  1581 leader_election.cc:343] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.471092  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.471546  1732 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.471882  1785 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.472280  1785 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.472568  1785 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.476893  1862 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.477492  1862 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.477893  1862 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.478982  1785 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.480100  1732 tablet_bootstrap.cc:654] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.480655  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:15.482501  1582 leader_election.cc:343] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.483436  1862 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.484757  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:15.486384  1581 leader_election.cc:343] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.486840  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.487591  1763 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.494045  2000 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.494529  1732 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.495187  1732 ts_tablet_manager.cc:1403] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 12:58:15.497511  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.498092  1912 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.500449  2000 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.500976  2000 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.503970  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.504817  1614 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:15.504396  1732 raft_consensus.cc:359] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.506594  1732 raft_consensus.cc:385] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.506966  1730 tablet_bootstrap.cc:492] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.507194  1732 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.507447  1730 ts_tablet_manager.cc:1403] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.088s	user 0.004s	sys 0.007s
I20260709 12:58:15.508075  1732 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.512065  1732 ts_tablet_manager.cc:1434] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:58:15.514097  1732 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.518483  1785 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.519680  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:15.520486  1687 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.523185  1732 tablet_bootstrap.cc:654] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.523720  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:15.524828  2021 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.510166  1730 raft_consensus.cc:359] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.526631  1730 raft_consensus.cc:385] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.526925  1730 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.527544  1730 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.527774  1687 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:15.529460  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:15.530956  1862 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.531618  1730 ts_tablet_manager.cc:1434] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:58:15.532601  1730 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.532785  1862 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:15.534004  1862 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.543798  2021 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:15.545812  1730 tablet_bootstrap.cc:654] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.548782  2000 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.551885  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:15.552496  1540 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.556636  1732 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.557296  1732 ts_tablet_manager.cc:1403] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.025s
I20260709 12:58:15.561674  1540 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:15.566929  1733 tablet_bootstrap.cc:492] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.567448  1733 ts_tablet_manager.cc:1403] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.149s	user 0.041s	sys 0.050s
I20260709 12:58:15.567236  1732 raft_consensus.cc:359] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.567723  1730 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.567898  1732 raft_consensus.cc:385] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.568173  1730 ts_tablet_manager.cc:1403] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:58:15.568284  1732 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.568991  1732 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.570422  1733 raft_consensus.cc:359] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.571120  1733 raft_consensus.cc:385] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.570708  1730 raft_consensus.cc:359] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.571460  1733 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.571537  1730 raft_consensus.cc:385] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.571918  1730 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.572309  1732 ts_tablet_manager.cc:1434] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:58:15.572142  1733 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.572719  1730 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.573266  1732 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.574697  1733 ts_tablet_manager.cc:1434] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:58:15.575659  1733 tablet_bootstrap.cc:492] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.579739  1732 tablet_bootstrap.cc:654] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.582376  1733 tablet_bootstrap.cc:654] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.585059  1862 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.585528  1862 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.588261  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.587702  1436 catalog_manager.cc:5697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:15.589471  1582 leader_election.cc:343] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.593654  1730 ts_tablet_manager.cc:1434] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:58:15.594592  1730 tablet_bootstrap.cc:492] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.602259  1732 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.602926  1732 ts_tablet_manager.cc:1403] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.001s
I20260709 12:58:15.611812  1732 raft_consensus.cc:359] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.612744  1732 raft_consensus.cc:385] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.613104  1732 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.613932  1732 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.617012  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:15.618263  1581 leader_election.cc:343] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.618703  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.620323  1763 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.623165  1862 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.627388  1730 tablet_bootstrap.cc:654] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.636296  1732 ts_tablet_manager.cc:1434] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:58:15.636508  1537 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.638362  1730 tablet_bootstrap.cc:492] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.639322  1730 ts_tablet_manager.cc:1403] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.008s
I20260709 12:58:15.641710  1997 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.645394  1730 raft_consensus.cc:359] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.645991  1730 raft_consensus.cc:385] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.646212  1730 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.646765  1730 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.648738  1730 ts_tablet_manager.cc:1434] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:58:15.651484  1732 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.652985  1730 tablet_bootstrap.cc:492] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.662451  1862 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.663132  1862 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.664095  1732 tablet_bootstrap.cc:654] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.666610  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.667819  1730 tablet_bootstrap.cc:654] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:15.668514  1582 leader_election.cc:343] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.671144  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:15.672806  1581 leader_election.cc:343] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.673365  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.674366  1785 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.675292  1862 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.682144  1730 tablet_bootstrap.cc:492] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.682585  1730 ts_tablet_manager.cc:1403] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.005s
I20260709 12:58:15.689491  1730 raft_consensus.cc:359] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.690164  1730 raft_consensus.cc:385] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.690397  1730 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.690999  1730 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.694479  1733 tablet_bootstrap.cc:492] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.694947  1733 ts_tablet_manager.cc:1403] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.120s	user 0.053s	sys 0.059s
I20260709 12:58:15.695009  1730 ts_tablet_manager.cc:1434] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 12:58:15.695989  1730 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.697597  1733 raft_consensus.cc:359] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.698242  1733 raft_consensus.cc:385] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.698521  1733 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.699133  1733 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.701550  1733 ts_tablet_manager.cc:1434] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:58:15.701562  1730 tablet_bootstrap.cc:654] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.701584  1997 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:15.703703  1733 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:15.704751  2003 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.706530  2003 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.713862  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.716125  1687 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.726804  1732 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.727273  1732 ts_tablet_manager.cc:1403] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.011s
I20260709 12:58:15.727367  1733 tablet_bootstrap.cc:654] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.730415  1732 raft_consensus.cc:359] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.731134  1732 raft_consensus.cc:385] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.731436  1732 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.732074  1732 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.733538  1732 ts_tablet_manager.cc:1434] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:15.734290  1732 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.741400  1730 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.742807  1730 ts_tablet_manager.cc:1403] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.003s
I20260709 12:58:15.749730  2021 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.767921  1912 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.769325  2003 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.769796  2003 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.771675  2003 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.772838  1506 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:15.773623  2021 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.785437  1862 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.785923  1862 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.789204  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:15.790262  1862 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.791224  1730 raft_consensus.cc:359] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.792083  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.793910  1582 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:15.795493  1862 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.796236  1730 raft_consensus.cc:385] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.796527  1730 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.797290  1730 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.799005  1730 ts_tablet_manager.cc:1434] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:58:15.799896  1730 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:15.816507  2004 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.816989  2004 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.814391  2002 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.818873  2004 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.819015  2002 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.820921  2002 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.826375  1733 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:15.827029  1733 ts_tablet_manager.cc:1403] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.029s
I20260709 12:58:15.836627  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.837780  1610 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.840777  1541 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:15.842391  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:15.843044  1730 tablet_bootstrap.cc:654] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.840953  2021 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:15.846458  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.846787  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:15.847008  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.847400  1614 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:15.847625  1732 tablet_bootstrap.cc:654] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.847118  1608 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:15.856021  1912 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.863951  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:15.872956  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.873649  1541 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:15.874082  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.881145  2003 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.881551  2003 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.882110  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:15.881891  2003 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.892377  1996 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.892741  1996 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.893122  1996 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.901203  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:15.927469  1730 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:15.927969  1730 ts_tablet_manager.cc:1403] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.128s	user 0.006s	sys 0.007s
I20260709 12:58:15.931959  1732 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:15.932395  1732 ts_tablet_manager.cc:1403] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.198s	user 0.007s	sys 0.019s
I20260709 12:58:15.932510  1997 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:15.930640  1656 leader_election.cc:343] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.934894  1732 raft_consensus.cc:359] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.935554  1732 raft_consensus.cc:385] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.935794  1732 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.936398  1732 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.936088  1730 raft_consensus.cc:359] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.938265  1730 raft_consensus.cc:385] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.938663  1730 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.947654  1730 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.928994  1862 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.953538  1732 ts_tablet_manager.cc:1434] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:58:15.966009  1732 tablet_bootstrap.cc:492] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:15.973093  2003 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.957041  1862 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.980343  2003 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.981576  1862 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:15.983274  1733 raft_consensus.cc:359] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.984144  1733 raft_consensus.cc:385] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.984498  1733 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.988200  1996 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.991070  1996 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:15.991672  1996 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.992159  1996 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.985278  1733 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:15.994670  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:15.996310  1581 leader_election.cc:343] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.999099  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:15.999984  1785 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:16.013007  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 77142.4us
I20260709 12:58:16.021032  1733 ts_tablet_manager.cc:1434] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.193s	user 0.006s	sys 0.001s
I20260709 12:58:15.994168  1996 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.050635  1785 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.051162  1785 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.055892  1785 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:16.066609  2002 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:16.097309  1582 leader_election.cc:343] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.097954  1582 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:16.098839  1785 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.129222  1730 ts_tablet_manager.cc:1434] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.201s	user 0.028s	sys 0.018s
W20260709 12:58:16.149008  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 134551us
W20260709 12:58:16.128088  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 104708us
I20260709 12:58:16.161276  1730 tablet_bootstrap.cc:492] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
W20260709 12:58:16.217322  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55086.5us
I20260709 12:58:16.224179  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:16.224961  1607 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.388376  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:16.397943  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:16.398763  1613 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.402755  2105 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.301096  2000 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.104s
I20260709 12:58:16.407842  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.391059  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.226477  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.300273  2092 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.232695  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:16.229457  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:16.437538  1763 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.438748  1763 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.424718  2093 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.440683  1539 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.436053  1610 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:16.451468  1763 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:16.432528  2105 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:16.475062  1582 leader_election.cc:343] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.435781  2092 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.478423  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.444167  2093 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.493969  1733 tablet_bootstrap.cc:492] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:16.496274  1730 tablet_bootstrap.cc:654] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.485340  2105 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:16.499356  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48001.6us
W20260709 12:58:16.501355  1656 leader_election.cc:343] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:16.502054  1656 leader_election.cc:343] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.503535  1539 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:16.506603  2093 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.510110  2092 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.511948  1607 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:16.512879  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:16.519405  2090 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.521046  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.521651  1611 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:16.519806  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.522795  1612 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:16.524580  1613 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
W20260709 12:58:16.525938  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50281.2us
W20260709 12:58:16.527223  1582 leader_election.cc:343] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.531754  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.532567  1541 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:16.519793  2090 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.549149  1732 tablet_bootstrap.cc:654] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.552003  1733 tablet_bootstrap.cc:654] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.550184  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.559105  1609 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:16.553543  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:16.560302  1686 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:16.550707  2090 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.564396  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:58:16.572278  1581 leader_election.cc:343] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.572765  1581 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:16.573760  1763 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.575223  1997 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.575728  1997 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:16.576537  1997 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.580293  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.584100  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.593297  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.595005  2099 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.595609  2099 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.595918  2099 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.591943  2002 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.599004  2004 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.600355  2002 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.605600  2004 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:16.604822  1507 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.619566  2100 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.613722  2002 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.618269  2105 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.613044  2004 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.620038  2100 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.632297  2100 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.626155  2105 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.635670  2105 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.639811  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.662698  1730 tablet_bootstrap.cc:492] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:16.664968  1730 ts_tablet_manager.cc:1403] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.508s	user 0.022s	sys 0.005s
W20260709 12:58:16.696434  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65121us
I20260709 12:58:16.712247  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:16.729780  1732 tablet_bootstrap.cc:492] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:16.730224  1732 ts_tablet_manager.cc:1403] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.766s	user 0.035s	sys 0.028s
I20260709 12:58:16.727160  2105 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.727115  2099 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.737773  1862 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:16.742096  2105 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:16.742472  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:16.743088  1733 tablet_bootstrap.cc:492] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:16.743038  1616 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.743281  2002 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.743731  1733 ts_tablet_manager.cc:1403] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.250s	user 0.016s	sys 0.005s
W20260709 12:58:16.745522  1581 leader_election.cc:343] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.746012  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:16.731422  2090 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.752997  1616 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:16.753741  2090 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.753877  2002 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.754236  1862 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.754065  1732 raft_consensus.cc:359] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.758044  1732 raft_consensus.cc:385] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.758376  1732 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.758556  1733 raft_consensus.cc:359] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.759049  1732 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:16.760978  1656 leader_election.cc:343] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.761545  1732 ts_tablet_manager.cc:1434] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:58:16.761700  1730 raft_consensus.cc:359] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.762377  1730 raft_consensus.cc:385] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.760370  2099 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.762689  1730 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.763433  1732 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:16.763312  1730 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.764205  1733 raft_consensus.cc:385] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.764532  1733 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.764863  1730 ts_tablet_manager.cc:1434] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.001s
I20260709 12:58:16.765796  1730 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:16.766068  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.767551  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.768173  1616 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:16.754076  1507 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.768666  1733 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.771617  2000 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.772075  2000 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:16.772907  2000 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.779938  1732 tablet_bootstrap.cc:654] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.783450  1730 tablet_bootstrap.cc:654] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.789932  1733 ts_tablet_manager.cc:1434] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 12:58:16.791235  1733 tablet_bootstrap.cc:492] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:16.847461  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:16.848513  1541 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.858078  1732 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:16.858529  1730 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:16.858668  1732 ts_tablet_manager.cc:1403] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.053s
I20260709 12:58:16.859017  1730 ts_tablet_manager.cc:1403] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.020s
I20260709 12:58:16.859930  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:16.860152  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:16.860814  1609 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.861543  1730 raft_consensus.cc:359] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.862612  1733 tablet_bootstrap.cc:654] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.862572  1730 raft_consensus.cc:385] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.861917  1732 raft_consensus.cc:359] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.863042  1730 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.863379  1732 raft_consensus.cc:385] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.863716  1732 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.863893  1730 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.864528  1732 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.866700  1730 ts_tablet_manager.cc:1434] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:16.866899  1732 ts_tablet_manager.cc:1434] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:58:16.868013  1730 tablet_bootstrap.cc:492] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:16.868016  1732 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:16.868930  1609 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:16.871671  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:16.871953  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:16.872215  1616 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.874154  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:16.874615  1541 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:16.874861  1608 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:16.875203  1730 tablet_bootstrap.cc:654] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.878301  1616 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:16.882459  1436 catalog_manager.cc:5697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:16.883528  1732 tablet_bootstrap.cc:654] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.884636  1436 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:16.885941  1730 tablet_bootstrap.cc:492] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:16.886178  1733 tablet_bootstrap.cc:492] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:16.886372  1730 ts_tablet_manager.cc:1403] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 12:58:16.886560  1733 ts_tablet_manager.cc:1403] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.004s
I20260709 12:58:16.888868  1733 raft_consensus.cc:359] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.889354  1733 raft_consensus.cc:385] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.889593  1733 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.890164  1733 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.892069  1733 ts_tablet_manager.cc:1434] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:58:16.892902  1733 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:16.894799  1732 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:16.895241  1732 ts_tablet_manager.cc:1403] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.002s
I20260709 12:58:16.896708  1730 raft_consensus.cc:359] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.897398  1730 raft_consensus.cc:385] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.897668  1730 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.898262  1730 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.899227  1733 tablet_bootstrap.cc:654] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.898924  1732 raft_consensus.cc:359] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.900029  1732 raft_consensus.cc:385] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.900207  1730 ts_tablet_manager.cc:1434] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:58:16.900339  1732 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.901348  1730 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:16.901585  1732 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.903918  1732 ts_tablet_manager.cc:1434] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:16.904973  1732 tablet_bootstrap.cc:492] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:16.908640  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.913846  1912 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.914286  1912 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.916082  1912 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.912382  2099 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.916620  2099 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.912729  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.916950  2099 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.917884  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.921737  2115 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.924480  2115 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:16.926898  2118 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.927287  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.928375  1612 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:16.929399  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.934887  2118 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:16.940753  2118 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:16.944432  1656 leader_election.cc:343] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.925295  2115 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.947062  2113 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.947557  2113 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:16.951268  1656 leader_election.cc:343] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.952548  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:16.954334  1686 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:16.957404  2113 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:16.956765  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:16.958385  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:16.960740  2093 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:58:16.963218  1582 leader_election.cc:343] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:16.963135  1656 leader_election.cc:343] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.965615  2000 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.967568  2099 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.968312  2000 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:16.969739  2099 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:16.970343  2000 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:16.985107  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:16.985827  1609 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:16.986953  1507 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:16.988153  1825 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.988533  1825 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.988855  1825 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.993232  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:16.996217  1581 leader_election.cc:343] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.996644  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:16.998035  1862 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.998338  1733 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:16.998764  1733 ts_tablet_manager.cc:1403] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.025s
I20260709 12:58:16.998835  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:16.999471  1688 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:17.006407  1733 raft_consensus.cc:359] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.007117  1733 raft_consensus.cc:385] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.007383  1733 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.007953  1733 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.010025  1732 tablet_bootstrap.cc:654] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.010023  1733 ts_tablet_manager.cc:1434] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:17.012032  1825 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.012666  1730 tablet_bootstrap.cc:654] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.014530  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.015266  2093 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.015627  2093 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.015702  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.016010  2093 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.016301  1609 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.018280  1733 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.024693  2093 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.026185  1438 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.027285  1825 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.023224  1609 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:17.027925  2093 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.028606  1507 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.029163  1733 tablet_bootstrap.cc:654] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.029336  1825 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.031818  1825 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:17.034561  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.034821  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:17.035320  1609 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.035517  1537 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.032642  1825 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.042353  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.070788  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:17.072536  1685 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.076743  1609 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:17.075556  1537 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:17.083199  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.083992  1912 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.084496  1912 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:58:17.085484  1656 consensus_peers.cc:597] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:17.071467  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:17.076159  1608 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.092053  1912 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.093948  1730 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.096318  1730 ts_tablet_manager.cc:1403] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.195s	user 0.005s	sys 0.007s
W20260709 12:58:17.095507  1656 leader_election.cc:343] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.084585  1685 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
W20260709 12:58:17.099005  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:17.106484  1730 raft_consensus.cc:359] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.107352  1730 raft_consensus.cc:385] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.107673  1730 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.109884  1730 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.114465  1730 ts_tablet_manager.cc:1434] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:58:17.124174  2093 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.124289  1997 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.124855  2093 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.126798  2093 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.130659  1437 catalog_manager.cc:5697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.137429  1732 tablet_bootstrap.cc:492] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:17.138028  1732 ts_tablet_manager.cc:1403] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.233s	user 0.008s	sys 0.011s
I20260709 12:58:17.136468  1437 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.142764  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.136837  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:17.145153  1656 leader_election.cc:343] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.146368  1730 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:17.144683  1609 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:17.147397  1608 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:17.148305  1732 raft_consensus.cc:359] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.148980  1732 raft_consensus.cc:385] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.149251  1732 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.149466  1733 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.149991  1733 ts_tablet_manager.cc:1403] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.002s
I20260709 12:58:17.149879  1732 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.160403  1732 ts_tablet_manager.cc:1434] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 12:58:17.162070  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.163646  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.165005  1732 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Bootstrap starting.
I20260709 12:58:17.167061  2115 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.170122  2115 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:17.170925  2115 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.166379  2093 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.172807  2093 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.173138  2093 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.197456  2118 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.198602  2093 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.185007  1733 raft_consensus.cc:359] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.201723  1733 raft_consensus.cc:385] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.202004  1733 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.202613  1733 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.205981  1733 ts_tablet_manager.cc:1434] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:58:17.208889  1733 tablet_bootstrap.cc:492] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.208994  1862 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.209501  1862 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.201050  2115 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.216861  1862 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.218408  2093 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.218544  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:17.220558  1581 leader_election.cc:343] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.221160  1730 tablet_bootstrap.cc:654] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.223666  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:17.225024  1582 leader_election.cc:343] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.225418  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:17.225848  1732 tablet_bootstrap.cc:654] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.226563  2011 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.228296  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:17.231417  1656 leader_election.cc:343] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.237517  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.234287  1437 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.238155  1609 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.243244  1732 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: No bootstrap required, opened a new log
I20260709 12:58:17.243813  1732 ts_tablet_manager.cc:1403] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.010s
I20260709 12:58:17.246411  1732 raft_consensus.cc:359] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.250166  1732 raft_consensus.cc:385] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.250864  1732 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.249223  2021 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.252015  1732 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.256186  1732 ts_tablet_manager.cc:1434] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:58:17.257699  1438 catalog_manager.cc:5697] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.260121  1438 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:17.255812  1642 tablet.cc:2406] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:17.267828  2021 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.280702  1609 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:17.282253  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.285584  2118 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.291324  2011 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.298049  2118 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:17.301002  2011 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.301223  2118 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.303067  2011 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.307376  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:17.311520  1582 leader_election.cc:343] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.316776  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.319849  1730 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.320379  1730 ts_tablet_manager.cc:1403] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.038s
I20260709 12:58:17.324954  1730 raft_consensus.cc:359] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.325919  1730 raft_consensus.cc:385] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:17.327968  1581 leader_election.cc:343] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.327986  1730 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.328539  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:17.329224  2113 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.330288  1730 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.336388  1733 tablet_bootstrap.cc:654] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.339577  1730 ts_tablet_manager.cc:1434] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:58:17.342355  1730 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:17.352959  1730 tablet_bootstrap.cc:654] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.353044  1437 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.354768  1912 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.355221  1912 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.358976  1733 tablet_bootstrap.cc:492] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.359511  1733 ts_tablet_manager.cc:1403] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.002s
I20260709 12:58:17.367614  1825 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.368130  1825 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.373858  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.374466  1616 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:17.376372  2152 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.376910  2152 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.377489  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.378525  2021 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.378875  2021 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.379204  2021 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.380107  2152 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.384320  1825 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.385468  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.385684  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.386123  1685 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:17.387051  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.387884  1733 raft_consensus.cc:359] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.388599  1733 raft_consensus.cc:385] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.388656  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.388195  2115 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.388929  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.388932  1733 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.389433  2115 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:17.389853  1582 leader_election.cc:343] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.390244  1733 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.391395  2115 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.391752  1733 ts_tablet_manager.cc:1434] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:58:17.392313  1686 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:17.392648  1733 tablet_bootstrap.cc:492] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.392724  1912 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.394299  2151 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.394665  2151 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.394960  2151 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:17.397738  1656 leader_election.cc:343] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.402619  2021 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.405167  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.405716  1608 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.405478  2093 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.398775  1733 tablet_bootstrap.cc:654] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.399612  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.400543  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.402243  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.411885  1535 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:17.412827  1608 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:17.416049  1656 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:17.416464  2151 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.417248  2093 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.417577  1609 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:17.424563  2151 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.425953  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:17.426573  1686 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.426919  2021 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.427021  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:17.428153  1582 leader_election.cc:343] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.428113  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.428920  2021 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.430310  2021 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:17.431082  2021 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.416116  1733 tablet_bootstrap.cc:492] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.432585  1733 ts_tablet_manager.cc:1403] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 12:58:17.435766  1733 raft_consensus.cc:359] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.436479  1733 raft_consensus.cc:385] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.436726  1733 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.437335  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:17.438719  1686 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:17.445518  2118 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.447228  1730 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.447739  1730 ts_tablet_manager.cc:1403] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.013s
I20260709 12:58:17.448112  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.449903  2113 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.450510  2113 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:17.451433  2113 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.452319  1730 raft_consensus.cc:359] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.454026  1730 raft_consensus.cc:385] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.454074  2024 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.454399  1730 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.454619  2024 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.455219  1730 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.456655  2024 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.458127  1730 ts_tablet_manager.cc:1434] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:58:17.459412  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.459734  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.460080  1608 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:17.461231  1507 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.461777  1730 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:17.462095  2106 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.462479  2106 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.462815  2106 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.464668  2118 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:17.466380  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:17.467589  2093 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.468386  1730 tablet_bootstrap.cc:654] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.437363  1733 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.468441  2152 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.468976  2152 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.470291  2106 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.472289  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.472796  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.473344  1616 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:17.473991  1582 leader_election.cc:343] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.476501  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.477268  1684 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:17.478696  1581 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.479631  2151 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.479835  2152 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.480007  2151 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.480535  2151 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.482821  1616 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:17.485009  1507 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.486016  1825 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.486487  1825 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:17.486683  1733 ts_tablet_manager.cc:1434] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:58:17.487330  1825 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.493628  2118 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.487221  2151 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:17.499177  1506 leader_election.cc:343] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.459419  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:17.511845  2106 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.514209  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:17.515767  1582 leader_election.cc:343] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.519199  2151 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.519923  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:17.520779  1684 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.529429  1686 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:17.534121  1733 tablet_bootstrap.cc:492] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.534346  1684 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:17.535588  1581 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.536823  1437 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.544855  1733 tablet_bootstrap.cc:654] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.548609  2151 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.549592  2151 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:17.550432  2151 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.549846  1436 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.551076  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:17.559926  1730 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.570876  1730 ts_tablet_manager.cc:1403] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.109s	user 0.026s	sys 0.043s
I20260709 12:58:17.573850  1730 raft_consensus.cc:359] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.574637  1730 raft_consensus.cc:385] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.575089  1730 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.576031  1730 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.584509  1730 ts_tablet_manager.cc:1434] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:58:17.585520  1730 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:17.588323  2110 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.591331  1730 tablet_bootstrap.cc:654] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:17.595032  1506 leader_election.cc:343] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.605227  1438 catalog_manager.cc:5697] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.627079  1733 tablet_bootstrap.cc:492] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.628572  1733 ts_tablet_manager.cc:1403] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.117s	user 0.040s	sys 0.043s
I20260709 12:58:17.631177  1733 raft_consensus.cc:359] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.631887  1733 raft_consensus.cc:385] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.632153  1733 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.637086  1733 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.639241  1733 ts_tablet_manager.cc:1434] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:58:17.640179  1733 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.646371  1733 tablet_bootstrap.cc:654] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.694525  1436 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.696264  1730 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.696790  1730 ts_tablet_manager.cc:1403] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.111s	user 0.034s	sys 0.046s
I20260709 12:58:17.700449  2110 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.700363  1730 raft_consensus.cc:359] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.701197  1730 raft_consensus.cc:385] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.701520  1730 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.702296  1730 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.704640  1730 ts_tablet_manager.cc:1434] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:17.705610  1730 tablet_bootstrap.cc:492] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:17.709192  1733 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.709659  1733 ts_tablet_manager.cc:1403] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.070s	user 0.041s	sys 0.024s
I20260709 12:58:17.712193  1733 raft_consensus.cc:359] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.712890  1733 raft_consensus.cc:385] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.713150  1733 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.713743  1733 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.714504  1730 tablet_bootstrap.cc:654] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.715896  1733 ts_tablet_manager.cc:1434] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:58:17.716944  1733 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.717706  2021 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.715821  2118 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.720718  2118 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.723640  2118 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.725309  2021 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:17.737501  1656 consensus_peers.cc:597] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:17.747014  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.749758  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.750370  1609 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:17.755877  1733 tablet_bootstrap.cc:654] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.773398  1733 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.773870  1733 ts_tablet_manager.cc:1403] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.013s
I20260709 12:58:17.777082  1733 raft_consensus.cc:359] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.777740  1733 raft_consensus.cc:385] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.778045  1733 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.778726  1733 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.777520  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.780753  2118 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.781005  1733 ts_tablet_manager.cc:1434] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:58:17.781231  2118 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.781723  2118 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.782253  1733 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.788328  1733 tablet_bootstrap.cc:654] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.790277  2110 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.809923  1730 tablet_bootstrap.cc:492] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.810525  1730 ts_tablet_manager.cc:1403] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.105s	user 0.033s	sys 0.046s
I20260709 12:58:17.811764  1535 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.813206  1730 raft_consensus.cc:359] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.814391  1730 raft_consensus.cc:385] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.814708  1730 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.815471  1730 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.818243  1730 ts_tablet_manager.cc:1434] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:17.820374  1730 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: Bootstrap starting.
I20260709 12:58:17.827090  2118 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.827744  1733 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.828158  1733 ts_tablet_manager.cc:1403] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.026s
I20260709 12:58:17.829892  2118 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.831032  1733 raft_consensus.cc:359] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.831684  1733 raft_consensus.cc:385] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.831938  1733 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.832623  1733 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.835438  1733 ts_tablet_manager.cc:1434] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:58:17.835754  2106 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.836505  1733 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:17.836251  2106 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.838156  2106 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.839547  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.842657  1733 tablet_bootstrap.cc:654] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.842769  2011 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.843248  2011 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.845129  2011 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.848078  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.848748  1686 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 0.
I20260709 12:58:17.853889  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.854916  2113 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.855082  1730 tablet_bootstrap.cc:654] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.855302  2113 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.855659  2113 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.858593  2152 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.867822  1537 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.866853  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:17.868963  2118 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.869480  2118 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.871752  2118 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:17.871341  2113 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:17.874614  1656 leader_election.cc:343] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.877219  1730 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: No bootstrap required, opened a new log
I20260709 12:58:17.879453  1730 ts_tablet_manager.cc:1403] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.004s
W20260709 12:58:17.873242  1582 leader_election.cc:343] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.879846  1997 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.881094  2113 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.881831  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:17.882385  1686 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.883502  1730 raft_consensus.cc:359] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.884348  1730 raft_consensus.cc:385] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.884660  1730 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.882144  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:17.885478  1730 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:17.886194  1582 leader_election.cc:343] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.888082  1730 ts_tablet_manager.cc:1434] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:58:17.889609  1686 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:17.889950  2113 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.890507  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:17.891228  2113 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.891664  2113 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:17.892369  2106 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.892490  2113 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.893026  2106 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.895639  2106 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:17.897734  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:17.898355  1608 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:17.900055  1507 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:17.901233  2106 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:17.901692  2106 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.902115  2106 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:17.904402  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.909116  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:17.911106  2106 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.911578  1685 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.913813  1733 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:17.917569  2024 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.914248  1733 ts_tablet_manager.cc:1403] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.011s
I20260709 12:58:17.931138  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:17.932950  2024 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.933348  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:17.934104  1609 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.938402  1733 raft_consensus.cc:359] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:17.939065  1733 raft_consensus.cc:385] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.939316  1733 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.939915  1733 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:17.961381  2180 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:58:17.966009  1541 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:17.971885  1733 ts_tablet_manager.cc:1434] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
W20260709 12:58:17.969235  2177 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 12:58:17.977180  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:18.026923  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:18.027557  1612 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:18.007198  2021 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.047482  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:18.049731  2106 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:18.049911  2110 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:18.052263  2182 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:58:18.049747  1733 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
W20260709 12:58:18.064621  1582 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:18.068845  1537 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:18.064631  2184 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
W20260709 12:58:18.081158  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44454.5us
W20260709 12:58:18.081863  1656 leader_election.cc:343] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:18.082355  1609 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:18.061287  2000 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.042039  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:18.045715  2021 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:18.091149  2021 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:18.091632  2187 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:18.086380  2000 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:18.096643  1912 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:18.114205  1912 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:18.092156  1612 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:18.116624  1912 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:18.119931  1912 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:18.116000  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 91592.9us
I20260709 12:58:18.139302  2185 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.139992  2185 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:18.152622  2000 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:18.215121  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 80681.7us
I20260709 12:58:18.216960  1733 tablet_bootstrap.cc:654] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.217367  2185 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:18.219214  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81187.7us
I20260709 12:58:18.220732  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:18.242509  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:18.251087  1539 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.258308  1912 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:18.310181  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 168962us
W20260709 12:58:18.318806  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 50409.2us
I20260709 12:58:18.320061  2000 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:18.325070  2151 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:18.672607  2187 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.673276  2187 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:18.675664  2187 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:18.683833  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:18.684721  1608 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
W20260709 12:58:18.694775  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 452357us
I20260709 12:58:18.696117  2190 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:18.693925  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 374135us
I20260709 12:58:18.754016  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:18.757200  1507 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:18.758477  2000 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:18.764268  1609 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 12:58:18.778687  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:18.778466  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 82922.4us
I20260709 12:58:18.779306  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:18.784714  2193 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:18.785637  2193 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:18.855695  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:18.856688  1541 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:18.786451  2193 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:18.876088  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 117883us
W20260709 12:58:18.901863  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 137091us
I20260709 12:58:18.905416  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:18.906318  1690 raft_consensus.cc:2410] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:58:18.896767  1533 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:18.922293  2196 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:58:18.923237  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:18.923125  1436 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.922458  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:18.927595  1733 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:18.928367  1733 ts_tablet_manager.cc:1403] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.879s	user 0.022s	sys 0.013s
I20260709 12:58:18.911576  2000 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:18.931774  2000 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:18.921288  2210 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:58:18.949098  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:18.957122  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:18.975021  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.016s	sys 0.023s
W20260709 12:58:18.975375  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.017s	sys 0.024s
I20260709 12:58:18.983783  2209 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:18.987670  2209 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.988168  2209 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.023873  1733 raft_consensus.cc:359] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.025031  1733 raft_consensus.cc:385] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.025444  1733 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.026273  1733 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:19.039888  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:19.040512  1733 ts_tablet_manager.cc:1434] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 12:58:19.140262  2000 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.140857  2000 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.142398  2190 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:19.142895  2000 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.143077  2190 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.199950  2213 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.228820  2190 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.224360  2193 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:19.230505  2193 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.200711  2213 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.235428  2213 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.235803  2193 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:19.236927  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.237414  2191 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.237936  2191 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.238250  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.239811  2191 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.247318  2191 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.247778  2191 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.248919  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.251065  2208 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.249763  1610 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 0.
I20260709 12:58:19.251668  2208 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.253804  2208 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.260381  2192 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.260618  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 322) took 1028 ms. Trace:
I20260709 12:58:19.260778  2191 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.260929  2192 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.259790  2213 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.306306  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:19.309535  2216 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:58:19.262225  2213 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.275905  2193 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:19.354106  2193 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.301515  2000 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.364162  2000 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.366278  2000 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.366676  1733 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:19.353575  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.377140  1687 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 0.
I20260709 12:58:19.378654  2209 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.328699  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.381445  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.345563  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.260082  1506 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:19.384011  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 134160us
I20260709 12:58:19.385697  1506 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:19.381497  2213 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.360277  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.363413  2198 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:19.353521  2186 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:19.343308  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.403678  1656 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:19.404630  1912 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:19.405045  1912 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.405393  1912 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.406210  2186 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.378672  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.400175  2218 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.331444  2200 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.408483  2198 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.430008  2193 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:19.435177  2220 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:58:19.431581  2209 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.426828  2200 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.438485  2192 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.468883  2211 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.471459  2200 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.261032  1539 rpcz_store.cc:276] 0709 12:58:18.232812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.239563 (+  6751us) service_pool.cc:224] Handling call
0709 12:58:18.250896 (+ 11333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:18.755711 (+504815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.755749 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:18.756197 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.900989 (+144792us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:18.915866 (+ 14877us) log.cc:844] Serialized 14 byte log entry
0709 12:58:18.942201 (+ 26335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.942314 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:19.246003 (+303689us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b18000772c0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:58:19.259479 (+ 13476us) raft_consensus.cc:1685] finished
0709 12:58:19.260408 (+   929us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:19.260551 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5934,"prepare.queue_time_us":2445,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19114,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"spinlock_wait_cycles":2210176,"thread_start_us":122980,"threads_started":2,"wal-append.queue_time_us":171613}
W20260709 12:58:19.483180  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 89268.3us
I20260709 12:58:19.451877  2186 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:19.496328  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50596.8us
I20260709 12:58:19.499229  1912 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.504786  1912 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:19.505739  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69136.2us
I20260709 12:58:19.511461  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.517591  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.519539  1733 tablet_bootstrap.cc:654] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.525653  2227 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.530022  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.506757  2187 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:19.514930  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:19.596697  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 77786.9us
I20260709 12:58:19.538763  2191 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
I20260709 12:58:19.620239  2195 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.620807  2195 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.545701  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:19.545326  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.634500  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.638227  2229 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:19.546070  2187 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.672686  2224 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.672984  2231 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:19.680095  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.681423  2198 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.675401  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.638693  1612 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.685024  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:19.683176  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.668022  2210 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:19.704062  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.685781  2229 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.743670  2195 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:19.720189  2224 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:19.720396  2198 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.754595  2198 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.749285  2224 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.751948  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.716308  2187 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:19.736666  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.704358  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.782020  2229 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.787933  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.752111  2210 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.789799  1538 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.709246  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.675707  2231 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.792207  2198 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.780377  1612 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:19.793797  1610 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:19.794739  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.802731  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:19.811823  1534 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 1: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:19.811954  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.797355  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.812603  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.813663  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.814993  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.816398  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.795557  2229 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:19.812012  2213 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:19.818603  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:19.817858  2229 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.824071  1733 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:19.824892  1733 ts_tablet_manager.cc:1403] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.458s	user 0.016s	sys 0.013s
I20260709 12:58:19.825757  2224 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.826298  2213 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:19.826490  2231 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:19.826925  2213 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:19.827876  2213 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.829974  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.832142  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.832355  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.834954  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.843449  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 103) took 1721 ms. Trace:
I20260709 12:58:19.843691  1733 raft_consensus.cc:359] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.844260  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:19.844995  1682 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:19.844478  1733 raft_consensus.cc:385] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.846614  1733 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.847366  1733 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.848507  2229 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.853241  1733 ts_tablet_manager.cc:1434] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:58:19.854110  2218 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.887745  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.843839  1436 rpcz_store.cc:276] 0709 12:58:18.129586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.132477 (+  2891us) service_pool.cc:224] Handling call
0709 12:58:19.843364 (+1710887us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:19.224017 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:19.246342 (+ 22325us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:19.246374 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:58:19.246401 (+    27us) tablet.cc:662] Decoding operations
0709 12:58:19.246763 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:19.246829 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:19.246858 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:19.247031 (+   173us) tablet.cc:701] Row locks acquired
0709 12:58:19.247048 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:58:19.247166 (+   118us) write_op.cc:270] Start()
0709 12:58:19.247269 (+   103us) write_op.cc:276] Timestamp: P: 1783601899247133 usec, L: 0
0709 12:58:19.247289 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:19.352813 (+105524us) log.cc:844] Serialized 540 byte log entry
0709 12:58:19.737304 (+384491us) op_driver.cc:464] REPLICATION: finished
0709 12:58:19.799770 (+ 62466us) write_op.cc:301] APPLY: starting
0709 12:58:19.799847 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:19.799938 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:19.800075 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:19.800272 (+   197us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:19.800441 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:19.800484 (+    43us) write_op.cc:312] APPLY: finished
0709 12:58:19.819580 (+ 19096us) log.cc:844] Serialized 22 byte log entry
0709 12:58:19.830105 (+ 10525us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:19.831517 (+  1412us) write_op.cc:454] Released schema lock
0709 12:58:19.831570 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:19.831877 (+   307us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:19.831912 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55170,"reported_tablets":3,"spinlock_wait_cycles":12544,"child_traces":[["op",{"apply.queue_time_us":62253,"apply.run_cpu_time_us":1766,"apply.run_wall_time_us":32095,"num_ops":1,"prepare.queue_time_us":259426,"prepare.run_cpu_time_us":66922,"prepare.run_wall_time_us":290568,"raft.queue_time_us":203475,"raft.run_cpu_time_us":9972,"raft.run_wall_time_us":43642,"replication_time_us":489877,"thread_start_us":419433,"threads_started":4,"wal-append.queue_time_us":179242}]]}
I20260709 12:58:19.895220  1733 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Bootstrap starting.
I20260709 12:58:19.896512  1688 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:58:19.896914  1688 pending_rounds.cc:85] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 0
I20260709 12:58:19.897207  1688 pending_rounds.cc:107] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:58:19.897512  1688 raft_consensus.cc:2889] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:19.899348  1581 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.886829  2192 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.884470  2218 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:19.854550  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.905407  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.903235  2198 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.907292  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.909593  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.911286  2241 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.912286  2210 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:19.914214  2198 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.916643  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.932469  1581 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.916651  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.937693  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.943861  2238 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.967887  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:19.974926  1537 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.982600  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.983948  2237 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:19.984457  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:19.989650  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:19.993397  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:19.994179  2198 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.000140  2218 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:20.006075  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:20.022382  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:20.023161  1733 tablet_bootstrap.cc:654] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.038005  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.039350  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.040772  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.045375  2210 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.046079  2210 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.049574  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.050690  1506 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.053367  2190 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.055197  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:20.052014  2210 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.055855  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:20.058171  2240 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.059242  1656 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.060199  1609 raft_consensus.cc:2393] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 1: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:20.061193  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.062975  2203 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.060675  2187 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.068187  1656 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.068888  2193 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.071055  1439 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.072717  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.073460  2193 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.080024  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.086205  2240 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.089661  2193 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.090859  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:20.094254  2218 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.097795  1733 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: No bootstrap required, opened a new log
I20260709 12:58:20.098240  1733 ts_tablet_manager.cc:1403] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent bootstrapping tablet: real 0.203s	user 0.007s	sys 0.009s
I20260709 12:58:20.105983  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.106864  2210 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.111678  1733 raft_consensus.cc:359] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:20.112351  1733 raft_consensus.cc:385] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.112627  1733 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.113180  1733 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:20.123929  1733 ts_tablet_manager.cc:1434] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:58:20.124744  2193 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.125264  2193 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:20.127738  2193 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:20.130564  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:20.142779  1656 leader_election.cc:343] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.143239  1656 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.143980  2193 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.152451  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.153153  2195 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.160342  2244 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:20.163434  1436 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:58:20.170272  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:20.170849  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:20.173805  1506 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.174786  2213 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.181218  1438 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.188046  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.188843  2193 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:20.217876  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.223116  2195 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:20.248055  2218 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.271122  2213 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.519114  2213 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.519641  2213 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:20.522248  2213 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:20.522231  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:20.522570  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:20.523799  1506 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:20.524377  2213 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.665527  1538 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.941082   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:20.970309  2264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:20.971114  2265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:20.971462  2267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:20.973026   431 server_base.cc:1061] running on GCE node
I20260709 12:58:20.976420   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:20.976751   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:20.976994   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601900976972 us; error 0 us; skew 500 ppm
I20260709 12:58:20.977708   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:20.981076   431 webserver.cc:533] Webserver started at http://127.0.107.196:33735/ using document root <none> and password file <none>
I20260709 12:58:20.981721   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:20.981982   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:20.982335   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:20.983670   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-3-root/instance:
uuid: "c445b7b7d94f48f99a3599ddfc92f462"
format_stamp: "Formatted at 2026-07-09 12:58:20 on dist-test-slave-vcr9"
I20260709 12:58:20.988780   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:58:20.992481  2272 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:20.993377   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:20.993745   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-3-root
uuid: "c445b7b7d94f48f99a3599ddfc92f462"
format_stamp: "Formatted at 2026-07-09 12:58:20 on dist-test-slave-vcr9"
I20260709 12:58:20.994067   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:21.009696   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:21.011396   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:21.014103   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:21.016814   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:21.017035   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:21.017352   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:21.017576   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:21.085745   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:38377
I20260709 12:58:21.085798  2334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:38377 every 8 connection(s)
I20260709 12:58:21.090569   431 auto_leader_rebalancer-test.cc:384] add a tserver: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:21.118127  2335 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33233
I20260709 12:58:21.118690  2335 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:21.119493  2335 heartbeater.cc:507] Master 127.0.107.254:33233 requested a full tablet report, sending...
I20260709 12:58:21.121688  1438 ts_manager.cc:194] Registered new tserver with Master: c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:21.124116  1438 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34152
I20260709 12:58:22.128739  2335 heartbeater.cc:499] Master 127.0.107.254:33233 was elected leader, sending a full tablet report...
I20260709 12:58:22.172575  1683 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.179437  1613 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.179550  1537 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.180687  2193 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:22.181614  2340 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:22.194900  2195 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.196643  1537 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
W20260709 12:58:22.204589  1653 consensus_peers.cc:597] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb61d39ca56d420fbee59be16467e2ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.206295  1613 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.217296  1438 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.233230  1613 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.242548  1683 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.244843  2238 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:22.249560  1537 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.252424  2238 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:22.260982  1579 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 113c4345626841658cc1c3aa19853e2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.265748  2237 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.274169  1539 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.276732  1683 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.293883  1436 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.299588  1682 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:22.314797  1653 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65a88b4c57e043e39d00e6e3f02b64fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.318315  1613 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.319368  1539 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.320197  2195 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.321420  2193 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.346294  2340 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.348825  1613 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.350296  1539 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.367178  1683 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.368105  1436 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:22.376197  1613 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:22.379369  1653 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31d2293f596d4cefaf1a169b3a79ba46. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.381567  2193 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:22.384516  1538 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.390758  2193 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:22.394075  2340 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.395632  1613 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.413892  1439 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.414968  1538 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:22.710225  2366 ts_tablet_manager.cc:933] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:22.714007  2366 tablet_copy_client.cc:323] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:22.736619  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet bb61d39ca56d420fbee59be16467e2ec from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:22.737206  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet bb61d39ca56d420fbee59be16467e2ec from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-bb61d39ca56d420fbee59be16467e2ec
I20260709 12:58:22.745182  1700 tablet_copy_source_session.cc:215] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.745199  2370 ts_tablet_manager.cc:933] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:22.748175  2370 tablet_copy_client.cc:323] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 12:58:22.749199  2366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61d39ca56d420fbee59be16467e2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.768788  2366 tablet_copy_client.cc:806] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.769415  2366 tablet_copy_client.cc:670] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.770531  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet 113c4345626841658cc1c3aa19853e2a from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 12:58:22.771122  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet 113c4345626841658cc1c3aa19853e2a from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-113c4345626841658cc1c3aa19853e2a
I20260709 12:58:22.772478  2373 ts_tablet_manager.cc:933] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:22.777171  2373 tablet_copy_client.cc:323] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:22.778883  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 65a88b4c57e043e39d00e6e3f02b64fe from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:22.779157  2366 tablet_copy_client.cc:538] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.779409  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 65a88b4c57e043e39d00e6e3f02b64fe from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-65a88b4c57e043e39d00e6e3f02b64fe
I20260709 12:58:22.780889  1626 tablet_copy_source_session.cc:215] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.784683  2370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113c4345626841658cc1c3aa19853e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.790884  1700 tablet_copy_source_session.cc:215] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.793162  2366 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:22.798647  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a88b4c57e043e39d00e6e3f02b64fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.804993  2370 tablet_copy_client.cc:806] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.805624  2370 tablet_copy_client.cc:670] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.811609  2370 tablet_copy_client.cc:538] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.832043  2370 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:22.844235  2373 tablet_copy_client.cc:806] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.844900  2373 tablet_copy_client.cc:670] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.862447  2373 tablet_copy_client.cc:538] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.865715  2366 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.866735  2366 tablet_bootstrap.cc:492] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:22.867434  2366 ts_tablet_manager.cc:1403] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.075s	user 0.031s	sys 0.004s
I20260709 12:58:22.871188  2366 raft_consensus.cc:359] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.872071  2366 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:22.872781  2366 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.878127  2373 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:22.881902  2370 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.882851  2370 tablet_bootstrap.cc:492] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:22.883486  2370 ts_tablet_manager.cc:1403] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.011s
I20260709 12:58:22.886767  2370 raft_consensus.cc:359] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.887580  2370 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:22.888195  2370 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.901754  2366 ts_tablet_manager.cc:1434] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.014s
I20260709 12:58:22.907850  2373 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.908437  2370 ts_tablet_manager.cc:1434] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.010s
I20260709 12:58:22.908793  2373 tablet_bootstrap.cc:492] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:22.909832  2373 ts_tablet_manager.cc:1403] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.004s
I20260709 12:58:22.910629  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-113c4345626841658cc1c3aa19853e2a received from {username='slave'} at 127.0.0.1:53078
I20260709 12:58:22.910892  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-bb61d39ca56d420fbee59be16467e2ec received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:22.911123  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-113c4345626841658cc1c3aa19853e2a on tablet 113c4345626841658cc1c3aa19853e2a with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:22.911789  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-bb61d39ca56d420fbee59be16467e2ec on tablet bb61d39ca56d420fbee59be16467e2ec with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:22.917279  2373 raft_consensus.cc:359] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.918646  2373 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:22.919284  2373 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:22.921279  2373 ts_tablet_manager.cc:1434] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:58:22.922785  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-65a88b4c57e043e39d00e6e3f02b64fe received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:22.923180  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-65a88b4c57e043e39d00e6e3f02b64fe on tablet 65a88b4c57e043e39d00e6e3f02b64fe with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:22.945492  2373 ts_tablet_manager.cc:933] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:22.947130  2373 tablet_copy_client.cc:323] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:22.948577  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 31d2293f596d4cefaf1a169b3a79ba46 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:22.949079  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 31d2293f596d4cefaf1a169b3a79ba46 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-31d2293f596d4cefaf1a169b3a79ba46
I20260709 12:58:22.954706  1700 tablet_copy_source_session.cc:215] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.957448  2373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d2293f596d4cefaf1a169b3a79ba46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.970925  2373 tablet_copy_client.cc:806] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.971556  2373 tablet_copy_client.cc:670] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.977795  2373 tablet_copy_client.cc:538] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.985188  2373 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:23.006687  2373 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:23.007475  2373 tablet_bootstrap.cc:492] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:23.008011  2373 ts_tablet_manager.cc:1403] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 12:58:23.010450  2373 raft_consensus.cc:359] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:23.011226  2373 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:23.011781  2373 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:23.014669  2373 ts_tablet_manager.cc:1434] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:23.016453  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-31d2293f596d4cefaf1a169b3a79ba46 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:23.016855  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-31d2293f596d4cefaf1a169b3a79ba46 on tablet 31d2293f596d4cefaf1a169b3a79ba46 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:23.151043  2309 raft_consensus.cc:1217] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.192348  2309 raft_consensus.cc:1217] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.223240  2309 raft_consensus.cc:1217] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.560209  2309 raft_consensus.cc:1217] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.722261  2237 raft_consensus.cc:1064] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:23.724466  2237 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:23.731742  1683 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.733659  2309 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.737003  2386 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.738163  2383 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.751436  2237 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:23.756523  1539 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.756160  1683 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:23.761165  2385 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.764056  2309 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:23.768095  2195 raft_consensus.cc:1064] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:23.770296  2195 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:23.770430  1438 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.788924  1539 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:23.817164  2340 raft_consensus.cc:1064] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:23.819639  2340 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:23.848295  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52975.5us
I20260709 12:58:23.903033  2309 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.904512  2340 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.907460  2309 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.909564  2340 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.910552  1614 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.913295  1539 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.918511  1614 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.922482  1539 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.934732  2340 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.940060  2193 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.942646  2340 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.942920  2399 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.964403  2399 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:23.975463  1613 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:23.995317  2309 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.011529  1437 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.016891  2399 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.026855  1614 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.028084  1538 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.029783  1539 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.042698  1683 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:24.048950  2309 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.050261  2310 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.059582  1436 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.063854  2399 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.065006  1538 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.070401  2193 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.076519  2394 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.078485  2193 raft_consensus.cc:1064] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:24.080801  2193 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:24.084095  2310 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.089962  1683 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:24.101904  2309 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:24.102811  1614 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:24.103716  2393 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:24.105782  2340 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:24.109050  2309 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.111881  1539 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:24.113957  1614 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.114934  2399 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.116845  2193 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:24.123800  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65a88b4c57e043e39d00e6e3f02b64fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:24.142874  1537 raft_consensus.cc:2955] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.143208  2309 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.140524  2399 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.151911  2340 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.163599  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb61d39ca56d420fbee59be16467e2ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:24.178996  1614 raft_consensus.cc:2955] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.184677  1439 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.199663  1607 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:24.202414  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 65a88b4c57e043e39d00e6e3f02b64fe with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:24.203805  1436 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.216894  2309 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.216432  2193 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.218609  2310 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.220589  2412 tablet_replica.cc:333] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:24.221508  2412 raft_consensus.cc:2243] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.222222  2412 raft_consensus.cc:2272] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.222711  1538 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.224288  2386 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.227165  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet bb61d39ca56d420fbee59be16467e2ec with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:24.228328  2412 ts_tablet_manager.cc:1916] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:24.231844  2386 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.234010  2413 tablet_replica.cc:333] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:24.233604  2383 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.243284  1613 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.245231  1536 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.253604  1439 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.254400  1538 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.263041  2310 raft_consensus.cc:2955] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.266790  2413 raft_consensus.cc:2243] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.271381  2413 raft_consensus.cc:2272] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.275686  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 113c4345626841658cc1c3aa19853e2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:24.284090  1438 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.292622  2412 ts_tablet_manager.cc:1929] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:24.293279  2412 log.cc:1199] T 65a88b4c57e043e39d00e6e3f02b64fe P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/65a88b4c57e043e39d00e6e3f02b64fe
I20260709 12:58:24.293515  2413 ts_tablet_manager.cc:1916] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:24.295682  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 65a88b4c57e043e39d00e6e3f02b64fe (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:24.307413  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 113c4345626841658cc1c3aa19853e2a with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:24.308531  2413 ts_tablet_manager.cc:1929] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:24.309042  2413 log.cc:1199] T bb61d39ca56d420fbee59be16467e2ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/bb61d39ca56d420fbee59be16467e2ec
I20260709 12:58:24.311126  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet bb61d39ca56d420fbee59be16467e2ec (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:24.316620  2414 tablet_replica.cc:333] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:24.318668  2414 raft_consensus.cc:2243] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.319387  2414 raft_consensus.cc:2272] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.324085  2414 ts_tablet_manager.cc:1916] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:24.331207  1683 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:24.336898  2310 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.337494  1536 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.338532  2193 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.340840  2414 ts_tablet_manager.cc:1929] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:24.341390  2414 log.cc:1199] T 113c4345626841658cc1c3aa19853e2a P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/113c4345626841658cc1c3aa19853e2a
I20260709 12:58:24.340803  2394 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:24.343185  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 113c4345626841658cc1c3aa19853e2a (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:24.346578  2393 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.353863  2310 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.354519  1538 raft_consensus.cc:2955] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.360469  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31d2293f596d4cefaf1a169b3a79ba46 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:24.371275  1439 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:24.382614  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d2293f596d4cefaf1a169b3a79ba46 with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:24.383545  2412 tablet_replica.cc:333] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:24.384398  2412 raft_consensus.cc:2243] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.385411  2412 raft_consensus.cc:2272] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.389703  2412 ts_tablet_manager.cc:1916] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:24.402437  2412 ts_tablet_manager.cc:1929] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:24.402820  2412 log.cc:1199] T 31d2293f596d4cefaf1a169b3a79ba46 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/31d2293f596d4cefaf1a169b3a79ba46
I20260709 12:58:24.404126  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 31d2293f596d4cefaf1a169b3a79ba46 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:25.451211  1683 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:25.458211  1653 consensus_peers.cc:597] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 396314c408674415abb66b1625b8a308. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.458350  1614 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.459192  1536 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.460960  2409 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.462041  2393 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.472167  2417 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.475762  1613 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.478523  1538 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.494637  1437 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.496022  1609 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:25.534304  1579 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4588cb2170964d9888521712ee881700. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.537599  1683 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.539296  2385 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.537599  1536 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.550333  2385 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.557600  2424 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.562824  1536 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.571992  1683 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.577562  1609 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:25.585246  1436 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.595582  1683 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.597692  1536 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.599241  2428 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.600083  2385 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:25.606977  1579 consensus_peers.cc:597] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdbc1ad76ba949aba54340f33a210d0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.613505  2385 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.613297  1683 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.631119  1436 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.633747  1538 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.669624  1538 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:25.678069  1609 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.678390  1688 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.679952  2397 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.680930  2209 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.690471  2209 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.691980  1609 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:25.694624  1688 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
W20260709 12:58:25.699959  1504 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79180ee33a124de7a839155b4a30086e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.717172  1439 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.045500  2442 ts_tablet_manager.cc:933] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:26.052212  2442 tablet_copy_client.cc:323] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 12:58:26.054836  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet 4588cb2170964d9888521712ee881700 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 12:58:26.055451  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet 4588cb2170964d9888521712ee881700 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-4588cb2170964d9888521712ee881700
I20260709 12:58:26.076817  1626 tablet_copy_source_session.cc:215] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:26.079233  2444 ts_tablet_manager.cc:933] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:26.086208  2442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4588cb2170964d9888521712ee881700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.095984  2444 tablet_copy_client.cc:323] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:26.098089  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 396314c408674415abb66b1625b8a308 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:26.098621  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 396314c408674415abb66b1625b8a308 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-396314c408674415abb66b1625b8a308
I20260709 12:58:26.108348  2446 ts_tablet_manager.cc:933] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:26.108733  2442 tablet_copy_client.cc:806] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:26.109375  2442 tablet_copy_client.cc:670] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:26.113349  2442 tablet_copy_client.cc:538] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:26.120947  1700 tablet_copy_source_session.cc:215] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:26.124452  2444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396314c408674415abb66b1625b8a308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.125403  2442 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:26.128522  2446 tablet_copy_client.cc:323] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 12:58:26.131302  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet bdbc1ad76ba949aba54340f33a210d0d from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 12:58:26.131841  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet bdbc1ad76ba949aba54340f33a210d0d from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-bdbc1ad76ba949aba54340f33a210d0d
I20260709 12:58:26.140868  1626 tablet_copy_source_session.cc:215] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:26.144214  2446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbc1ad76ba949aba54340f33a210d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.148967  2444 tablet_copy_client.cc:806] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:26.149580  2444 tablet_copy_client.cc:670] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:26.154110  2444 tablet_copy_client.cc:538] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:26.168082  2444 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:26.168476  2446 tablet_copy_client.cc:806] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:26.169288  2446 tablet_copy_client.cc:670] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:26.172889  2446 tablet_copy_client.cc:538] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:26.180253  2442 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:26.181239  2442 tablet_bootstrap.cc:492] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:26.181919  2446 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:26.181931  2442 ts_tablet_manager.cc:1403] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.020s
I20260709 12:58:26.187016  2442 raft_consensus.cc:359] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.187839  2442 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:26.188549  2442 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.215998  2446 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:26.219228  2442 ts_tablet_manager.cc:1434] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 12:58:26.220764  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-4588cb2170964d9888521712ee881700 received from {username='slave'} at 127.0.0.1:53078
I20260709 12:58:26.221331  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-4588cb2170964d9888521712ee881700 on tablet 4588cb2170964d9888521712ee881700 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:26.221378  2446 tablet_bootstrap.cc:492] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:26.222242  2446 ts_tablet_manager.cc:1403] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.005s
I20260709 12:58:26.225888  2442 ts_tablet_manager.cc:933] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:26.240931  2442 tablet_copy_client.cc:323] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:26.244159  2446 raft_consensus.cc:359] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.245230  2446 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:26.246342  2446 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.249331  2446 ts_tablet_manager.cc:1434] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 12:58:26.259532  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-bdbc1ad76ba949aba54340f33a210d0d received from {username='slave'} at 127.0.0.1:53078
I20260709 12:58:26.259964  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-bdbc1ad76ba949aba54340f33a210d0d on tablet bdbc1ad76ba949aba54340f33a210d0d with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:26.265851  2444 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:26.268206  2444 tablet_bootstrap.cc:492] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:26.269476  2444 ts_tablet_manager.cc:1403] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.008s
I20260709 12:58:26.272714  2444 raft_consensus.cc:359] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.273579  2444 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:26.274240  2444 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.278416  2444 ts_tablet_manager.cc:1434] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:26.281262  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-396314c408674415abb66b1625b8a308 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:26.281698  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-396314c408674415abb66b1625b8a308 on tablet 396314c408674415abb66b1625b8a308 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:26.287024  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 79180ee33a124de7a839155b4a30086e from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:26.287606  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 79180ee33a124de7a839155b4a30086e from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-79180ee33a124de7a839155b4a30086e
I20260709 12:58:26.295087  1551 tablet_copy_source_session.cc:215] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:26.298480  2442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79180ee33a124de7a839155b4a30086e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.313457  2442 tablet_copy_client.cc:806] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:26.314023  2442 tablet_copy_client.cc:670] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:26.321910  2442 tablet_copy_client.cc:538] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:26.330622  2442 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:26.355137  2442 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:26.356045  2442 tablet_bootstrap.cc:492] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:26.356715  2442 ts_tablet_manager.cc:1403] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 12:58:26.359540  2442 raft_consensus.cc:359] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.360378  2442 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:26.360980  2442 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:26.363559  2442 ts_tablet_manager.cc:1434] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:26.365105  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-79180ee33a124de7a839155b4a30086e received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:26.365480  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-79180ee33a124de7a839155b4a30086e on tablet 79180ee33a124de7a839155b4a30086e with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:26.480690  2310 raft_consensus.cc:1217] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:26.532099  2310 raft_consensus.cc:1217] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:26.549134  2310 raft_consensus.cc:1217] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:26.762598  2310 raft_consensus.cc:1217] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:27.052654  2429 raft_consensus.cc:1064] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:27.054497  2429 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.075683  1688 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.076056  1536 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.076934  2385 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.077836  2459 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.082278  2309 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.086848  2429 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.088213  2385 raft_consensus.cc:1064] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:27.090593  2385 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.106333  2459 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.112632  1688 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.115499  1538 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.118139  1537 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.112565  2309 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.130913  2429 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.139990  2466 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.144353  2429 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.158675  2399 raft_consensus.cc:1064] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:27.159675  1436 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.161023  2399 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.166282  1683 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.170176  2310 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.171583  2409 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.172382  2457 raft_consensus.cc:1064] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:27.172040  1536 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.177482  2409 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.203423  2457 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:27.273057  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 143117us
I20260709 12:58:27.298231  2309 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.299642  2472 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.294658  2308 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.317691  2308 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.323244  1614 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.348623  2478 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:27.394737  2479 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:58:27.397676  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 124187us
I20260709 12:58:27.409480  1612 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.424510  2473 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:27.426607  1539 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.430599  2457 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:27.433362  2462 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.438082  1688 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.439838  2308 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.449996  2397 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.459107  1607 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.462905  2478 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.464594  1688 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.479720  1539 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.516198  2309 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.545213  1607 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.548856  1688 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.582669  1607 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.589483  2309 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.588826  1437 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.590866  1688 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.590404  1437 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.591037  2462 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.592161  2385 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.591842  1437 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.598244  2385 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.602505  1682 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.602579  2309 raft_consensus.cc:2955] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.607059  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdbc1ad76ba949aba54340f33a210d0d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.624652  1541 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.630909  1607 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.632428  2397 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.633963  2309 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:58:27.636313  1426 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet bdbc1ad76ba949aba54340f33a210d0d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:58:27.636391  1439 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.638567  2397 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.641383  1614 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.642434  2397 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.645730  1612 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.648326  2308 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.650377  1541 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.652917  2465 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.659843  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet bdbc1ad76ba949aba54340f33a210d0d with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:27.656111  2465 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.666091  2459 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.669384  2308 raft_consensus.cc:2955] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.671469  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79180ee33a124de7a839155b4a30086e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.679593  1435 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.685292  2310 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.686672  1541 raft_consensus.cc:2955] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.706461  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4588cb2170964d9888521712ee881700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.708257  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 79180ee33a124de7a839155b4a30086e with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:27.708941  2493 tablet_replica.cc:333] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:27.710237  2493 raft_consensus.cc:2243] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.711022  2493 raft_consensus.cc:2272] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.714715  2493 ts_tablet_manager.cc:1916] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:27.717741  1436 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.718533  2494 tablet_replica.cc:333] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:27.726402  2494 raft_consensus.cc:2243] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.727973  2494 raft_consensus.cc:2272] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.731664  2494 ts_tablet_manager.cc:1916] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:27.736860  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 4588cb2170964d9888521712ee881700 with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:27.740615  2493 ts_tablet_manager.cc:1929] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:27.741194  2493 log.cc:1199] T bdbc1ad76ba949aba54340f33a210d0d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/bdbc1ad76ba949aba54340f33a210d0d
I20260709 12:58:27.742910  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet bdbc1ad76ba949aba54340f33a210d0d (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:27.749552  2494 ts_tablet_manager.cc:1929] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:27.750025  2494 log.cc:1199] T 79180ee33a124de7a839155b4a30086e P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/79180ee33a124de7a839155b4a30086e
I20260709 12:58:27.751919  2494 tablet_replica.cc:333] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:27.751959  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 79180ee33a124de7a839155b4a30086e (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:27.752979  2494 raft_consensus.cc:2243] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.753763  2494 raft_consensus.cc:2272] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.757563  2494 ts_tablet_manager.cc:1916] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:27.773989  2494 ts_tablet_manager.cc:1929] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:27.774381  2494 log.cc:1199] T 4588cb2170964d9888521712ee881700 P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/4588cb2170964d9888521712ee881700
I20260709 12:58:27.775786  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 4588cb2170964d9888521712ee881700 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:27.949999  1688 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:27.954245  2310 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.955832  1607 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.955928  2476 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.959234  2473 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:27.962939  2399 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.969245  2310 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.971334  1607 raft_consensus.cc:2955] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:27.975358  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 396314c408674415abb66b1625b8a308 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.982669  1439 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.999178  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 396314c408674415abb66b1625b8a308 with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:28.000130  2493 tablet_replica.cc:333] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:28.001227  2493 raft_consensus.cc:2243] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:28.002013  2493 raft_consensus.cc:2272] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:28.006186  2493 ts_tablet_manager.cc:1916] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:28.022027  2493 ts_tablet_manager.cc:1929] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:28.022406  2493 log.cc:1199] T 396314c408674415abb66b1625b8a308 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/396314c408674415abb66b1625b8a308
I20260709 12:58:28.023921  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet 396314c408674415abb66b1625b8a308 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:29.064157  1541 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.069501  1688 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:29.069576  1614 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:29.069911  1504 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04fd8c1bd97c403fbac13cb4d6f34e1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:29.070930  2495 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.071677  2478 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.079126  2495 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.081285  1688 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.081018  1614 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.092958  1539 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.105927  1682 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:29.107113  1504 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57b6d9fb4551488e978e5e62c1c59485. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:29.107532  1607 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:29.108953  2478 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.110496  2478 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.110114  1435 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:29.119756  2397 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.123783  1614 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.137125  1682 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.161888  1682 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:29.188375  1653 consensus_peers.cc:597] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9059b4be41c340278068c13696d1000e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:29.190315  1614 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:29.192458  1533 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:29.198714  2509 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.201233  2500 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.202945  1436 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:29.225725  2500 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.227124  1614 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.233731  1533 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.249478  1614 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.252192  1439 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.257591  1682 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:29.259174  1533 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:29.260133  1579 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ee88b04047243b6b9ee3653189f3969. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:29.261909  2459 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.262930  2465 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.275817  2465 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.279981  1533 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.281344  1682 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:29.299651  1435 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:29.561172  2517 ts_tablet_manager.cc:933] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:29.563551  2517 tablet_copy_client.cc:323] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:29.565100  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:29.565563  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 04fd8c1bd97c403fbac13cb4d6f34e1c from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-04fd8c1bd97c403fbac13cb4d6f34e1c
I20260709 12:58:29.570420  1551 tablet_copy_source_session.cc:215] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.573436  2517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.589757  2517 tablet_copy_client.cc:806] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.590679  2517 tablet_copy_client.cc:670] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.597093  2517 tablet_copy_client.cc:538] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.607512  2517 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:29.627856  2517 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.628791  2517 tablet_bootstrap.cc:492] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:29.629480  2517 ts_tablet_manager.cc:1403] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.004s
I20260709 12:58:29.632582  2517 raft_consensus.cc:359] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.633438  2517 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:29.634128  2517 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.637358  2517 ts_tablet_manager.cc:1434] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:29.639254  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-04fd8c1bd97c403fbac13cb4d6f34e1c received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:29.639717  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-04fd8c1bd97c403fbac13cb4d6f34e1c on tablet 04fd8c1bd97c403fbac13cb4d6f34e1c with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:29.682236  2517 ts_tablet_manager.cc:933] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:29.683964  2517 tablet_copy_client.cc:323] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:29.685740  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 57b6d9fb4551488e978e5e62c1c59485 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:29.686280  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 57b6d9fb4551488e978e5e62c1c59485 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-57b6d9fb4551488e978e5e62c1c59485
I20260709 12:58:29.694278  1551 tablet_copy_source_session.cc:215] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.697924  2517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6d9fb4551488e978e5e62c1c59485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.704110  2522 ts_tablet_manager.cc:933] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:29.721827  2522 tablet_copy_client.cc:323] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:29.723803  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 9059b4be41c340278068c13696d1000e from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:29.724395  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 9059b4be41c340278068c13696d1000e from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-9059b4be41c340278068c13696d1000e
I20260709 12:58:29.731787  1700 tablet_copy_source_session.cc:215] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.735683  2522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9059b4be41c340278068c13696d1000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.740007  2517 tablet_copy_client.cc:806] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.740940  2517 tablet_copy_client.cc:670] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.746124  2517 tablet_copy_client.cc:538] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.752692  2522 tablet_copy_client.cc:806] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.753376  2522 tablet_copy_client.cc:670] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.755585  2517 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:29.756985  2522 tablet_copy_client.cc:538] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.769269  2522 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:29.787560  2517 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.788480  2517 tablet_bootstrap.cc:492] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:29.789206  2517 ts_tablet_manager.cc:1403] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.007s
I20260709 12:58:29.792178  2517 raft_consensus.cc:359] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.793092  2517 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:29.794152  2522 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.793781  2517 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.797039  2522 tablet_bootstrap.cc:492] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:29.797405  2517 ts_tablet_manager.cc:1434] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 12:58:29.798210  2522 ts_tablet_manager.cc:1403] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 12:58:29.799924  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-57b6d9fb4551488e978e5e62c1c59485 received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:29.800395  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-57b6d9fb4551488e978e5e62c1c59485 on tablet 57b6d9fb4551488e978e5e62c1c59485 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:29.801481  2522 raft_consensus.cc:359] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.802403  2522 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:29.803109  2522 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.805927  2522 ts_tablet_manager.cc:1434] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:29.807590  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-9059b4be41c340278068c13696d1000e received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:29.808015  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-9059b4be41c340278068c13696d1000e on tablet 9059b4be41c340278068c13696d1000e with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:29.811208  2517 ts_tablet_manager.cc:933] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:29.816763  2517 tablet_copy_client.cc:323] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 12:58:29.818462  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet 2ee88b04047243b6b9ee3653189f3969 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 12:58:29.818979  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet 2ee88b04047243b6b9ee3653189f3969 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-2ee88b04047243b6b9ee3653189f3969
I20260709 12:58:29.829370  1626 tablet_copy_source_session.cc:215] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.833806  2517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee88b04047243b6b9ee3653189f3969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.847990  2517 tablet_copy_client.cc:806] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.848600  2517 tablet_copy_client.cc:670] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.852254  2517 tablet_copy_client.cc:538] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.858613  2517 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:29.871618  2517 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.872380  2517 tablet_bootstrap.cc:492] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:29.872920  2517 ts_tablet_manager.cc:1403] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.015s	user 0.015s	sys 0.000s
I20260709 12:58:29.874818  2517 raft_consensus.cc:359] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.875392  2517 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:29.875828  2517 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:29.877619  2517 ts_tablet_manager.cc:1434] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:29.879494  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-2ee88b04047243b6b9ee3653189f3969 received from {username='slave'} at 127.0.0.1:53078
I20260709 12:58:29.879904  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-2ee88b04047243b6b9ee3653189f3969 on tablet 2ee88b04047243b6b9ee3653189f3969 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:29.988288  2310 raft_consensus.cc:1217] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:30.087832  2310 raft_consensus.cc:1217] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:30.104367  2310 raft_consensus.cc:1217] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:58:30.389313  2310 raft_consensus.cc:1217] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:30.450866  2504 raft_consensus.cc:1064] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:30.453259  2504 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.463160  2310 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.463295  1688 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.464527  2504 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.465425  2524 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.466708  1614 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.476315  2524 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.502305  2504 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.505553  2310 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.510751  1612 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.513937  1682 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.530725  1435 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:30.587116  1538 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.605207  2310 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.606675  2504 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.612450  2525 raft_consensus.cc:1064] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:30.613823  1688 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.614984  2525 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.619834  2310 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.628513  2504 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.643814  2542 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.648272  1607 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.649812  1688 raft_consensus.cc:2955] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.652817  1682 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.651867  2544 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.659624  2525 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.689594  2310 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.689584  1436 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.692198  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.698232  2545 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:30.699009  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 44262.6us
I20260709 12:58:30.703186  2540 raft_consensus.cc:1064] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:30.705786  2540 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.712922  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 04fd8c1bd97c403fbac13cb4d6f34e1c with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:30.717397  2549 tablet_replica.cc:333] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:30.720788  2504 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.724916  1688 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.729784  2310 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.748383  1436 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.753366  1607 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.753507  2310 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.753677  1538 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.755544  2529 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.756412  2510 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.761993  2540 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.784144  2549 raft_consensus.cc:2243] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:30.787582  2549 raft_consensus.cc:2272] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:30.796891  2510 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.806687  1612 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.811235  1607 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.812665  1541 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.818059  1436 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.838954  2549 ts_tablet_manager.cc:1916] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:30.846273  1541 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.854916  2308 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:30.859877  2308 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.865028  2525 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.871752  2525 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.873188  1688 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:30.873399  2310 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.874485  2504 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.880618  2549 ts_tablet_manager.cc:1929] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:30.881161  2549 log.cc:1199] T 04fd8c1bd97c403fbac13cb4d6f34e1c P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/04fd8c1bd97c403fbac13cb4d6f34e1c
I20260709 12:58:30.882690  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 04fd8c1bd97c403fbac13cb4d6f34e1c (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:30.882843  1688 raft_consensus.cc:2955] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.890035  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57b6d9fb4551488e978e5e62c1c59485 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.895062  1437 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.898818  1688 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.904722  1612 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.904896  2310 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.906291  2540 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.907169  2476 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.907444  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 57b6d9fb4551488e978e5e62c1c59485 with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:30.908344  2549 tablet_replica.cc:333] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:30.909327  2549 raft_consensus.cc:2243] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:30.910010  2549 raft_consensus.cc:2272] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:30.922118  2549 ts_tablet_manager.cc:1916] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:30.934552  2476 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.937383  1607 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.939834  2310 raft_consensus.cc:2955] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.945040  2465 raft_consensus.cc:1064] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:30.952365  2549 ts_tablet_manager.cc:1929] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:58:30.947413  2465 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:30.952874  2549 log.cc:1199] T 57b6d9fb4551488e978e5e62c1c59485 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/57b6d9fb4551488e978e5e62c1c59485
I20260709 12:58:30.957850  1437 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:30.960093  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 57b6d9fb4551488e978e5e62c1c59485 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:30.962904  1538 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.965128  2308 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.965190  1688 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.967038  2554 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.968736  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9059b4be41c340278068c13696d1000e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.969627  2465 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.971058  2531 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.973673  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 9059b4be41c340278068c13696d1000e with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:30.986553  2556 tablet_replica.cc:333] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:30.989789  2556 raft_consensus.cc:2243] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:30.990583  2556 raft_consensus.cc:2272] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.013433  2556 ts_tablet_manager.cc:1916] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.019065  2531 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.022056  2308 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.034788  1541 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.046518  1688 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.055385  1439 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.073751  1612 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:31.079845  1533 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:31.081854  2308 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:31.083242  2531 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:31.084807  2465 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:31.086912  2556 ts_tablet_manager.cc:1929] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.088318  2556 log.cc:1199] T 9059b4be41c340278068c13696d1000e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/9059b4be41c340278068c13696d1000e
I20260709 12:58:31.090175  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet 9059b4be41c340278068c13696d1000e (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:31.100551  1541 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.103142  2465 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.108881  2308 raft_consensus.cc:2955] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:31.127382  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ee88b04047243b6b9ee3653189f3969 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:31.136934  1439 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:31.151139  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ee88b04047243b6b9ee3653189f3969 with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:31.153434  2560 tablet_replica.cc:333] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:31.154620  2560 raft_consensus.cc:2243] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.155391  2560 raft_consensus.cc:2272] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.159329  2560 ts_tablet_manager.cc:1916] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.175565  2560 ts_tablet_manager.cc:1929] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.175966  2560 log.cc:1199] T 2ee88b04047243b6b9ee3653189f3969 P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/2ee88b04047243b6b9ee3653189f3969
I20260709 12:58:31.177350  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 2ee88b04047243b6b9ee3653189f3969 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:32.230722  1682 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.237890  1614 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:32.238147  1653 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 710eea1b85d441dcabbb12e33e31ae6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.239588  1533 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.239624  2540 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:32.241196  2476 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.249150  2529 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.257025  1533 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.262591  1538 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.267107  1437 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.269644  1612 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
W20260709 12:58:32.274785  1504 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ab255080f74412f87943c46e12f9f06. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.278688  1614 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.278899  1682 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.280537  2545 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.281318  2525 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.301923  2525 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.314004  1612 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.318809  1688 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.320739  1682 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.339522  1607 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.341768  1533 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:32.341871  1653 consensus_peers.cc:597] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08d3893a9300428592d3ce769b91a4db. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.342623  2540 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.349098  1436 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.349999  2540 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.377583  2565 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.379288  1612 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.395522  1541 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.398170  1439 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.398841  1533 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.412444  1682 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.412436  1612 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:32.413812  1504 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b3d048f5d2644a6b635da71cc6c7a8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.414314  2575 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.416337  2525 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.428344  2575 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.430112  1612 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.432636  1682 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:32.453504  1437 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.705224  2583 ts_tablet_manager.cc:933] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:32.707267  2583 tablet_copy_client.cc:323] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:32.708993  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 710eea1b85d441dcabbb12e33e31ae6b from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:32.709462  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 710eea1b85d441dcabbb12e33e31ae6b from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-710eea1b85d441dcabbb12e33e31ae6b
I20260709 12:58:32.714628  1700 tablet_copy_source_session.cc:215] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.717989  2583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710eea1b85d441dcabbb12e33e31ae6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:32.734619  2583 tablet_copy_client.cc:806] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:32.735157  2583 tablet_copy_client.cc:670] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:32.738732  2583 tablet_copy_client.cc:538] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:32.746088  2583 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:32.767882  2583 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:32.768780  2583 tablet_bootstrap.cc:492] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:32.769441  2583 ts_tablet_manager.cc:1403] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:58:32.772131  2586 ts_tablet_manager.cc:933] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:32.772346  2583 raft_consensus.cc:359] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.773227  2583 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:32.774330  2583 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.776458  2586 tablet_copy_client.cc:323] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:32.781093  2583 ts_tablet_manager.cc:1434] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:58:32.786337  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 08d3893a9300428592d3ce769b91a4db from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:32.786501  1699 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-710eea1b85d441dcabbb12e33e31ae6b received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:32.786996  1699 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-710eea1b85d441dcabbb12e33e31ae6b on tablet 710eea1b85d441dcabbb12e33e31ae6b with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:32.787693  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 08d3893a9300428592d3ce769b91a4db from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-08d3893a9300428592d3ce769b91a4db
I20260709 12:58:32.795110  1700 tablet_copy_source_session.cc:215] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.798708  2586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d3893a9300428592d3ce769b91a4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:32.814688  2586 tablet_copy_client.cc:806] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:32.815228  2586 tablet_copy_client.cc:670] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:32.818992  2586 tablet_copy_client.cc:538] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:32.827766  2586 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:32.846092  2586 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:32.846832  2586 tablet_bootstrap.cc:492] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:32.847352  2586 ts_tablet_manager.cc:1403] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:58:32.849982  2586 raft_consensus.cc:359] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.850775  2586 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:32.851378  2586 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.853546  2586 ts_tablet_manager.cc:1434] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:32.857232  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-08d3893a9300428592d3ce769b91a4db received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:32.857632  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-08d3893a9300428592d3ce769b91a4db on tablet 08d3893a9300428592d3ce769b91a4db with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:32.888914  2586 ts_tablet_manager.cc:933] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:32.890440  2586 tablet_copy_client.cc:323] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:32.891806  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 8ab255080f74412f87943c46e12f9f06 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:32.892340  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 8ab255080f74412f87943c46e12f9f06 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-8ab255080f74412f87943c46e12f9f06
I20260709 12:58:32.900465  1551 tablet_copy_source_session.cc:215] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.904116  2586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab255080f74412f87943c46e12f9f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:32.918920  2586 tablet_copy_client.cc:806] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:32.919497  2586 tablet_copy_client.cc:670] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:32.922660  2586 tablet_copy_client.cc:538] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:32.931309  2586 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:32.942894  2583 ts_tablet_manager.cc:933] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:32.950544  2583 tablet_copy_client.cc:323] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:32.952425  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 6b3d048f5d2644a6b635da71cc6c7a8b from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:32.953123  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 6b3d048f5d2644a6b635da71cc6c7a8b from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-6b3d048f5d2644a6b635da71cc6c7a8b
I20260709 12:58:32.964783  2586 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:32.965765  2586 tablet_bootstrap.cc:492] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:32.966465  2586 ts_tablet_manager.cc:1403] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.014s
I20260709 12:58:32.966207  1551 tablet_copy_source_session.cc:215] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.969209  2583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3d048f5d2644a6b635da71cc6c7a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:32.970182  2586 raft_consensus.cc:359] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.971040  2586 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:32.971637  2586 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:32.973965  2586 ts_tablet_manager.cc:1434] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:58:32.977819  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-8ab255080f74412f87943c46e12f9f06 received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:32.978206  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-8ab255080f74412f87943c46e12f9f06 on tablet 8ab255080f74412f87943c46e12f9f06 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:33.002767  2583 tablet_copy_client.cc:806] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:33.003453  2583 tablet_copy_client.cc:670] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:33.007557  2583 tablet_copy_client.cc:538] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:33.016537  2583 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:33.037575  2583 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:33.038419  2583 tablet_bootstrap.cc:492] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:33.039029  2583 ts_tablet_manager.cc:1403] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 12:58:33.041888  2583 raft_consensus.cc:359] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:33.042728  2583 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:33.043349  2583 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:33.046130  2583 ts_tablet_manager.cc:1434] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:58:33.048404  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-6b3d048f5d2644a6b635da71cc6c7a8b received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:33.048770  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-6b3d048f5d2644a6b635da71cc6c7a8b on tablet 6b3d048f5d2644a6b635da71cc6c7a8b with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:33.135531  2310 raft_consensus.cc:1217] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.275226  2310 raft_consensus.cc:1217] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.415706  2310 raft_consensus.cc:1217] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.489763  2310 raft_consensus.cc:1217] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.616978  2591 raft_consensus.cc:1064] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:33.619521  2591 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:33.626088  1612 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.626684  2310 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.627419  2595 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.626710  1541 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.628387  2540 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.629200  2591 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.648299  2540 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.653582  1612 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.658156  2310 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.661938  1541 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.673175  1437 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.707655  2540 raft_consensus.cc:1064] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:33.716374  2540 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:33.731731  2310 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.734899  2565 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.748795  1541 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.751524  1614 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.740597  1682 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:33.759112  2591 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.759914  2540 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.764928  1541 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:33.766481  2595 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:33.767493  2310 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:33.769438  2595 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:33.776909  2540 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.781172  2565 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.783241  1533 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.801059  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 710eea1b85d441dcabbb12e33e31ae6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:33.814947  2308 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.816612  1541 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.812168  1436 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:33.807689  2310 raft_consensus.cc:2955] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.850132  1435 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.853052  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 710eea1b85d441dcabbb12e33e31ae6b with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:33.860519  2575 raft_consensus.cc:1064] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:33.861167  2611 tablet_replica.cc:333] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:33.863148  2575 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:33.865899  1614 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.886974  1682 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:33.892869  2310 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:33.894326  2605 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.895479  1614 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:33.896711  2605 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.868641  2611 raft_consensus.cc:2243] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.898139  2611 raft_consensus.cc:2272] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.903613  2565 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.906651  1607 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.911099  2611 ts_tablet_manager.cc:1916] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:33.916003  2310 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.916929  1682 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.917538  2596 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.918306  1612 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.919958  2545 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.920776  2596 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.929138  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08d3893a9300428592d3ce769b91a4db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:33.943209  2308 raft_consensus.cc:2955] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.955284  1435 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:33.967510  2613 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.976681  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 08d3893a9300428592d3ce769b91a4db with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:33.982443  1607 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:33.986951  2611 ts_tablet_manager.cc:1929] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:33.987406  2611 log.cc:1199] T 710eea1b85d441dcabbb12e33e31ae6b P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/710eea1b85d441dcabbb12e33e31ae6b
I20260709 12:58:33.992726  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 710eea1b85d441dcabbb12e33e31ae6b (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:33.997453  2617 tablet_replica.cc:333] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:33.998934  2617 raft_consensus.cc:2243] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.003517  2617 raft_consensus.cc:2272] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.002022  1682 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.006093  2310 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.007117  2617 ts_tablet_manager.cc:1916] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.002650  2596 raft_consensus.cc:1064] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:34.010138  2596 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:34.018487  1439 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.025946  2307 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:34.027699  1614 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:34.028983  2545 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:34.029249  2617 ts_tablet_manager.cc:1929] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.029408  1688 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:34.030545  2617 log.cc:1199] T 08d3893a9300428592d3ce769b91a4db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/08d3893a9300428592d3ce769b91a4db
I20260709 12:58:34.033454  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet 08d3893a9300428592d3ce769b91a4db (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:34.035118  2575 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:34.040289  2545 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:34.091365  1688 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.091368  2596 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.128892  1533 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:34.138463  1614 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.137467  1435 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.138520  2308 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.141916  2545 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.145829  2596 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.149145  2307 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.155890  1612 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.150964  1614 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.162587  2307 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.158707  2619 raft_consensus.cc:2955] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.179865  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b3d048f5d2644a6b635da71cc6c7a8b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:34.185827  1437 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.197906  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b3d048f5d2644a6b635da71cc6c7a8b with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:34.203207  1533 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:34.210510  2624 tablet_replica.cc:333] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:34.211835  2624 raft_consensus.cc:2243] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.212567  2307 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.212671  2624 raft_consensus.cc:2272] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.213948  1614 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.214504  2619 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.215353  2596 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.216516  2624 ts_tablet_manager.cc:1916] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.221297  2545 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.223013  1614 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.224460  2308 raft_consensus.cc:2955] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.235018  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ab255080f74412f87943c46e12f9f06 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:34.240391  1436 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:34.251982  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ab255080f74412f87943c46e12f9f06 with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:34.257634  2624 ts_tablet_manager.cc:1929] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.258088  2624 log.cc:1199] T 6b3d048f5d2644a6b635da71cc6c7a8b P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/6b3d048f5d2644a6b635da71cc6c7a8b
I20260709 12:58:34.259752  2624 tablet_replica.cc:333] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:34.259649  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 6b3d048f5d2644a6b635da71cc6c7a8b (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:34.260752  2624 raft_consensus.cc:2243] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.261453  2624 raft_consensus.cc:2272] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.264635  2624 ts_tablet_manager.cc:1916] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.275290  2624 ts_tablet_manager.cc:1929] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.275630  2624 log.cc:1199] T 8ab255080f74412f87943c46e12f9f06 P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/8ab255080f74412f87943c46e12f9f06
I20260709 12:58:34.276875  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 8ab255080f74412f87943c46e12f9f06 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:35.325320  1688 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:35.331800  1614 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:35.332294  1653 consensus_peers.cc:597] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea39a99a63554d4dbb26f49a38585b4e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.332774  1539 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.334183  2610 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:35.335268  2627 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:35.346392  2625 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.349154  1533 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.353041  1612 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.366228  1688 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:35.375512  1437 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.382920  1539 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:35.383914  1653 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c43a3d11aec04f86a107e64e2a5bc263. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.384959  1613 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.386780  2625 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.388512  2625 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.400509  2595 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.406483  1539 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.414656  1612 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.415802  1688 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:35.423975  1653 consensus_peers.cc:597] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ea53f766b5a4fd081983e46c7fd5da9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.426182  1612 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.427106  1533 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.429191  2595 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:35.430666  2627 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.452437  1436 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.453261  2627 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.457149  1613 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.476866  1688 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:35.484676  1612 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:35.487421  1653 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f37c8720262488fbc2c2923a7e60e16. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.490314  1533 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:35.489864  1539 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.496686  2628 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:35.499203  2610 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.504380  1436 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.535300  2627 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.536721  1613 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.539659  1539 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.561971  1436 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:35.773576  2647 ts_tablet_manager.cc:933] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:35.777176  2647 tablet_copy_client.cc:323] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:35.779202  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet ea39a99a63554d4dbb26f49a38585b4e from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:35.779793  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet ea39a99a63554d4dbb26f49a38585b4e from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-ea39a99a63554d4dbb26f49a38585b4e
I20260709 12:58:35.790817  1700 tablet_copy_source_session.cc:215] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:35.792382  2649 ts_tablet_manager.cc:933] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:35.794675  2647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea39a99a63554d4dbb26f49a38585b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.800711  2649 tablet_copy_client.cc:323] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:35.803009  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet c43a3d11aec04f86a107e64e2a5bc263 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:35.803529  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet c43a3d11aec04f86a107e64e2a5bc263 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-c43a3d11aec04f86a107e64e2a5bc263
I20260709 12:58:35.811244  1700 tablet_copy_source_session.cc:215] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:35.813699  2647 tablet_copy_client.cc:806] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:35.814369  2649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43a3d11aec04f86a107e64e2a5bc263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.814406  2647 tablet_copy_client.cc:670] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:35.818900  2647 tablet_copy_client.cc:538] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:35.828869  2647 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:35.830523  2649 tablet_copy_client.cc:806] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:35.831099  2649 tablet_copy_client.cc:670] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:35.834273  2649 tablet_copy_client.cc:538] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:35.842828  2649 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:36.038949  2649 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.039858  2649 tablet_bootstrap.cc:492] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:36.043146  2647 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.044183  2647 tablet_bootstrap.cc:492] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:36.044890  2647 ts_tablet_manager.cc:1403] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.216s	user 0.077s	sys 0.097s
I20260709 12:58:36.048029  2647 raft_consensus.cc:359] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.048928  2647 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:36.050635  2647 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.070106  2649 ts_tablet_manager.cc:1403] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.227s	user 0.088s	sys 0.069s
I20260709 12:58:36.075613  2649 raft_consensus.cc:359] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.076785  2649 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:36.077636  2649 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.086843  2647 ts_tablet_manager.cc:1434] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.042s	user 0.022s	sys 0.012s
I20260709 12:58:36.087136  2649 ts_tablet_manager.cc:1434] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:58:36.088824  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-c43a3d11aec04f86a107e64e2a5bc263 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:36.089284  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-c43a3d11aec04f86a107e64e2a5bc263 on tablet c43a3d11aec04f86a107e64e2a5bc263 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:36.095556  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-ea39a99a63554d4dbb26f49a38585b4e received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:36.095950  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-ea39a99a63554d4dbb26f49a38585b4e on tablet ea39a99a63554d4dbb26f49a38585b4e with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:36.101004  2649 ts_tablet_manager.cc:933] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:36.112202  2649 tablet_copy_client.cc:323] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:36.115357  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 4ea53f766b5a4fd081983e46c7fd5da9 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:36.115882  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 4ea53f766b5a4fd081983e46c7fd5da9 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-4ea53f766b5a4fd081983e46c7fd5da9
I20260709 12:58:36.125540  2655 ts_tablet_manager.cc:933] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:36.126168  1700 tablet_copy_source_session.cc:215] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:36.129192  2655 tablet_copy_client.cc:323] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:36.131466  2649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea53f766b5a4fd081983e46c7fd5da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.135258  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 3f37c8720262488fbc2c2923a7e60e16 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:36.135890  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 3f37c8720262488fbc2c2923a7e60e16 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-3f37c8720262488fbc2c2923a7e60e16
I20260709 12:58:36.143239  1700 tablet_copy_source_session.cc:215] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:36.146215  2655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f37c8720262488fbc2c2923a7e60e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.152534  2649 tablet_copy_client.cc:806] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:36.153123  2649 tablet_copy_client.cc:670] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:36.156158  2649 tablet_copy_client.cc:538] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:36.162132  2655 tablet_copy_client.cc:806] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:36.162698  2655 tablet_copy_client.cc:670] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:36.166417  2649 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:36.166666  2655 tablet_copy_client.cc:538] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:36.175740  2655 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:36.184486  2308 raft_consensus.cc:1217] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:36.196933  2649 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.198150  2649 tablet_bootstrap.cc:492] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:36.198719  2649 ts_tablet_manager.cc:1403] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.004s
I20260709 12:58:36.201012  2649 raft_consensus.cc:359] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.201615  2649 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:36.202366  2649 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.204928  2649 ts_tablet_manager.cc:1434] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:58:36.209092  2655 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.209389  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-4ea53f766b5a4fd081983e46c7fd5da9 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:36.209846  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-4ea53f766b5a4fd081983e46c7fd5da9 on tablet 4ea53f766b5a4fd081983e46c7fd5da9 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:36.210145  2655 tablet_bootstrap.cc:492] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:36.210868  2655 ts_tablet_manager.cc:1403] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.018s
I20260709 12:58:36.214155  2655 raft_consensus.cc:359] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.214952  2655 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:36.215548  2655 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:36.217880  2655 ts_tablet_manager.cc:1434] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:58:36.219378  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-3f37c8720262488fbc2c2923a7e60e16 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:36.219769  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-3f37c8720262488fbc2c2923a7e60e16 on tablet 3f37c8720262488fbc2c2923a7e60e16 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:36.300359  2308 raft_consensus.cc:1217] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:36.550431  2307 raft_consensus.cc:1217] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:36.668839  2308 raft_consensus.cc:1217] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:58:36.744743  2625 raft_consensus.cc:1064] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:36.746693  2625 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:36.755132  2308 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:36.756348  1541 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:36.757104  2661 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:36.757927  1612 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:36.757957  2628 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:36.761866  2628 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:36.777081  2661 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.779048  1612 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.781577  1541 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.788828  2308 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.795225  1436 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.855136  1681 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:36.862223  2307 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:36.864238  1541 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:36.864277  2628 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:36.872555  2610 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:36.875028  2627 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.891429  2628 raft_consensus.cc:1064] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:36.903824  1541 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.905972  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c43a3d11aec04f86a107e64e2a5bc263 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:36.914407  2628 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:36.917877  2307 raft_consensus.cc:2955] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:36.925482  1437 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:36.944475  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet c43a3d11aec04f86a107e64e2a5bc263 with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:36.962265  2674 tablet_replica.cc:333] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
W20260709 12:58:36.968792  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47173.4us
I20260709 12:58:36.970378  2674 raft_consensus.cc:2243] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.971959  2674 raft_consensus.cc:2272] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.978950  2674 ts_tablet_manager.cc:1916] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:36.988015  2307 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:36.988687  1614 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:36.989660  2625 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:36.990546  2627 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:36.995836  2674 ts_tablet_manager.cc:1929] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:36.996469  2674 log.cc:1199] T c43a3d11aec04f86a107e64e2a5bc263 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/c43a3d11aec04f86a107e64e2a5bc263
I20260709 12:58:36.998425  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet c43a3d11aec04f86a107e64e2a5bc263 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:37.000461  1541 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.002342  2628 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.003908  2627 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.008605  2307 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.031548  1435 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.035852  1541 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.038241  1614 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.061067  1688 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:37.073407  2307 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.075438  2625 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.078287  1614 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.080157  2628 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.086050  2625 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.087428  2307 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.096997  2628 raft_consensus.cc:1064] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:37.099300  2628 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:37.102169  1439 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.112596  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea39a99a63554d4dbb26f49a38585b4e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:37.117218  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet ea39a99a63554d4dbb26f49a38585b4e with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:37.117482  1614 raft_consensus.cc:2955] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.128103  2680 tablet_replica.cc:333] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:37.133080  2625 raft_consensus.cc:1064] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:37.135548  2625 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:37.138804  2308 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.139071  2680 raft_consensus.cc:2243] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:37.139858  2680 raft_consensus.cc:2272] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:37.140576  2671 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.145080  1612 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:37.145676  2680 ts_tablet_manager.cc:1916] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:37.146415  1541 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:37.146836  2661 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.149487  1612 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.151775  2661 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.160022  2627 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.161748  1538 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.161953  2680 ts_tablet_manager.cc:1929] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:37.162403  2680 log.cc:1199] T ea39a99a63554d4dbb26f49a38585b4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/ea39a99a63554d4dbb26f49a38585b4e
I20260709 12:58:37.165184  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet ea39a99a63554d4dbb26f49a38585b4e (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:37.166883  2308 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:37.167403  2627 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.173247  2628 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.199597  2671 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.198802  2627 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.205395  2308 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.216500  2307 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.217777  1541 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.230877  1439 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:37.220542  1538 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.238808  1612 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.242344  1613 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.260366  1681 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:37.273516  2308 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:37.282697  1541 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:37.283416  2661 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.285101  2610 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.279067  1439 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.290874  2610 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.294767  2308 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.301496  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f37c8720262488fbc2c2923a7e60e16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:37.308109  1681 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:37.317106  1436 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.324090  2307 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.324265  1541 raft_consensus.cc:2955] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.328756  2628 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.334883  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f37c8720262488fbc2c2923a7e60e16 with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:37.335927  2674 tablet_replica.cc:333] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:37.336503  1614 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.337136  2674 raft_consensus.cc:2243] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:37.337805  2674 raft_consensus.cc:2272] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:37.340888  2661 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.343937  2671 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.348804  2308 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.349346  2674 ts_tablet_manager.cc:1916] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:37.363016  1614 raft_consensus.cc:2955] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:37.504899  2674 ts_tablet_manager.cc:1929] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:58:37.505451  2674 log.cc:1199] T 3f37c8720262488fbc2c2923a7e60e16 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/3f37c8720262488fbc2c2923a7e60e16
I20260709 12:58:38.135219  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ea53f766b5a4fd081983e46c7fd5da9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:38.173997  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 3f37c8720262488fbc2c2923a7e60e16 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
W20260709 12:58:38.225696  1426 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 51726us
I20260709 12:58:38.254012  1436 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:38.370704  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ea53f766b5a4fd081983e46c7fd5da9 with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:38.372516  2709 tablet_replica.cc:333] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:38.373608  2709 raft_consensus.cc:2243] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:38.374804  2709 raft_consensus.cc:2272] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:38.377504  2709 ts_tablet_manager.cc:1916] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:38.388672  2709 ts_tablet_manager.cc:1929] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:38.389055  2709 log.cc:1199] T 4ea53f766b5a4fd081983e46c7fd5da9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/4ea53f766b5a4fd081983e46c7fd5da9
I20260709 12:58:38.390400  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet 4ea53f766b5a4fd081983e46c7fd5da9 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
W20260709 12:58:38.550182  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08001db120 after lost signal to thread 434
W20260709 12:58:38.551237  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08000b90c0 after lost signal to thread 1473
W20260709 12:58:38.552372  1562 debug-util.cc:398] Leaking SignalData structure 0x7b0800328ba0 after lost signal to thread 1565
W20260709 12:58:38.553349  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5f20 after lost signal to thread 1640
W20260709 12:58:38.554404  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08001acf40 after lost signal to thread 1714
W20260709 12:58:38.555446  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4140 after lost signal to thread 2334
I20260709 12:58:39.468330  1536 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:39.477092  1614 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:39.477888  1504 consensus_peers.cc:597] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d2479e7644f4a63a2e17a1e8ba94dcc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.478504  2702 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:39.480520  1685 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.481637  2702 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.491096  2710 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.494766  1689 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.506029  1614 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.508584  1538 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:39.512315  1439 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.532634  1689 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.533208  1612 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.534827  2702 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.536791  2696 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:39.537953  1504 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 781a7e0898fc40c4a08fd46ca3bf5f17. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.560197  2702 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.569389  1689 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.595175  1689 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:39.598767  1614 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
W20260709 12:58:39.602934  1653 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a95518ca56c246da9d064efb1f0fb391. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.606290  1538 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.606738  1609 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.608788  2705 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.613714  2705 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.650009  2705 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.653376  1436 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.688205  1609 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.688688  1689 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:39.711207  1439 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:39.729404  1653 consensus_peers.cc:597] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b36f171d98ea4aedbd87b5f98c2c0127. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.732538  1614 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.733748  1536 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.735937  1538 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.743155  2610 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.747263  2705 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.767393  2610 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.770151  1609 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.787241  1435 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.804016  1538 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:39.884297  2731 ts_tablet_manager.cc:933] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:39.886600  2731 tablet_copy_client.cc:323] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:39.888408  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:39.888921  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 0d2479e7644f4a63a2e17a1e8ba94dcc from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-0d2479e7644f4a63a2e17a1e8ba94dcc
I20260709 12:58:39.897118  1551 tablet_copy_source_session.cc:215] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:39.910989  2731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:39.930039  2731 tablet_copy_client.cc:806] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:39.930734  2731 tablet_copy_client.cc:670] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:39.934660  2731 tablet_copy_client.cc:538] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:39.942489  2731 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:39.974720  2731 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:39.975741  2731 tablet_bootstrap.cc:492] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:39.976522  2731 ts_tablet_manager.cc:1403] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.011s
I20260709 12:58:39.979879  2731 raft_consensus.cc:359] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:39.981079  2731 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:39.981818  2731 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:39.997855  2731 ts_tablet_manager.cc:1434] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:58:39.999821  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-0d2479e7644f4a63a2e17a1e8ba94dcc received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:40.000321  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-0d2479e7644f4a63a2e17a1e8ba94dcc on tablet 0d2479e7644f4a63a2e17a1e8ba94dcc with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:40.018582  2731 ts_tablet_manager.cc:933] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 12:58:40.022799  2731 tablet_copy_client.cc:323] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 12:58:40.024590  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 781a7e0898fc40c4a08fd46ca3bf5f17 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 12:58:40.025137  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 781a7e0898fc40c4a08fd46ca3bf5f17 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-781a7e0898fc40c4a08fd46ca3bf5f17
I20260709 12:58:40.036016  1551 tablet_copy_source_session.cc:215] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:40.040527  2731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781a7e0898fc40c4a08fd46ca3bf5f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:40.062182  2731 tablet_copy_client.cc:806] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:40.062928  2731 tablet_copy_client.cc:670] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:40.070684  2736 ts_tablet_manager.cc:933] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:40.088366  2731 tablet_copy_client.cc:538] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:40.099632  2731 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:40.090272  2736 tablet_copy_client.cc:323] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:40.106331  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet a95518ca56c246da9d064efb1f0fb391 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:40.106995  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet a95518ca56c246da9d064efb1f0fb391 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-a95518ca56c246da9d064efb1f0fb391
I20260709 12:58:40.116104  1700 tablet_copy_source_session.cc:215] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:40.135079  2731 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:40.176723  2736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95518ca56c246da9d064efb1f0fb391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:40.182824  2731 tablet_bootstrap.cc:492] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:40.188192  2731 ts_tablet_manager.cc:1403] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.008s
I20260709 12:58:40.185473  2740 ts_tablet_manager.cc:933] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:40.206688  2731 raft_consensus.cc:359] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:40.207559  2731 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:40.208196  2731 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:40.210290  2740 tablet_copy_client.cc:323] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:40.221930  2736 tablet_copy_client.cc:806] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:40.223721  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet b36f171d98ea4aedbd87b5f98c2c0127 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:40.224361  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet b36f171d98ea4aedbd87b5f98c2c0127 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-b36f171d98ea4aedbd87b5f98c2c0127
I20260709 12:58:40.241689  2736 tablet_copy_client.cc:670] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:40.255396  2736 tablet_copy_client.cc:538] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:40.266359  1700 tablet_copy_source_session.cc:215] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:40.270330  2740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f171d98ea4aedbd87b5f98c2c0127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:40.278486  2309 raft_consensus.cc:1217] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.279393  2731 ts_tablet_manager.cc:1434] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.088s	user 0.002s	sys 0.005s
I20260709 12:58:40.281657  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-781a7e0898fc40c4a08fd46ca3bf5f17 received from {username='slave'} at 127.0.0.1:52700
I20260709 12:58:40.282061  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-781a7e0898fc40c4a08fd46ca3bf5f17 on tablet 781a7e0898fc40c4a08fd46ca3bf5f17 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:40.334998  2736 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
W20260709 12:58:40.356805  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48678.6us
I20260709 12:58:40.366954  2740 tablet_copy_client.cc:806] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:40.372007  2740 tablet_copy_client.cc:670] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:40.377249  2740 tablet_copy_client.cc:538] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:40.391074  2740 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:40.400180  2736 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:40.409315  2736 tablet_bootstrap.cc:492] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:40.410138  2736 ts_tablet_manager.cc:1403] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.075s	user 0.024s	sys 0.004s
I20260709 12:58:40.414453  2736 raft_consensus.cc:359] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:40.420989  2736 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:40.422561  2736 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:40.425446  2736 ts_tablet_manager.cc:1434] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:40.431433  2740 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:40.432564  2740 tablet_bootstrap.cc:492] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:40.433800  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-a95518ca56c246da9d064efb1f0fb391 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:40.434273  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-a95518ca56c246da9d064efb1f0fb391 on tablet a95518ca56c246da9d064efb1f0fb391 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:40.433429  2740 ts_tablet_manager.cc:1403] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.014s
I20260709 12:58:40.439014  2740 raft_consensus.cc:359] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:40.440070  2740 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:40.440884  2740 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:40.444044  2740 ts_tablet_manager.cc:1434] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:58:40.445751  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-b36f171d98ea4aedbd87b5f98c2c0127 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:40.446167  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-b36f171d98ea4aedbd87b5f98c2c0127 on tablet b36f171d98ea4aedbd87b5f98c2c0127 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:40.574736  2309 raft_consensus.cc:1217] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.587845  2309 raft_consensus.cc:1217] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.599308  2309 raft_consensus.cc:1217] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.866824  2720 raft_consensus.cc:1064] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:40.869398  2720 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:40.885344  1612 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.887401  2744 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.893693  2307 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.898679  2739 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.901930  1689 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.906387  2720 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.930020  2744 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:40.947463  2308 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:40.955116  1612 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:40.964671  1435 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:40.975028  2747 raft_consensus.cc:1064] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:40.982124  2747 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:40.989675  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 85213.2us
I20260709 12:58:41.010191  1689 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.016955  2308 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.018683  1612 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.019042  2729 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.020550  2743 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.027544  1538 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.029312  2743 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.032775  2743 raft_consensus.cc:1064] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:41.035269  2743 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.044037  2759 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.056391  2308 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.065275  2751 raft_consensus.cc:1064] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:41.068154  2751 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.104769  1612 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.106384  2702 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.120676  1439 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.129237  2307 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.129544  1538 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.137624  2767 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:41.139231  2308 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.140867  2751 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:41.156436  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 63420.5us
I20260709 12:58:41.163564  1609 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.165032  1541 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.165225  1609 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.177541  1685 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.176030  1536 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.180464  2702 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.188334  2761 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:41.188562  1612 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.190163  2751 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.193970  1685 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.195140  2308 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.195005  2747 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.196914  2744 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.198590  2744 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.200877  2307 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.202946  2743 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.203768  2307 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.210593   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:41.210270  1614 raft_consensus.cc:2955] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.228021  1613 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.254853  1437 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.280180  2761 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:58:41.347296  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:41.347481  2759 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:58:41.351126  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 69183us
I20260709 12:58:41.357136  2751 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:58:41.361392  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 81551.9us
I20260709 12:58:41.362779  2309 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.392638  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b36f171d98ea4aedbd87b5f98c2c0127 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.398277  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d2479e7644f4a63a2e17a1e8ba94dcc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.396916  2780 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.424003  2782 tablet_replica.cc:333] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:41.425110  2782 raft_consensus.cc:2243] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.426072  2782 raft_consensus.cc:2272] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.439318  1536 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.442998  1436 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.444850  2782 ts_tablet_manager.cc:1916] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.449725  1682 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.456712  1616 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.455576  1613 raft_consensus.cc:2955] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.465565  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet b36f171d98ea4aedbd87b5f98c2c0127 with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:41.517987  1613 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:58:41.528410  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 152250us
I20260709 12:58:41.537195  2309 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.543458  1437 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.568094  2309 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.598491  2788 tablet_replica.cc:333] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 12:58:41.599576  2788 raft_consensus.cc:2243] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.600327  2788 raft_consensus.cc:2272] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.600680  1435 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 2 to 3, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.620740  2788 ts_tablet_manager.cc:1916] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.623906  2782 ts_tablet_manager.cc:1929] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.637868  1682 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.638440  2782 log.cc:1199] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/0d2479e7644f4a63a2e17a1e8ba94dcc
I20260709 12:58:41.656376  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 0d2479e7644f4a63a2e17a1e8ba94dcc (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:41.656921  2309 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.658874  2766 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:41.665096  1536 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.668890  2788 ts_tablet_manager.cc:1929] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.669417  2788 log.cc:1199] T b36f171d98ea4aedbd87b5f98c2c0127 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/b36f171d98ea4aedbd87b5f98c2c0127
I20260709 12:58:41.668392  2768 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.671774  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet b36f171d98ea4aedbd87b5f98c2c0127 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:41.672963  1616 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.675427  2778 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:41.680323  2306 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.682094  2309 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.684522  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a95518ca56c246da9d064efb1f0fb391 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.684767  2779 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:41.694380  1439 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.695672  2751 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.702162  2306 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.706324  1613 raft_consensus.cc:2955] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.716041  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 781a7e0898fc40c4a08fd46ca3bf5f17 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.721521  1537 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.730744  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet a95518ca56c246da9d064efb1f0fb391 with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46804
I20260709 12:58:41.735536  1439 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 3 to 4, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.745424  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3306db491bf34b228d1100fd9c826528"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:41.746117  1685 raft_consensus.cc:606] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:41.758646  2789 tablet_replica.cc:333] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 12:58:41.763965  2766 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:41.766839  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 781a7e0898fc40c4a08fd46ca3bf5f17 with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57974
I20260709 12:58:41.767805  2782 tablet_replica.cc:333] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 12:58:41.769098  2782 raft_consensus.cc:2243] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.769814  2782 raft_consensus.cc:2272] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.770969  2766 raft_consensus.cc:993] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:41.771449  2766 raft_consensus.cc:1081] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:41.771883  2789 raft_consensus.cc:2243] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.772614  2789 raft_consensus.cc:2272] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.774061  2782 ts_tablet_manager.cc:1916] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.775326  2789 ts_tablet_manager.cc:1916] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.782730  1537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3306db491bf34b228d1100fd9c826528"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34874
I20260709 12:58:41.783376  1537 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:41.783716  1537 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.785651  1541 raft_consensus.cc:2955] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:41.796130  1537 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:41.798632  1537 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:41.799229  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:41.800884  1614 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.800953  2789 ts_tablet_manager.cc:1929] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.801483  2789 log.cc:1199] T a95518ca56c246da9d064efb1f0fb391 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/a95518ca56c246da9d064efb1f0fb391
I20260709 12:58:41.803578  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet a95518ca56c246da9d064efb1f0fb391 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:41.806740  1614 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:41.809798  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:41.810638  2751 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:41.811738  2751 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:41.812618  2751 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:41.824563  2782 ts_tablet_manager.cc:1929] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.825212  2782 log.cc:1199] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/781a7e0898fc40c4a08fd46ca3bf5f17
I20260709 12:58:41.830255  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9059b4be41c340278068c13696d1000e"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:41.830855  1685 raft_consensus.cc:606] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:41.832438  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 781a7e0898fc40c4a08fd46ca3bf5f17 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 12:58:41.842542  1436 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.855608  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:41.856190  1685 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:41.856516  1685 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:41.857223  1685 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:41.858255  1685 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.860862  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:41.861439  1682 raft_consensus.cc:606] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:41.864996  1685 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:41.867352  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:41.867928  1682 raft_consensus.cc:606] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:41.875064  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:41.875550  1685 raft_consensus.cc:606] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:41.876600   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:41.877602   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:41.950001  2759 raft_consensus.cc:993] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:41.950512  2729 raft_consensus.cc:1081] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:41.952086  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:56280
I20260709 12:58:41.952584  2309 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:41.952870  2309 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.958194  2309 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.960139  2309 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:41.961027  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:41.961174  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:41.961665  1614 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.961746  1685 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:41.962179  1685 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:41.962893  1685 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.964026  1685 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.971184  1614 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:41.971900  1685 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:41.972482  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:41.973580  2734 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:41.974584  2734 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:41.975451  2734 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:41.982885  2759 raft_consensus.cc:993] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:41.983372  2759 raft_consensus.cc:1081] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:41.983022  1436 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.985096  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34874
I20260709 12:58:41.985643  1541 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:41.986014  1541 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.993403  1541 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:41.996193  1541 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:41.997118  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:41.997676  1614 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.997573  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:41.998247  1685 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:41.998576  1685 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:41.999328  1685 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:42.000598  1685 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.004582  1614 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:42.006749  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:42.007440  2779 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:42.007894  2779 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:42.008006  1685 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:42.008862  2779 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:42.029004  1436 catalog_manager.cc:5697] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.096196  2729 raft_consensus.cc:993] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower d3b488cf00f7497ea0bf5964b99f6e0e to start an election
I20260709 12:58:42.096751  2759 raft_consensus.cc:1081] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer d3b488cf00f7497ea0bf5964b99f6e0e to start an election
I20260709 12:58:42.098539  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:46810
I20260709 12:58:42.099896  1614 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:42.100260  1614 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.107277  1614 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:42.111830  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:42.112471  1537 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.119097  1537 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:42.111407  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:42.120479  1685 raft_consensus.cc:3055] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:42.120396  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:42.121291  1685 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:42.121876  2776 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:42.122380  2776 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:42.122243  1685 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:42.123378  2776 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:42.124688  1685 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.148579  1614 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:42.154599  1685 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:42.154275  1436 catalog_manager.cc:5697] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.226888  1616 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.228217  2751 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.246790  1685 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.248394  2751 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:58:42.256003  2759 raft_consensus.cc:993] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:42.256697  2759 raft_consensus.cc:1081] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:42.259148  2309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9059b4be41c340278068c13696d1000e"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:56280
I20260709 12:58:42.259999  2309 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:42.260730  2309 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.300151  2309 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:42.315816  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:42.316695  1613 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.327033  1613 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:42.329293  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:42.331007  1682 raft_consensus.cc:3055] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:42.331164  1614 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:42.331367  1682 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:42.332206  1682 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:42.333160  1682 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.336207  2276 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:42.337702  2734 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:42.338196  2734 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:42.344710  2734 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:42.355967  2309 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:42.372434  1682 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:42.402696  1435 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:42.474798  1614 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:42.475976  2734 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:42.478121  1614 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.480556  2751 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.495354  1685 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:42.497141  2734 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:42.500258  1681 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.511159  2784 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.593528  1537 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.595027  2776 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.595449  1681 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.597168  2785 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.821344  1689 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:42.822790  2791 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:42.846185  1614 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:42.847491  2734 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:42.880439   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:42.943440  1681 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:42.961691  1653 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a5f5933777f457e99f4a6b1781ec12b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.975337  1614 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.985445   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:42.985467  1541 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.986405  2768 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:42.989207  2766 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.084141  2766 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.098446  1609 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.102034  1539 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.135099  1689 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:43.135514  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:58:43.145599  1613 raft_consensus.cc:606] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:43.119956  1435 catalog_manager.cc:5697] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.166262  2776 raft_consensus.cc:993] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:43.166813  2776 raft_consensus.cc:1081] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Signalling peer c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:43.169986  2306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:56290
I20260709 12:58:43.170528  2306 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.170907  2306 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.181830  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:43.182546  1539 raft_consensus.cc:606] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Received request to transfer leadership to TS d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:43.185302  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:43.185828  1537 raft_consensus.cc:606] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:43.189652  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:43.190235  1681 raft_consensus.cc:606] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:43.191630  2306 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:43.192780  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:43.193351  1681 raft_consensus.cc:606] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:58:43.200436  1653 consensus_peers.cc:597] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff79ac342d91424db634ca7802846535. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:43.201258  1613 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:43.202572  2768 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.203485  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:43.204087  1681 raft_consensus.cc:606] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:43.208370   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:43.215423   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:43.218168  2759 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.220942  1539 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:43.222780  2816 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.229763  1613 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.236480  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:43.237059  1537 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.239367  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:43.239919  1614 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:43.240190  1614 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:43.240940  1614 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:43.242028  1614 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.233673  1539 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.259132  1609 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:43.268607  1614 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:43.269501  2306 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:43.272431  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:43.273504  2791 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:43.281448  2791 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:43.282624  2791 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:43.284044  1579 consensus_peers.cc:597] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bb16b93f1fe47b4be38ae591c62b564. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:43.284628  1689 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:43.286223  1537 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:43.286372  2692 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.293099  1537 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:43.294762  2692 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:43.325471  1437 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.319502  2759 raft_consensus.cc:993] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:43.343088  2822 raft_consensus.cc:993] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:43.343979  2824 raft_consensus.cc:1081] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:43.342609  2759 raft_consensus.cc:1081] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
W20260709 12:58:43.369374  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61118.7us
I20260709 12:58:43.394868  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34874
I20260709 12:58:43.395658  1539 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.396099  1539 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.415663  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34874
W20260709 12:58:43.417666  2826 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:58:43.419201  1541 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.419647  1541 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.438277  2692 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.455032  1689 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.439615  1539 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:43.481526  1541 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:43.484107  1541 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:43.467494  1439 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:43.494048  1539 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:43.499574  2832 ts_tablet_manager.cc:933] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:43.654752  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 223304us
I20260709 12:58:43.657472  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:43.658110  1681 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:43.658452  1681 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:43.662103  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:43.662726  1689 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:43.663038  1689 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:43.673916  1681 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:43.677728  1681 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.676618  1689 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:43.683298  1689 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.701035  1681 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:43.706231  1689 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:43.756896  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:43.757474  1613 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.757506  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:43.762446  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:43.764825  1613 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:43.766784  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:43.767504  1613 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.757113  2832 tablet_copy_client.cc:323] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:43.766129  2779 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:43.776013  1613 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:43.777804  2784 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:43.785480  2779 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:58:43.793244  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 243717us
I20260709 12:58:43.793346  2779 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:43.801043  2784 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:43.801388  1689 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:43.801988  2784 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:43.815573  2843 raft_consensus.cc:993] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower d3b488cf00f7497ea0bf5964b99f6e0e to start an election
I20260709 12:58:43.816120  2843 raft_consensus.cc:1081] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Signalling peer d3b488cf00f7497ea0bf5964b99f6e0e to start an election
I20260709 12:58:43.819336  1614 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:43.815611  1613 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:58:43.824738  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 75925us
I20260709 12:58:44.280218   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:44.689108  2854 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.689747  2854 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.697576  2854 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.706465   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:44.743791  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.009s	sys 0.030s
W20260709 12:58:44.744292  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.011s	sys 0.030s
W20260709 12:58:44.744573  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 926633us
I20260709 12:58:44.756656  2857 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.757526  2857 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:44.759908  2858 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:43.831847  1538 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:44.767484  2858 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.766119  2857 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.769933  2858 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.770044  2857 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:44.770699  2857 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.772738  2857 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.789758  2861 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.791891  2861 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.798689  2861 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.801630  2863 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.804117  2779 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.804749  2779 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.805316  2857 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.805824  2857 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.807559  2858 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.807716  2857 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:44.808092  2858 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.810503  2858 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.808830  2779 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.811369  2863 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.825412  1609 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:44.826336  2865 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.826798  2865 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.828442  2865 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.843133  2863 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.845186  2861 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.845781  2861 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:44.847898  2861 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.848457  2776 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:44.848973  2776 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.844511  2864 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.849962  2864 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.851003  2776 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:44.853442  2864 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:44.864064  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.867206  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.867995  2847 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.869603  2847 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.870685  2865 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:44.871363  2865 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.871693  2847 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:44.873675  2865 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.888331  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 960) took 1060 ms. Trace:
I20260709 12:58:44.888911  1533 rpcz_store.cc:276] 0709 12:58:43.827898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.887380 (+1059482us) service_pool.cc:224] Handling call
0709 12:58:44.887717 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.887903 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.887935 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.887981 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:44.888033 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.888094 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.888258 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.889751  2867 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:44.890411  2867 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.891683  2865 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:43.824941  1614 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:44.892799  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1648) took 1068 ms. Trace:
I20260709 12:58:44.892993  2776 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:44.893610  2776 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.892261  2865 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.895778  2776 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:44.893198  1614 rpcz_store.cc:276] 0709 12:58:43.824445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.824554 (+   109us) service_pool.cc:224] Handling call
0709 12:58:43.824782 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.892537 (+1067755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.892721 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.892959  2867 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:44.897416  2867 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.898108  2865 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.897883  2867 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:44.903494  2853 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:44.903986  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:44.904004  2853 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.907171  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:44.907208  2853 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:44.908015  2867 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:44.909505  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:44.912362  2868 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:44.913687  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:44.954680  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.006s	sys 0.007s
W20260709 12:58:44.955890  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.008s	sys 0.007s
W20260709 12:58:44.956400  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 1.14224e+06us
I20260709 12:58:44.971756  1538 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:44.973184  1436 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.976212  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:44.978773  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:44.981295  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:44.989828  2785 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:44.992555  2776 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:44.993530  2776 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.998327  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:44.999903  1613 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:45.001546  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:44.995697  2863 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.005028  2863 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:44.989892  2868 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.012683  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.013705  2868 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.001034  2785 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.020572  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:46818
I20260709 12:58:45.021910  1607 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:45.022619  1607 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:45.026422  2785 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.029875  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.030355  2776 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.031988  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.026945  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.038297  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:45.039754  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 185446us
I20260709 12:58:45.017524  2863 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.053305  2759 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.053849  2766 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.054014  2847 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.054417  2759 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.054821  2766 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.055111  2847 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.053328  2865 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.057165  2865 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.058246  2847 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.066847  2840 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.072705  2816 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.060027  2766 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.073635  2816 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.079058  2867 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.082207  2824 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.060122  2865 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.067901  2840 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.094975  2768 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.096161  2768 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:45.096179  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.093250  2865 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.103515  2838 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.104578  2868 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.107275  2822 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:45.108309  2759 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.099527  2785 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.116566  1607 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.118747  2867 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.113188  2868 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.120414  2785 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.120996  2868 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.122814  2785 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.123431  2868 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.124859  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.120458  2822 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.126497  2840 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.113159  2824 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.133190  2855 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.133559  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.139154  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:45.119800  2865 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.141878  2865 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.145905  2824 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.150362  1607 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.153558  2856 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.125380  2867 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.155522  2856 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.155588  2840 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.160743  2840 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.119065  2838 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.167165  2822 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.168320  2867 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:45.175849  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49846.9us
I20260709 12:58:45.176162  2816 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.173125  2768 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.174417  2838 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.183943  2876 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.185412  2876 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:45.189200  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.189787  2865 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:45.163985  2840 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:45.189250  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50447.7us
I20260709 12:58:45.192394  2867 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.197608  2867 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.198221  2856 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.200002  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:45.201670  2768 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.202518  2877 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.203579  2768 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.204358  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.205084  1541 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:45.205542  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.203900  2877 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.196164  2868 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.207139  2868 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.208469  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.208112  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.192417  2878 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.212608  2816 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:45.218914  2877 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.214308  2840 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.217739  2838 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:58:45.219602  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.230677  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:45.231448  2307 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:45.236603  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:45.213063  2876 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.246814  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.249956  2879 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.250911  2879 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.260166  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:45.236773  2816 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.236886  2838 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.261418  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.271725  2865 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.269330  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.272107  2877 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.272392  2865 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.272759  2877 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.274712  2865 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.275138  2877 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.228061  2840 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.277670  1614 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.277658  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.253999  2878 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.270237  2822 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.280503  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:45.278064  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 78266.7us
I20260709 12:58:45.285167  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 5a5f5933777f457e99f4a6b1781ec12b from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:45.285640  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.286166  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 5a5f5933777f457e99f4a6b1781ec12b from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-5a5f5933777f457e99f4a6b1781ec12b
I20260709 12:58:45.288394  2850 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.289081  2850 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.290799  2822 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.291939  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.295601  2778 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.296490  2850 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.297152  2854 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:45.297560  2854 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:45.297863  2855 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.298089  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:45.283655  2876 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.298854  2310 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:45.298878  2853 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.302410  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.301828  2853 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:45.293154  2867 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.307246  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.308346  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.310472  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.312709  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.313795  2816 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.318770  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.318871  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.298560  2855 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.298635  2854 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.326689  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.400270  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.394462  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.325920  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.326017  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:45.438232  1681 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:45.319621  1689 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
W20260709 12:58:45.425269  1653 consensus_peers.cc:597] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f362fd54b48400ba3c9fb8b8a405a93. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:45.327106  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:45.452798  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 105757us
I20260709 12:58:45.452922  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.453974  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.327767  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.323535  2872 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.325567  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.398329  2816 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.316807  2853 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:45.415155  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080003c360 after lost signal to thread 434
I20260709 12:58:45.472203  1541 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:45.470752  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.376645  2863 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.325040  2785 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:45.317159  2879 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.399434  2822 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.465005  2856 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.411687  2865 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.399240  2868 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.469653  1533 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:45.478000  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.399101  2859 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.375413  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:45.478933  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 60800.1us
I20260709 12:58:45.398911  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:45.329635  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.375752  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.316283  2880 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:45.480892  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61153.8us
I20260709 12:58:45.474700  2776 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.481016  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:45.481478  2779 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.481992  2861 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.325068  2778 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.483378  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:45.483554  2857 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.484383  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 52447.6us
I20260709 12:58:45.484133  2785 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.484879  2837 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.399031  2768 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.536429  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:45.438687  2876 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.471901  2862 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.494308  1681 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:45.498426  1614 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:45.505040  1684 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:45.506735  2776 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:45.469473  2850 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.519760  2854 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:45.522980  2864 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.522624  2778 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.520730  1682 raft_consensus.cc:606] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:45.518903  1616 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:45.480571  2853 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.540989  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.525318  2837 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.554427  2816 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.545296  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.555357  2861 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.556319  2857 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.558987  2834 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.546190  2862 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.500905  2879 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.375182  2873 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.552937  2856 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:45.587370  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.554116  2885 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.586905  2853 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.560662  2838 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.544795  2865 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.559778  2834 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.598541  2891 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.599598  2856 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.588292  2840 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:45.548743  2779 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:45.582284  2850 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.514408  2863 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:45.606877  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 97051.3us
I20260709 12:58:45.598658  2855 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.519379  2872 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.600078  2885 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.616930  2885 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.619284  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:45.620285  2692 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:45.620802  2692 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.621230  2692 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:45.589210  2864 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.611867  2816 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.551360  2859 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.607465  2867 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:45.639894  2881 ts_tablet_manager.cc:933] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.650854  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:45.631000  2882 ts_tablet_manager.cc:933] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:45.647550  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:45.658286  2867 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.634219  2876 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:45.647979  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800034300 after lost signal to thread 1473
I20260709 12:58:45.639793  2885 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:45.612730  2879 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.642055  2873 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:45.622977  2891 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:45.772122  2868 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.053162  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.745472  2776 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:45.686221  2778 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:46.052807  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08000343e0 after lost signal to thread 1487
I20260709 12:58:46.065253  2872 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:46.065547  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800174600 after lost signal to thread 1565
I20260709 12:58:46.057168  2856 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:45.958261  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.999034  2692 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:45.905640  2889 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:58:45.772183  2890 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:45.669646  2785 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.086774  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.906736  2862 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.059926  2863 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:45.849496  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 218544us
I20260709 12:58:46.061347  2865 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.091087  2692 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.071139  2776 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.093665  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.096875  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:45.724365  2885 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:46.099192  2273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.009s
W20260709 12:58:46.103852  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.042s
W20260709 12:58:46.104259  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.016s	sys 0.042s
I20260709 12:58:46.104401  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:46.104538  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 523253us
I20260709 12:58:46.105649  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.092362  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:46.106956  2273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.010s
I20260709 12:58:46.106451  1504 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:46.107983  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.109845  2837 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.110423  2878 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.110622  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.112774  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.113463  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.112694  2779 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.116999  2834 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.117686  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.118678  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.118837  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:46.119469  1685 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:46.119735  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800326360 after lost signal to thread 1640
I20260709 12:58:46.120200  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:46.120967  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:46.121122  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc340 after lost signal to thread 1714
I20260709 12:58:46.122843  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.097903  2861 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.122241  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.125211  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.125514  2864 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.126063  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.126933  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.127254  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.128001  2779 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.128443  2779 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.128815  2779 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.093096  2890 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.134483  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:46.138492  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.130396  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.090272  2891 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:46.130698  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc920 after lost signal to thread 1715
I20260709 12:58:46.087960  2887 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.103219  2856 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.161183  2890 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.121572  2776 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.183445  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:46.193725  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.197110  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.182782  1686 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:46.198565  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.199978  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.201342  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.192557  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:46.207942  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.010s
I20260709 12:58:46.213403  2897 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:58:46.213626  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.018s	sys 0.011s
I20260709 12:58:46.213985  2897 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.214427  2897 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.216840  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.217414  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.218312  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.198890  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.221244  2307 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:46.180269  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.202767  2873 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.226670  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.226845  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.227598  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.231913  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.224879  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.232697  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.236593  1607 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:46.235987  1612 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:46.242492  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.243990  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.244851  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.245534  1607 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:46.197053  2887 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:46.247203  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 120914us
I20260709 12:58:46.250952  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.253801  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.213464  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.255378  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.257593  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.252368  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:46.249670  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800343b00 after lost signal to thread 2334
I20260709 12:58:46.263806  1685 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:46.259150  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.266840  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:46.266981  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 93274.3us
I20260709 12:58:46.267925  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.269048  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.271396  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.272289  1613 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:46.274593  2906 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:58:46.272989  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 58935.9us
I20260709 12:58:46.275241  2906 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.281104  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.281388  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.259752  2865 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:46.283849  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.285218  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08002bdda0 after lost signal to thread 2832
I20260709 12:58:46.286594  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.268069  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.288357  1582 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.289090  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:46.289346  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:46.290794  1582 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:46.291697  2834 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.292098  2834 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.292500  2834 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.292716  2859 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.292423  2895 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.293582  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.270817  2885 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.298210  2776 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.270375  2878 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.268146  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.305703  2882 tablet_copy_client.cc:323] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 12:58:46.306077  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.316805  2893 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.306541  2902 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:46.317809  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:46.318625  2902 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.319113  2865 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.306967  1700 tablet_copy_source_session.cc:215] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.320472  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.320964  1700 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:55612 (request call id 49) took 1059 ms. Trace:
I20260709 12:58:46.308367  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.308591  2275 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.322813  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.307610  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:46.324404  2885 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.324543  1507 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.325241  2885 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.312291  2857 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.325881  2887 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:46.327889  2854 consensus_meta.cc:287] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.778s	user 0.004s	sys 0.011s
I20260709 12:58:46.306891  2906 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.313699  2878 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.319309  2902 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.311772  2779 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.329038  2847 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.313016  2881 tablet_copy_client.cc:323] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:46.323925  2275 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.329965  1689 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:46.329993  1536 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:46.321400  1700 rpcz_store.cc:276] 0709 12:58:45.275694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.276413 (+   719us) service_pool.cc:224] Handling call
0709 12:58:46.320865 (+1044452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.331854  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.334117  2894 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.334345  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.334553  2894 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.334995  2894 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.334132  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.340615  2904 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.340971  1653 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:58:46.342124  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 48652.6us
I20260709 12:58:46.343274  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.335666  2779 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.337124  2854 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.337742  2776 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.349370  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.350035  1532 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:46.347234  2854 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.351043  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.351207  2854 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.352545  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.352627  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.337419  2895 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.347882  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:46.365293  1533 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.331586  2847 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.353941  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.353699  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.368829  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.371714  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.373056  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.374430  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.375154  1608 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:46.375836  1539 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:46.371786  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.376765  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.382714  2907 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.386046  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:46.378702  2692 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.388602  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.367252  2859 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.378288  2816 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:46.343775  2897 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:46.391891  2692 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.396306  2857 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.396633  2692 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.397312  2903 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.398000  2903 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.389427  2785 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.403095  2900 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.404820  2890 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.413923  2785 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.415468  2890 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.403127  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.407460  2894 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.412803  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.421088  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 978) took 1095 ms. Trace:
I20260709 12:58:46.421319  2897 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.422688  1539 rpcz_store.cc:276] 0709 12:58:45.325662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.325768 (+   106us) service_pool.cc:224] Handling call
0709 12:58:46.420894 (+1095126us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540040ced4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:46.420999 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022092160}
I20260709 12:58:46.393895  2816 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.412567  2902 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.413928  2900 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.417773  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.423305  2912 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.418785  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.415918  2785 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.368535  2895 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.433326  2847 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.437242  2912 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:46.437358  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:46.426283  2816 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.417066  2859 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.435423  2867 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.428984  2853 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.460515  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.463382  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.466147  1581 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.467550  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:46.467692  2859 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.468161  2893 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.468912  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.469858  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.470077  1607 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:46.445287  2850 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.440297  2900 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.454445  2912 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.477155  2895 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.468595  2893 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.478700  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet 1bb16b93f1fe47b4be38ae591c62b564 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 12:58:46.462769  2785 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.486275  2880 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.432211  2854 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:46.460579  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:46.485241  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:46.486292  2893 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.486166  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet 1bb16b93f1fe47b4be38ae591c62b564 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-1bb16b93f1fe47b4be38ae591c62b564
I20260709 12:58:46.495836  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.496167  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.499872  2896 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:46.516554  1535 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:46.483369  2912 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.474336  2859 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.524509  2902 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.526407  2834 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.493697  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.528546  1533 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:46.488328  2785 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:58:46.536741  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 176200us
I20260709 12:58:46.503163  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:46.538872  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 152919us
I20260709 12:58:46.507117  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:46.495522  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.518352  2900 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:46.506666  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:46.496990  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.500651  1609 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:46.516599  2896 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.540771  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:46.538326  2785 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.557940  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.558002  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.559238  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:46.543256  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 172703us
I20260709 12:58:46.489176  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.555670  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:46.517753  2880 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.556001  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:46.561187  1616 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.559218  1683 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:46.561841  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:46.545775  2902 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.593801  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.596897  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.563377  2880 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.600931  2880 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.594908  2911 ts_tablet_manager.cc:933] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.558210  2868 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.596628  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.562968  2894 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:46.578447  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.552582  1534 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:46.555747  2900 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:46.615043  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.592049  2904 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.593758  2867 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.613772  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.615810  1533 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:46.616426  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.616528  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.595463  2854 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.619338  2308 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:46.604569  2902 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:46.620468  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.600112  2879 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.601747  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.624702  1540 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:46.624768  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:46.629192  2308 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.616564  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.625608  2902 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.627866  2856 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.609515  2840 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:58:46.632510  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 291604us
I20260709 12:58:46.636756  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:46.652839  1614 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.634928  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:46.617624  2867 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.642231  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.644721  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.645047  2900 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.647341  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.618511  2904 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:58:46.668862  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 58918.8us
W20260709 12:58:46.672685  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66670us
I20260709 12:58:46.641527  2894 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:46.684249  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49413.2us
I20260709 12:58:46.685130  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.647949  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.666117  2867 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.748476  2785 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.789494  1612 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:46.673141  2904 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.755942  2305 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:46.689982  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.690354  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:46.744958  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.718120  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:46.758785  1614 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:46.737736  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.689155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.733180  2308 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
W20260709 12:58:46.799674  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 109803us
W20260709 12:58:46.800016  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55128.3us
I20260709 12:58:46.800711  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.801860  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.805467  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.806555  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.809103  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.809600  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.689296  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.810220  1616 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:46.810206  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.737149  2832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5f5933777f457e99f4a6b1781ec12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.809306  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.709306  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:46.813721  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.814107  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:46.708621  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.816363  2853 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.820053  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.813074  2863 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.799147  1626 tablet_copy_source_session.cc:215] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.812963  2894 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:58:46.821903  2895 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.820626  2893 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.710421  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet ff79ac342d91424db634ca7802846535 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:46.738999  2896 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.837616  2692 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.821663  2868 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.709842  2912 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.803993  2897 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.846477  2911 tablet_copy_client.cc:323] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 12:58:46.816957  2855 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.708767  2816 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.727069  2903 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:46.846362  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 205) took 1969 ms. Trace:
I20260709 12:58:46.821982  2907 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.858368  2840 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:46.807713  2879 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.862561  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet ff79ac342d91424db634ca7802846535 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-ff79ac342d91424db634ca7802846535
I20260709 12:58:46.810912  2776 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.846287  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:46.845535  1504 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:46.794431  2859 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.892455  2897 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:46.893289  2897 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:46.831024  2856 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.835785  2854 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.894402  2897 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.881320  2840 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.899302  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 240) took 1762 ms. Trace:
I20260709 12:58:46.835621  1534 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:46.844848  2885 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:58:46.851574  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.550s (SENT) [suppressed 1 similar messages]
I20260709 12:58:46.838066  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:46.840636  2276 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:46.865026  1613 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:46.892841  2859 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:46.839021  2880 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.877485  2922 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:46.896390  2776 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.918941  2922 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.919430  2922 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.896780  2912 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.901880  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.899703  1439 rpcz_store.cc:276] 0709 12:58:45.137090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.137358 (+   268us) service_pool.cc:224] Handling call
0709 12:58:46.899119 (+1761761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118537,"reported_tablets":2}
I20260709 12:58:46.902912  2921 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.882553  2816 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:46.904419  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 63857.2us
I20260709 12:58:46.907351  2919 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.919950  2834 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.912917  2880 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.918354  2878 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.910019  1700 tablet_copy_source_session.cc:215] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.922468  2776 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.910287  2885 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:46.935949  2888 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.936360  2854 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:46.929764  2921 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:46.935168  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:46.867784  1436 rpcz_store.cc:276] 0709 12:58:44.876652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.876774 (+   122us) service_pool.cc:224] Handling call
0709 12:58:46.846281 (+1969507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:45.101988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:45.246381 (+144393us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:45.246450 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:58:45.246506 (+    56us) tablet.cc:662] Decoding operations
0709 12:58:45.247094 (+   588us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:45.247202 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:45.247241 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:45.247623 (+   382us) tablet.cc:701] Row locks acquired
0709 12:58:45.247687 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:58:45.247898 (+   211us) write_op.cc:270] Start()
0709 12:58:45.248070 (+   172us) write_op.cc:276] Timestamp: P: 1783601925247818 usec, L: 0
0709 12:58:45.248111 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:58:45.280685 (+ 32574us) log.cc:844] Serialized 599 byte log entry
0709 12:58:45.622593 (+341908us) op_driver.cc:464] REPLICATION: finished
0709 12:58:46.213926 (+591333us) write_op.cc:301] APPLY: starting
0709 12:58:46.214026 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:46.214146 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:46.214294 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:46.214593 (+   299us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:46.214840 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:46.214899 (+    59us) write_op.cc:312] APPLY: finished
0709 12:58:46.215178 (+   279us) log.cc:844] Serialized 23 byte log entry
0709 12:58:46.215384 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:46.215468 (+    84us) write_op.cc:454] Released schema lock
0709 12:58:46.215522 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:46.215897 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:46.215923 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1603,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":576212,"apply.run_cpu_time_us":1969,"apply.run_wall_time_us":1955,"num_ops":1,"prepare.queue_time_us":107689,"prepare.run_cpu_time_us":12008,"prepare.run_wall_time_us":366778,"raft.queue_time_us":134906,"raft.run_cpu_time_us":47929,"raft.run_wall_time_us":493008,"replication_time_us":359539,"thread_start_us":755714,"threads_started":4,"wal-append.queue_time_us":162946}]]}
I20260709 12:58:46.951751  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:46.953150  2785 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.943460  2921 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.958163  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.941557  2885 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:46.939916  2840 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:46.931478  2919 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.963804  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:46.969331  2908 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.974505  2882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb16b93f1fe47b4be38ae591c62b564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.961030  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:46.963971  2885 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.983945  2908 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:46.983871  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:46.985764  2908 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:46.990906  2893 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.992489  2859 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.994391  2867 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:46.994789  2872 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:46.995252  2872 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:46.996052  2302 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:46.999619  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.001575  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.007295  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:47.011209  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 172108us
W20260709 12:58:47.012004  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 160487us
I20260709 12:58:47.013010  2902 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:47.014645  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.005946  2304 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.016155  2926 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.020036  2908 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:47.020321  1537 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.021507  1537 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.021793  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.022399  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.023478  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.024645  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.024001  1537 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:47.016543  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.028707  1608 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.019029  2925 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.035751  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.008873  2867 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.038951  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:47.039203  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:47.013842  2859 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.043103  1582 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.055478  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.059930  2926 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.061681  2926 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.062129  2926 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.061735  2885 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.065280  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:47.066471  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.071578  2885 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:46.996183  2872 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.114029  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 851) took 1082 ms. Trace:
I20260709 12:58:47.116786  1653 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.116007  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:47.114601  1689 rpcz_store.cc:276] 0709 12:58:46.031550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.130265 (+ 98715us) service_pool.cc:224] Handling call
0709 12:58:46.270363 (+140098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.333301 (+ 62938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.003298 (+669997us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b5400119254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:47.113792 (+110494us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400119250. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:47.113956 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458233984}
I20260709 12:58:47.060402  2850 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:47.075184  2909 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:47.123631  2853 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:58:47.114337  2903 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.110877  2854 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.135188  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:58:47.194413  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 74805.7us
I20260709 12:58:47.180899  2909 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.175271  2850 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.197908  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.198609  1539 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:47.176167  2766 raft_consensus.cc:993] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:47.177769  2904 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.178864  2888 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.179248  2878 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:47.180358  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 125004us
I20260709 12:58:47.123235  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:47.182116  2903 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.201951  2881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff79ac342d91424db634ca7802846535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.202282  2850 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:47.216398  2902 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:47.217270  2847 raft_consensus.cc:1081] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:58:47.221597  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.224092  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:47.149207  1615 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.201499  2909 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:47.228776  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 162387us
I20260709 12:58:47.235509  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.242420  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.242877  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.208600  2885 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.179950  2922 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.198520  2919 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:47.177772  2921 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.228901  2903 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.251360  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.252456  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:47.244393  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.245977  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.235139  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:47.259425  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.260128  2921 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:47.260607  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.253506  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.226109  2893 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:47.256368  2302 raft_consensus.cc:2393] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:47.241842  2850 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.249816  2878 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.264838  1682 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:47.265460  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.251223  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.269138  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.261265  2919 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:47.271387  2904 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.265043  2834 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.267916  2928 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.272769  2912 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.265460  2921 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:47.280145  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 163496us
I20260709 12:58:47.282766  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.276000  2853 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.276846  2919 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.286791  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.266834  2893 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.282570  2926 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.281411  2878 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.294005  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:47.291606  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 167536us
I20260709 12:58:47.295630  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:47.296192  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.296536  1507 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:47.298204  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 53922.2us
I20260709 12:58:47.299247  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.290138  2919 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.300449  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:47.297068  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.299532  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.298421  1507 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:47.300719  2893 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:47.301172  1700 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 2f362fd54b48400ba3c9fb8b8a405a93 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 12:58:47.313417  1700 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 2f362fd54b48400ba3c9fb8b8a405a93 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-2f362fd54b48400ba3c9fb8b8a405a93
I20260709 12:58:47.301630  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.302748  2850 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:47.302680  2909 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.298509  2853 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:58:47.303591  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.316916  1532 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:47.317886  2850 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.318266  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.314247  2275 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.319254  2853 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.319783  2900 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.319933  2904 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.320245  2853 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:47.307168  2935 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:47.300021  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.312460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.292281  2837 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.311586  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.314191  2872 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.306640  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.321245  2776 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.330664  2854 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:47.332398  2854 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.332751  2854 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.333505  2854 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.334887  2310 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.335237  2305 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.334867  2854 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.339874  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.340711  2837 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.341212  1700 tablet_copy_source_session.cc:215] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:47.327642  2903 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.328101  2922 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:47.328648  2855 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.347774  2855 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.316339  2918 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.341429  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.341820  2837 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.342000  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.342248  2885 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.357070  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.342558  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.321890  2897 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:47.344719  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.345249  2864 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.345381  2934 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.318874  2850 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.350767  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.369854  1537 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.351176  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.331187  2926 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.352293  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:47.362241  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.363387  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.358310  2303 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.366561  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.367578  2920 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.345793  2776 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.371694  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:47.374828  1538 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:47.358827  2912 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.353123  2918 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.366724  2302 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.379038  2915 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.378958  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:47.388573  2916 consensus_queue.cc:1059] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.389679  2916 raft_consensus.cc:3055] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.391588  1537 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:47.394461  2882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56290 (request call id 161) took 2170 ms. Trace:
I20260709 12:58:47.394474  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.353843  2837 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:47.379309  2900 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.376093  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.402240  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.378007  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:47.366320  2855 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.382886  2924 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:58:47.384714  2778 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:58:47.406884  2855 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.407389  2863 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.407749  2863 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.371721  2925 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.353611  2922 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:58:47.408653  2863 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.409395  2922 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.409755  2922 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:47.409900  2863 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.390030  2916 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:47.376834  2776 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.410995  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:47.411494  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.377460  2934 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:47.389979  2919 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.404760  2920 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.406586  2840 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.383669  2918 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.403621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.413084  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.414320  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.399997  2903 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.415578  2909 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:58:47.406924  2891 consensus_queue.cc:1175] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:58:47.412647  2847 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.430646  2916 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.420516  2864 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.410745  2912 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.435407  2912 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.435876  2912 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.421178  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.414032  2934 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.422863  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.423514  2915 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.424188  2878 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.424338  1435 catalog_manager.cc:5697] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.417692  2873 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.438170  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.445544  2276 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.448467  1614 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:47.449457  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.455576  2878 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.455021  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.447026  2873 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.458761  2878 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.459244  2873 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.459898  2878 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.460342  2878 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:47.460506  2873 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.463837  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.463865  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.447057  2921 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.453478  1435 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.449404  2891 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.441887  2916 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.451974  2885 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.471900  2926 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.451738  2880 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.477407  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.415757  2922 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.472195  2867 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:47.453156  2900 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:58:47.394923  2882 rpcz_store.cc:276] 0709 12:58:45.223587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.223791 (+   204us) service_pool.cc:224] Handling call
0709 12:58:45.658470 (+434679us) ts_tablet_manager.cc:934] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
0709 12:58:46.930192 (+1271722us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:47.332078 (+401886us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.332241 (+   163us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:47.393208 (+ 60967us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:47.393979 (+   771us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.394299 (+   320us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:47.394362 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":135750,"tablet-copy.queue_time_us":162535,"thread_start_us":532987,"threads_started":2}
I20260709 12:58:47.484809  2911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f362fd54b48400ba3c9fb8b8a405a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.479316  2862 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:47.475792  2915 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:47.489651  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 92034.8us
I20260709 12:58:47.487166  2867 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:47.491986  2867 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.494115  2918 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.497776  2908 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:47.498250  2306 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:47.500717  1581 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.501538  2850 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.469803  2878 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.507354  2850 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:47.507817  2878 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.508256  2850 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.509425  2850 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.509613  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:47.503350  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.504491  2847 raft_consensus.cc:3055] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.480585  2921 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.452450  2837 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.513463  2847 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:47.517282  2847 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.514169  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:47.515357  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.520443  2915 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:47.521132  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.514639  2932 consensus_queue.cc:1059] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:58:47.524945  2922 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.525434  2932 raft_consensus.cc:3055] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.525782  2932 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:47.520985  2915 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.526578  2932 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:47.513295  2895 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.514282  2903 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:58:47.515105  2920 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:58:47.534701  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.510684  2924 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.535399  2920 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.529642  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.535616  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:47.535799  2920 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:58:47.527750  2925 consensus_queue.cc:1175] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:58:47.535928  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.533679  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.511076  2882 tablet_copy_client.cc:806] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.536799  2920 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:47.537135  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.537549  2882 tablet_copy_client.cc:670] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.538100  2920 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.538478  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.533903  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.544690  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.527832  2926 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.548171  2847 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.532322  2915 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.527562  2918 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.551651  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.555171  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.553817  2919 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.549670  2912 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.555951  2882 tablet_copy_client.cc:538] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:47.562803  2832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56280 (request call id 378) took 4157 ms. Trace:
I20260709 12:58:47.558717  2837 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.566833  2776 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.566988  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.583917  1684 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:47.571244  1685 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:47.584460  2936 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:58:47.568375  2832 rpcz_store.cc:276] 0709 12:58:43.400723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.400904 (+   181us) service_pool.cc:224] Handling call
0709 12:58:43.500064 (+ 99160us) ts_tablet_manager.cc:934] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
0709 12:58:46.711026 (+3210962us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:47.202837 (+491811us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.202960 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:47.539353 (+336393us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:47.556788 (+ 17435us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.558341 (+  1553us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:47.558460 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7081,"tablet-copy.queue_time_us":97988,"thread_start_us":328614,"threads_started":2}
I20260709 12:58:47.594707  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.568598  2932 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.595610  2832 tablet_copy_client.cc:806] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.591548  1535 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:47.627772  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.624166  2832 tablet_copy_client.cc:670] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.642115  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:47.643222  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.629153  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.629971  1534 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:47.672940  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.674109  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.629971  2776 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.692256  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:58:47.692724  2937 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:58:47.697165  2912 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.698674  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.700718  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.698138  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.696022  2306 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.707373  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.721678  1683 raft_consensus.cc:606] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.722692  1683 raft_consensus.cc:614] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:47.723613  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.732967  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.727392  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.739717  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.737598  2832 tablet_copy_client.cc:538] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:47.741063  2847 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:58:47.748270  1684 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:47.748795  2847 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.749210  2847 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:47.750517  2847 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:47.752080  2847 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.761662  1690 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:47.762903  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.770335  1614 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:47.771379  1685 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:47.763434  1681 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:47.774078  1689 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.757280  1615 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:47.778931  1540 raft_consensus.cc:2410] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:47.780392  2934 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:47.781612  2855 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:47.783103  2855 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:47.783043  2934 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:47.786885  1614 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.787310  1683 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.789060  1682 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:47.792364  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.793053  1537 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.795537  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.796844  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.797747  1536 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.797845  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:47.798966  1541 raft_consensus.cc:2410] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:47.798944  1537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34874
I20260709 12:58:47.799949  1537 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:47.800379  1537 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.745967  1535 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.804091  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.754228  1684 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.756189  1686 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:47.786135  2882 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:47.789952  2832 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:47.812008  1506 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.813616  1536 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:58:47.873077  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:47.878175  1688 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:47.880741  1690 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:47.881803  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.810316  2919 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.871589  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.875016  2855 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.818845  1537 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.887476  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:47.813828  2873 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.884713  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:47.892939  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:47.894331  1610 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.896632  1616 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.897470  1611 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.888833  2881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56280 (request call id 387) took 2667 ms. Trace:
I20260709 12:58:47.899777  2881 rpcz_store.cc:276] 0709 12:58:45.220370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.221031 (+   661us) service_pool.cc:224] Handling call
0709 12:58:45.668740 (+447709us) ts_tablet_manager.cc:934] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
0709 12:58:47.197615 (+1528875us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:47.506816 (+309201us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.506963 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:47.742741 (+235778us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:47.812212 (+ 69471us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.878927 (+ 66715us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:47.887415 (+  8488us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":123201,"tablet-copy.queue_time_us":96890,"thread_start_us":394600,"threads_started":2}
I20260709 12:58:47.901114  2881 tablet_copy_client.cc:806] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.901208  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:47.890857  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:47.901661  2881 tablet_copy_client.cc:670] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.819715  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.909726  1539 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.905328  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.906119  1537 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.920706  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:58:47.923847  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 104191us
I20260709 12:58:47.928555  1613 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:47.928480  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.887006  2776 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.932404  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:47.934927  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.936740  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.903007  2915 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.923556  2897 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.925311  2931 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.931291  2855 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.943912  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:47.942270  2776 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:47.937381  2872 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.949090  2776 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:47.929776  2916 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:58:47.935932  2878 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.937966  2935 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.956058  1687 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:47.956023  1534 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:47.941223  2863 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.959412  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:47.956601  2909 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:58:47.979029  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:47.984349  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.958847  2862 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.998688  2862 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:47.999058  2862 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:47.999431  2862 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:48.000360  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:48.001361  1535 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:48.001819  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.002017  1533 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:48.002310  2864 raft_consensus.cc:2764] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:58:48.002929  2864 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:58:48.003492  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.935868  2918 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:58:48.005043  1538 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:47.995217  2930 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:48.005498  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.952107  2921 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:58:48.016957  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:47.993229  2847 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:58:48.026904  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 76391.3us
W20260709 12:58:48.039981  2944 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:58:48.041788  2915 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:48.041949  1532 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:48.042773  2911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56280 (request call id 404) took 1771 ms. Trace:
I20260709 12:58:48.043696  2867 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:48.048753  1541 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:48.028751  2925 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:48.036199  2776 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:48.066920  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:48.072928  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:48.052582  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:48.061249  2925 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:48.056828  2915 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:58:48.075646  2776 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:58:48.082664  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.088757  1612 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:48.043197  2911 rpcz_store.cc:276] 0709 12:58:46.271734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.273839 (+  2105us) service_pool.cc:224] Handling call
0709 12:58:46.617806 (+343967us) ts_tablet_manager.cc:934] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
0709 12:58:47.483524 (+865718us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:47.802802 (+319278us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.813153 (+ 10351us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:48.004548 (+191395us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:48.026198 (+ 21650us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:48.042623 (+ 16425us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:48.042693 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":51859,"tablet-copy.queue_time_us":112118,"thread_start_us":197829,"threads_started":2}
I20260709 12:58:48.085846  2840 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.083499  2948 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:48.090044  2840 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.090771  2948 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.093638  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.091403  2840 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.102726  2840 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.103199  2951 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:48.107743  2925 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.103752  2951 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.115547  2948 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.119936  2776 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.121591  2951 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:48.123092  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:48.088981  1535 raft_consensus.cc:606] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Received request to transfer leadership to TS d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:48.118580  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.133059  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:48.125250  2908 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.134135  1613 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:48.115007  2847 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.111321  2911 tablet_copy_client.cc:806] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:48.124647  2859 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.117707  2862 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.134307  2908 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.137650  2920 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:48.138463  2908 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.139813  2908 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.141498  2878 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.141899  2878 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.142848  2909 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.142729  2878 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.143357  2909 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.143751  2878 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.143904  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:48.144774  2302 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:48.144269  2909 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.137277  2932 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.145537  2909 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.145855  2932 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.146770  2932 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.137113  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.137277  2911 tablet_copy_client.cc:670] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
W20260709 12:58:48.159118  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.161748  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 60417.7us
I20260709 12:58:48.164551  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:48.147475  1437 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.132727  2951 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:48.173419  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:48.177343  2834 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.179720  2834 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:48.148048  2932 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.190941  1437 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:48.193445  2881 tablet_copy_client.cc:538] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:48.202746  2840 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:48.203677  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 66664.8us
I20260709 12:58:48.180747  2834 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:48.147781  2862 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:48.187198  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.188138  2951 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:48.190250  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 63970.2us
I20260709 12:58:48.210728  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:48.211483  2925 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:58:48.219708  2834 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.220422  2867 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:48.225977  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.225864  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.234719  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.235095  2859 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.236064  2916 consensus_queue.cc:1059] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:48.238818  2928 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:48.239238  2928 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:48.239995  2928 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.238871  2916 raft_consensus.cc:3055] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.241683  2916 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.242578  2916 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.243834  2916 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.248309  2951 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:48.249141  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:48.232493  2932 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:58:48.234494  2908 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:48.271533  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 60885.6us
I20260709 12:58:48.274809  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.257181  2915 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.272675  1609 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:48.276854  1506 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.277616  1681 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:48.283192  1607 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:48.283352  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.287151  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:48.289207  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:48.290462  1683 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:48.286496  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:48.291424  2864 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.282401  2931 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:48.281474  2873 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:58:48.304140  2873 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.304200  2881 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:48.304556  2873 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:58:48.271739  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 84645.7us
I20260709 12:58:48.282150  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:58:48.289983  2854 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:48.291831  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:48.320658  2911 tablet_copy_client.cc:538] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:48.322652  2832 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:48.325234  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:48.325910  2832 tablet_bootstrap.cc:492] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:48.325829  1686 raft_consensus.cc:606] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:48.326385  2935 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:48.327265  2854 raft_consensus.cc:697] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:48.328593  1683 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:48.305409  2873 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.337072  2918 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:48.338033  2873 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:48.328922  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.334563  2855 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:58:48.334004  2854 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:48.361588  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:48.362506  1532 raft_consensus.cc:606] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Received request to transfer leadership to TS d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.363004  1532 raft_consensus.cc:614] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:48.392983  1690 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:48.399191  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.411767   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:48.355769  2275 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:48.413813  2935 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:48.419665  2935 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:48.420665  2935 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.422451  2882 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:48.423892  2882 tablet_bootstrap.cc:492] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:48.424611  2882 ts_tablet_manager.cc:1403] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.639s	user 0.046s	sys 0.018s
I20260709 12:58:48.400985  2832 ts_tablet_manager.cc:1403] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.621s	user 0.033s	sys 0.011s
I20260709 12:58:48.384449  2928 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:48.431016  2880 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.442350  1689 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:48.443823  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:48.444909  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 109854us
I20260709 12:58:48.445869  2863 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:48.467276  2863 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:48.488237  2867 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:48.523968   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:48.515879  2920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55606 (request call id 15) took 4683 ms. Trace:
I20260709 12:58:48.526090  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 216) took 2266 ms. Trace:
I20260709 12:58:48.532389  2920 rpcz_store.cc:276] 0709 12:58:43.798785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.799770 (+   985us) service_pool.cc:224] Handling call
0709 12:58:43.815779 (+ 16009us) log.cc:844] Serialized 506 byte log entry
0709 12:58:44.672753 (+856974us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18000971e0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:58:45.123940 (+451187us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b18000971e0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:58:48.482310 (+3358370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":894782,"raft.queue_time_us":1380,"raft.run_cpu_time_us":2568,"raft.run_wall_time_us":7783,"spinlock_wait_cycles":21198464,"thread_start_us":11260,"threads_started":1,"wal-append.queue_time_us":336912,"wal-append.run_cpu_time_us":2002,"wal-append.run_wall_time_us":1085747}
I20260709 12:58:48.542887  1532 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:48.543759  2909 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:48.544167  2909 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:48.548207  1439 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } }
I20260709 12:58:48.549294  1538 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:58:48.550264  1439 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 2, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.550647  2832 raft_consensus.cc:359] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:48.559213  2911 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 12:58:48.528332  1435 rpcz_store.cc:276] 0709 12:58:46.258660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.258882 (+   222us) service_pool.cc:224] Handling call
0709 12:58:48.524966 (+2266084us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:47.594617 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:47.618026 (+ 23409us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:47.618082 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:58:47.618112 (+    30us) tablet.cc:662] Decoding operations
0709 12:58:47.618714 (+   602us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:47.618815 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:47.618861 (+    46us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:47.619299 (+   438us) tablet.cc:701] Row locks acquired
0709 12:58:47.619327 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:58:47.619532 (+   205us) write_op.cc:270] Start()
0709 12:58:47.619695 (+   163us) write_op.cc:276] Timestamp: P: 1783601927619464 usec, L: 0
0709 12:58:47.620191 (+   496us) op_driver.cc:348] REPLICATION: starting
0709 12:58:47.731729 (+111538us) log.cc:844] Serialized 929 byte log entry
0709 12:58:48.172912 (+441183us) op_driver.cc:464] REPLICATION: finished
0709 12:58:48.261586 (+ 88674us) write_op.cc:301] APPLY: starting
0709 12:58:48.261665 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:48.261768 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:48.261886 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:48.262284 (+   398us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:48.262428 (+   144us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:48.262469 (+    41us) write_op.cc:312] APPLY: finished
0709 12:58:48.271268 (+  8799us) log.cc:844] Serialized 29 byte log entry
0709 12:58:48.283286 (+ 12018us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:48.291482 (+  8196us) write_op.cc:454] Released schema lock
0709 12:58:48.298372 (+  6890us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:48.301827 (+  3455us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:48.301856 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":251657,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":88412,"apply.run_cpu_time_us":2942,"apply.run_wall_time_us":40225,"num_ops":2,"prepare.queue_time_us":83858,"prepare.run_cpu_time_us":57135,"prepare.run_wall_time_us":326879,"raft.queue_time_us":131876,"raft.run_cpu_time_us":11222,"raft.run_wall_time_us":61493,"replication_time_us":552577,"thread_start_us":283280,"threads_started":4,"wal-append.queue_time_us":243257}]]}
I20260709 12:58:48.560833  1439 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:58:48.555801  2882 raft_consensus.cc:359] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:48.578011  1681 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:48.545527  2909 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:48.557551  2832 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:48.525085  2863 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.553503  2878 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:58:48.600040  2832 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:48.587380  2921 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:58:48.582978  2882 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:48.644866  2912 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 12:58:48.653340  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.674907  2776 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.669855  2880 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.681836  2880 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.675500  2776 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.743697  2872 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.772622  1689 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:48.744791  2862 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.767547  2306 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:48.774605  2916 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.685791  2882 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:48.981506  2970 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:58:48.947086  2873 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:48.860805  2872 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:48.781518  2862 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:48.968202  2928 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:58:49.021821  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 244538us
I20260709 12:58:49.011520  1610 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:48.983712  2916 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.041332  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.042233  1683 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:49.010990  2873 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.032994  2832 ts_tablet_manager.cc:1434] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.601s	user 0.005s	sys 0.005s
I20260709 12:58:49.031867  2978 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.079047  2872 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:49.081254  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.045114  2880 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.085716  2867 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.153486  2974 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:58:49.153303  2867 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:49.155045  2976 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:58:49.155589  2867 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.056037  2776 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.161855  2873 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.162868  2881 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:49.163826  2881 tablet_bootstrap.cc:492] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:49.165474  2881 ts_tablet_manager.cc:1403] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.862s	user 0.027s	sys 0.038s
I20260709 12:58:49.081144  2978 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.169842  2978 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:49.053103  2832 ts_tablet_manager.cc:1467] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Tablet startup took 623ms
I20260709 12:58:49.171453  2916 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.203840  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.204771  1683 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:49.363739  2951 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.437717  2273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.002s	sys 0.026s
I20260709 12:58:49.363858  2960 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.440038  2273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.002s	sys 0.027s
I20260709 12:58:49.387202  2880 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.448199  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:49.444183  2880 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.440650  2951 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.442404  2960 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.456666  2308 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:49.454361  2882 ts_tablet_manager.cc:1434] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 1.029s	user 0.003s	sys 0.024s
I20260709 12:58:49.463470  2951 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.462416  2880 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:49.174028  2832 ts_tablet_manager.cc:1469] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Trace:
0709 12:58:43.400723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.400904 (+   181us) service_pool.cc:224] Handling call
0709 12:58:43.500064 (+ 99160us) ts_tablet_manager.cc:934] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
0709 12:58:46.711026 (+3210962us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:47.202837 (+491811us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.202960 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:47.539353 (+336393us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:47.556788 (+ 17435us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.558341 (+  1553us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:47.558460 (+   119us) inbound_call.cc:177] Queueing success response
0709 12:58:47.779891 (+221431us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:58:48.438903 (+659012us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:58:48.514815 (+ 75912us) tablet_replica.cc:261] Starting instrumentation
0709 12:58:48.515382 (+   567us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":7081,"mutex_wait_us":40,"raft.queue_time_us":19546,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":19642,"tablet-copy.queue_time_us":97988,"tablet-download-pool.queue_time_us":54960,"tablet-download-pool.run_cpu_time_us":2184,"tablet-download-pool.run_wall_time_us":33827,"thread_start_us":328614,"threads_started":2}
W20260709 12:58:49.458478  2882 ts_tablet_manager.cc:1467] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Tablet startup took 1033ms
I20260709 12:58:49.467057  2960 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:49.467835  2882 ts_tablet_manager.cc:1469] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Trace:
0709 12:58:45.223587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.223791 (+   204us) service_pool.cc:224] Handling call
0709 12:58:45.658470 (+434679us) ts_tablet_manager.cc:934] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
0709 12:58:46.930192 (+1271722us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:47.332078 (+401886us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.332241 (+   163us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:47.393208 (+ 60967us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:47.393979 (+   771us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.394299 (+   320us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:47.394362 (+    63us) inbound_call.cc:177] Queueing success response
0709 12:58:47.785736 (+391374us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:58:48.424967 (+639231us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:58:48.551557 (+126590us) tablet_replica.cc:261] Starting instrumentation
0709 12:58:48.552113 (+   556us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":135750,"mutex_wait_us":24039,"raft.queue_time_us":105014,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":20058,"tablet-copy.queue_time_us":162535,"tablet-download-pool.queue_time_us":200,"tablet-download-pool.run_cpu_time_us":1464,"tablet-download-pool.run_wall_time_us":14121,"thread_start_us":752847,"threads_started":3}
I20260709 12:58:49.471305  2881 raft_consensus.cc:359] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:49.472210  2881 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:49.472916  2881 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:49.474887  2881 ts_tablet_manager.cc:1434] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.309s	user 0.007s	sys 0.000s
I20260709 12:58:49.478838  2916 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.479460  2916 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.479888  2847 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.480424  2847 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.481580  2916 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.482318  2847 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.488793  2911 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:58:49.489588  2911 tablet_bootstrap.cc:492] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 12:58:49.490101  2911 ts_tablet_manager.cc:1403] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.931s	user 0.030s	sys 0.001s
I20260709 12:58:49.492552  2911 raft_consensus.cc:359] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.493742  2911 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 12:58:49.494494  2911 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:49.496714  2911 ts_tablet_manager.cc:1434] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:49.502763  2982 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:49.503388  2982 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.505225  2872 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.505769  2872 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.507579  2872 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.511507  2982 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.535148  2909 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.549444  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 130) took 1197 ms. Trace:
I20260709 12:58:49.549793  1437 rpcz_store.cc:276] 0709 12:58:48.352117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.356184 (+  4067us) service_pool.cc:224] Handling call
0709 12:58:48.655944 (+299760us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb5090 00007f8d58c53f3a 00007f8d5ea0a1cc 00007f8d5eb0837e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc 00007f8d5cfc8392 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:49.549385 (+893441us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":475850624}
W20260709 12:58:49.578282  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.000s	sys 0.042s
W20260709 12:58:49.578719  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.000s	sys 0.042s
I20260709 12:58:49.586432  2864 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.587011  2864 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:49.588326  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.021s	sys 0.001s
W20260709 12:58:49.588675  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.021s	sys 0.001s
I20260709 12:58:49.589087  2864 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.590651  2961 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.591173  2961 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.592278  2989 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:58:49.592849  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.059s	sys 0.183s
W20260709 12:58:49.593173  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.059s	sys 0.183s
I20260709 12:58:49.593480  2776 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:49.593994  2776 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:49.600904  2972 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.621s	user 0.004s	sys 0.000s
I20260709 12:58:49.601359  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:49.593186  2961 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.602276  2303 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:49.603904  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:49.605257  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:49.606098  2305 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:49.608470  2918 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.608983  2918 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.610055  1535 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.611018  2918 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.619649  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.620337  1539 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:49.592769  2989 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.625473  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.626135  1535 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:49.625368  1532 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.630136  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.635198  2862 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.596032  2776 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.636976  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:49.653776  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:49.655246  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.012s	sys 0.036s
W20260709 12:58:49.655618  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.037s
I20260709 12:58:49.658640  2989 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.661652  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.662432  1535 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:49.655239  1539 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:49.664242  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.665766  1535 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:49.665107  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.666674  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:49.667367  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.000s	sys 0.072s
W20260709 12:58:49.667680  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.000s	sys 0.072s
I20260709 12:58:49.674847  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 1708) took 1407 ms. Trace:
I20260709 12:58:49.675300  1610 rpcz_store.cc:276] 0709 12:58:48.267240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.271617 (+  4377us) service_pool.cc:224] Handling call
0709 12:58:49.674620 (+1403003us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400178ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:49.674763 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485198080}
W20260709 12:58:49.679555  2971 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.634s	user 0.005s	sys 0.000s
W20260709 12:58:49.685184  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.044s	sys 0.072s
W20260709 12:58:49.685545  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.044s	sys 0.072s
I20260709 12:58:49.687822  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.688571  1532 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:49.687814  2982 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.691514  2982 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.693559  2982 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.701483  2982 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:49.703351  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 905) took 1322 ms. Trace:
I20260709 12:58:49.705389  1688 rpcz_store.cc:276] 0709 12:58:48.381082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.382393 (+  1311us) service_pool.cc:224] Handling call
0709 12:58:48.414816 (+ 32423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.423935 (+  9119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.423976 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.424578 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.916826 (+492248us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:48.967216 (+ 50390us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.967465 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.967563 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.679064 (+711501us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:58:49.703070 (+ 24006us) raft_consensus.cc:1685] finished
0709 12:58:49.703152 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.703270 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12723,"prepare.queue_time_us":50692,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":11559,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":4130,"spinlock_wait_cycles":11390208,"thread_start_us":491798,"threads_started":1,"wal-append.queue_time_us":585434}
I20260709 12:58:49.707806  2982 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:49.710665  2982 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.726464  2982 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:49.727659  2982 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:49.735127  2982 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.754200  2985 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:49.753954  2995 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:49.754794  2985 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.754927  2995 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.758080  2982 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.759511  2982 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.757450  2995 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:49.762879  2982 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.776315  2985 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:49.785029  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.006s	sys 0.012s
W20260709 12:58:49.785465  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.006s	sys 0.012s
I20260709 12:58:49.786278  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1705) took 1107 ms. Trace:
I20260709 12:58:49.789482  1538 rpcz_store.cc:276] 0709 12:58:48.679242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.679721 (+   479us) service_pool.cc:224] Handling call
0709 12:58:48.680132 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.680540 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.680582 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.685616 (+  5034us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.785847 (+1100231us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:49.785896 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.785974 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.786025 (+    51us) raft_consensus.cc:1685] finished
0709 12:58:49.786039 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.786190 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3669,"raft.queue_time_us":629,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7232,"spinlock_wait_cycles":1987968,"thread_start_us":1042838,"threads_started":1,"wal-append.queue_time_us":756265}
I20260709 12:58:49.809407  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.810124  1533 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:49.811070  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.811765  1539 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:49.812750  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:49.813397  1535 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:49.813637  2916 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.814218  2916 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.816746  2275 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:49.818205  2880 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:49.818611  2880 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.819080  2909 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.819667  2909 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.820312  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.820837  1700 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-5a5f5933777f457e99f4a6b1781ec12b received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:49.820895  1688 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:49.821379  1700 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-5a5f5933777f457e99f4a6b1781ec12b on tablet 5a5f5933777f457e99f4a6b1781ec12b with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:49.821681  2909 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.822036  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.822593  1699 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-ff79ac342d91424db634ca7802846535 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:49.822731  1684 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:49.823025  1699 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-ff79ac342d91424db634ca7802846535 on tablet ff79ac342d91424db634ca7802846535 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:49.819074  2880 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.823696  1698 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-2f362fd54b48400ba3c9fb8b8a405a93 received from {username='slave'} at 127.0.0.1:55612
I20260709 12:58:49.827584  1698 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-2f362fd54b48400ba3c9fb8b8a405a93 on tablet 2f362fd54b48400ba3c9fb8b8a405a93 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:49.831511  2873 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:49.832157  2873 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.834955  2873 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.822184  2909 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.835680  2909 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.818638  2916 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.837519  2916 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.838491  2916 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:49.840513  2916 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.841243  2916 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:49.841670  2880 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.844826  2909 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.845428  2909 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.845994  2909 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.852824  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.853482  1688 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:49.856583  2909 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.857188  2909 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.858517  2909 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.866382  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.867416  1689 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:49.867691  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:49.868532  1686 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:49.876058  2960 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:49.876904  2960 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:49.893031  2872 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:49.893841  2872 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.899295  2985 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.900020  2985 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:49.902606  2985 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:49.879492  2960 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:49.984447  2960 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:49.985158  2960 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.003374  2880 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:50.061915  2985 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.062631  2985 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.058079  2872 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:50.108366  2997 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.109146  2997 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.111743  2997 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.112601  2909 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.113293  2909 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.113850  2909 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.154346  2997 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.155169  2997 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:50.182216  2995 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.183022  2995 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.217239  2880 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.218011  2880 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.222721  2996 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.223475  2996 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.226111  2996 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.226723  2996 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.227262  2996 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.271783  2960 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.280748  2847 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.285017  2847 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.282517  2995 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:50.292960  2880 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.295529  2915 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.287173  2847 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:50.301347  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 173243us
I20260709 12:58:50.302893  2909 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.296113  2915 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:50.304877  2997 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.305286  2985 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:50.305780  2915 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.308153  2996 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.309470  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.309962  3001 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.310482  3001 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.313005  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:50.313169  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:50.318526  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:50.319267  2997 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.319780  2997 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.323614  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:50.326486  1683 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.315138  2880 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:50.335683  1683 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:50.315237  3001 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.337914  3001 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.322108  2915 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.338722  3001 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.339013  2915 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.341372  3001 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:50.322255  2996 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.324683  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:50.320194  2960 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:50.343057  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:50.322547  2998 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:50.346076  2998 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.346490  2998 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:50.346622  2915 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.322376  3000 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.343916  2960 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.347421  2915 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.347997  3000 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.350128  3000 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.350581  3000 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.348012  2915 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.351109  3000 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.342692  2880 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.343701  2996 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.347486  2960 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.321828  2997 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.323426  3002 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.386650  2932 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.386327  3002 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.387184  2932 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.388979  3002 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.376647  2915 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.382905  2951 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.393707  2951 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.395704  2951 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:50.383481  2996 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.356845  3003 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:50.396937  3003 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.397307  3003 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.384829  2997 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:50.389145  2932 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.389845  2920 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.404960  2920 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.405654  2951 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.406185  2951 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.406968  2920 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.209975   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:50.408826  2912 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:50.409267  2912 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.409590  2912 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.375490  2275 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:50.404294  2997 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.407033  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 206) took 2318 ms. Trace:
W20260709 12:58:50.414062  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 745901us
I20260709 12:58:50.356972  2880 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:50.435227  2997 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.456146  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.456955  1688 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:50.467353  3007 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.467860  3007 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.460665  1437 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.469239  1437 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 2 to 3, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:50.467073  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 122679us
I20260709 12:58:50.472580  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.474779  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.420480  1439 rpcz_store.cc:276] 0709 12:58:48.088898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.089049 (+   151us) service_pool.cc:224] Handling call
0709 12:58:50.406973 (+2317924us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:48.637390 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:48.640731 (+  3341us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:48.640766 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:58:48.640786 (+    20us) tablet.cc:662] Decoding operations
0709 12:58:48.641342 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:48.641401 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:48.641433 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:48.641772 (+   339us) tablet.cc:701] Row locks acquired
0709 12:58:48.641792 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:58:48.641930 (+   138us) write_op.cc:270] Start()
0709 12:58:48.642054 (+   124us) write_op.cc:276] Timestamp: P: 1783601928641887 usec, L: 0
0709 12:58:48.642079 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:58:48.687725 (+ 45646us) log.cc:844] Serialized 1313 byte log entry
0709 12:58:48.698353 (+ 10628us) op_driver.cc:464] REPLICATION: finished
0709 12:58:48.757887 (+ 59534us) write_op.cc:301] APPLY: starting
0709 12:58:48.765975 (+  8088us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:48.777113 (+ 11138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:48.953826 (+176713us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:49.029473 (+ 75647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:49.048701 (+ 19228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:49.052873 (+  4172us) write_op.cc:312] APPLY: finished
0709 12:58:49.078959 (+ 26086us) log.cc:844] Serialized 35 byte log entry
0709 12:58:49.079156 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:49.079262 (+   106us) write_op.cc:454] Released schema lock
0709 12:58:49.079315 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:49.079745 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:49.079788 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59829,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":280,"apply.run_cpu_time_us":3141,"apply.run_wall_time_us":335040,"num_ops":3,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":3351,"prepare.run_wall_time_us":64316,"replication_time_us":56147}]]}
I20260709 12:58:50.475888  1682 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:50.435573  2981 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:58:50.489980  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.497340  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.498853  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.499961  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.501096  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.501731  1539 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:50.502847  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.503552  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.504179  1533 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:50.484153  1437 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.505136  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.505335  2308 raft_consensus.cc:1217] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:50.506157  1539 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:50.509764  2979 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.510492  2979 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.503691  1538 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:50.484102  2951 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:50.469857  3007 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.517400  3007 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.517948  3007 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.486008  2980 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.488022  2925 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.478933  2859 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:50.504300  2926 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.531793  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.532683  1683 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:50.533833  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.535135  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.537134  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.538441  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.548521  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.549336  1689 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:50.514207  2962 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.549983  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:50.570576  1538 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.553565  3010 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.555176  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.556288  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.558352  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.559099  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.559563  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.559832  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.607887  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:50.573716  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.560249  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.610366  1613 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:50.560554  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.611260  1607 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:50.611789  1616 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:50.560277  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.561415  1608 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:50.561568  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.523136  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.566859  2859 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.567795  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.571265  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.621582  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.627351  1616 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:50.571641  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.629805  3011 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:50.630249  3011 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.624984  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.631146  1687 raft_consensus.cc:2368] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:50.525027  2951 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:50.631786  2951 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:50.631971  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.632699  2951 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.633121  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.634284  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:50.615119  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.524698  3007 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.522807  3000 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.616266  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.547079  2834 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.527123  2925 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.614645  2962 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.625494  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.630640  3011 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.515870  2919 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.613715  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.670233  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.637241  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.637871  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.572888  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.646332  1538 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:50.673228  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.674024  1538 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:50.650432  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:50.654592  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:50.612375  2989 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.657773  1607 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
W20260709 12:58:50.622746  3004 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:50.633718  1687 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:50.662557  1682 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:58:50.647085  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080019efa0 after lost signal to thread 434
I20260709 12:58:50.630412  2859 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:50.525290  2980 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.620028  2981 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.569096  2926 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:50.523141  3003 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.624430  1534 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:50.621749  1611 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:50.678304  1689 raft_consensus.cc:2393] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:50.679287  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.681228  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:50.682732  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.656744  2847 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:50.689282  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.662149  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:50.662806  2776 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.619714  2275 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:50.658784  2303 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:50.688602  3016 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:50.664023  2834 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:50.615831  3010 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.690696  1506 leader_election.cc:400] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:50.735656  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:50.927085  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.887913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.196611  1539 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:50.746754  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.194001  1506 leader_election.cc:403] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:50.681376  2855 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:50.688618  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 80829.8us
I20260709 12:58:51.210688  3022 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.214147  3007 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:51.232153  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.219919  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.225595  1538 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:51.233758  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.233832  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:58:51.236699  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08001ddb60 after lost signal to thread 1473
I20260709 12:58:51.236997  1689 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:51.237840  2926 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:51.238029  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080039f300 after lost signal to thread 1565
W20260709 12:58:51.239147  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800374de0 after lost signal to thread 1640
W20260709 12:58:51.239428  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800374d20 after lost signal to thread 1641
I20260709 12:58:51.240536  2980 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:50.755738  1608 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:51.241075  2980 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:51.241242  1689 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:51.241557  2980 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:50.759262  2998 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.242924  2909 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:51.243544  2980 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.243443  2909 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:51.244096  2981 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.244367  1681 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:50.816169  1610 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:51.245476  3019 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:50.688298  2989 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.246174  3022 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.244283  2998 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.247656  2998 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.247856  2989 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.248067  2998 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.143723  2994 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.250932  2998 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.251019  3003 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.251253  2994 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.252350  1537 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:51.252545  1690 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:51.240417  1613 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:51.253912  2994 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.246174  2981 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.254556  2994 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.255189  2994 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.256008  2909 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.774595  2912 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:51.258230  2997 consensus_meta.cc:287] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.800s	user 0.007s	sys 0.003s
I20260709 12:58:50.886155  3005 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:51.258647  2912 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.258970  3005 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.136489  2872 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:50.736193  2859 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:51.261096  3005 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.260700  2859 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.261759  2997 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.262775  1683 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:51.262836  2859 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.248188  3022 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:51.254001  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800313a20 after lost signal to thread 1714
I20260709 12:58:51.263937  2997 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.265789  2998 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:51.266748  3011 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.586s	user 0.001s	sys 0.006s
I20260709 12:58:51.268869  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:51.272774  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 659968us
I20260709 12:58:51.273401  3008 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.260630  2872 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.248521  3007 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.688902  2921 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.279211  1612 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:58:51.209025  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.009s
W20260709 12:58:51.301424  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.009s
I20260709 12:58:51.223024  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:51.280548  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44187.4us
I20260709 12:58:51.306519  2308 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Advancing to term 2
I20260709 12:58:50.750378  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:50.949872  3020 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:51.305076  2921 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.312790  2921 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.299719  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.312757  3020 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.313632  1611 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:51.235471  3016 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.314929  3020 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:50.757345  2925 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.298954  1540 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:51.295305  3011 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.316566  3016 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.235695  2776 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.317721  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.318132  3011 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:50.993278  3021 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.318627  2776 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.318899  3021 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:51.319842  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08001d32e0 after lost signal to thread 2334
I20260709 12:58:50.784428  3017 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:50.760195  2979 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:50.689065  2919 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.278692  2855 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.781829  2880 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:50.778774  2960 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.291752  2962 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.310544  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.311231  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.226140  2847 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.320708  1616 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:51.321810  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.337872  1582 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.339506  1608 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:51.296203  3008 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:51.328915  2855 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.340417  3008 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.341675  2962 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.342128  2962 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.341840  3010 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.352335  2998 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.340418  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.353248  2304 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:51.342499  2962 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.355782  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.356702  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.356783  1532 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:51.329429  3017 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.359393  3017 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.339972  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.339824  2880 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.344154  2919 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.362954  2919 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.363366  2919 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:51.363725  2919 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.345839  2960 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.346513  3023 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.347615  3021 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.347734  3022 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:51.350538  2847 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.342842  2303 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:51.320338  2275 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:51.370050  2921 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.342501  2305 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:51.371591  1682 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:51.367455  3023 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:51.372346  2960 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:51.372658  3023 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:51.370532  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65873.4us
I20260709 12:58:51.373287  2308 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:51.375519  2960 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:51.376013  2960 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.376847  2921 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.378005  2960 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.379160  3008 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.380049  2872 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.380589  2872 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:51.381026  2872 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.381723  3008 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.382701  3007 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.382908  2872 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:51.334614  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080035a360 after lost signal to thread 2882
I20260709 12:58:51.383371  2872 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.387634  2872 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.389776  2872 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.390313  2872 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:51.393577  2834 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.394841  2962 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.401343  2962 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.398518  2919 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.405573  2994 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.410890  2919 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.403923  3007 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.414675  3007 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.417454  3007 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.405746  3023 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.420962  3023 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.398345  2855 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:51.437234  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 756116us
I20260709 12:58:51.438198  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.439273  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.441279  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.448836  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.462086  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.463241  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.466610  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.469601  1581 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:51.446496  2847 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.480764  2847 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.482043  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:51.482544  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:51.482851  1689 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:51.482944  2847 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.483340  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:51.484627  2997 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.484584  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.484551  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:51.486274  1683 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.486814  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.487376  1688 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:51.492302  1539 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:51.492429  1681 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:51.437021  2921 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.495339  1683 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:58:51.485162  2997 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:51.496578  2997 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.464634  3006 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.461207  3000 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.464831  2994 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.501801  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:51.504716  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.513388  1537 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:51.514664  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.516103  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.517449  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.518178  1537 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.519196  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.507237  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.520926  1541 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:51.521917  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.483875  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.523983  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.526062  1541 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:51.519876  1537 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.469084  2872 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:58:51.532441  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 62948.9us
I20260709 12:58:51.495025  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.501040  3006 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:58:51.547430  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 869697us
I20260709 12:58:51.543773  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:51.549593  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.031s
I20260709 12:58:51.549731  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.557245  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:58:51.557493  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.000s	sys 0.032s
I20260709 12:58:51.557842  1681 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.558396  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.559221  1538 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.560678  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.557746  1682 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.531929  3005 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.554250  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:51.557801  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 602163us
I20260709 12:58:51.511437  3000 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:51.594060  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.565011  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.553309  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.597326  1537 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.543797  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.599314  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.538528  2880 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.539268  3023 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:51.535912  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:51.511736  2921 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.554339  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:51.592646  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 123137us
I20260709 12:58:51.613722  1685 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.614006  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.614588  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.599192  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.615788  1612 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:51.596941  1688 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.616695  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.617211  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.553364  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.562875  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.601007  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.584772  1681 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.619164  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.532948  2994 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.607632  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.564179  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.562779  3006 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.561816  3027 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.538758  2872 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.641273  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:51.621016  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:51.642017  1616 raft_consensus.cc:2368] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:51.642082  1612 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.618223  1689 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.549572  3003 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.627866  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.560734  2855 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.584344  3026 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.630190  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.658010  1690 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.635569  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.598018  3000 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.636873  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:51.659798  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.639221  1538 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.606464  2880 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:51.643636  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 131858us
I20260709 12:58:51.668159  1537 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.668215  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.668859  1613 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:51.669138  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.669646  1537 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.670192  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.644968  1688 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.646029  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.671532  2308 raft_consensus.cc:2368] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:51.670650  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.648456  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:51.634510  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-1bb16b93f1fe47b4be38ae591c62b564 received from {username='slave'} at 127.0.0.1:53078
I20260709 12:58:51.661546  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:51.678020  1689 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:51.678782  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.662230  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.625344  2998 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.662724  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.612457  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:51.622118  1532 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.674876  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.675912  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.676468  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.673959  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:51.634550  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.641314  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 994) took 1178 ms. Trace:
I20260709 12:58:51.682883  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.698712  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.666492  2305 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:51.613102  3005 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.680258  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.686416  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.699411  1614 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:51.686558  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.689745  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:51.685701  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 98342.2us
I20260709 12:58:51.691272  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.691529  2847 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.691892  3007 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:51.692521  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-1bb16b93f1fe47b4be38ae591c62b564 on tablet 1bb16b93f1fe47b4be38ae591c62b564 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:51.640983  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:51.672062  2880 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.697459  1612 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:51.645818  3027 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.701407  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:51.701617  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 144419us
I20260709 12:58:51.703272  1613 raft_consensus.cc:2393] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:51.682479  2951 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:51.705561  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.705861  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.706135  2276 leader_election.cc:400] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:51.685662  3028 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.685475  3033 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.660161  3003 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.780602  2276 leader_election.cc:403] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:51.691290  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.690026  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.707227  1537 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:51.776554  1614 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:51.708330  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:51.777783  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.778205  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:51.784466  2308 raft_consensus.cc:2368] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:51.785753  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.786448  1614 raft_consensus.cc:2368] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:58:51.779523  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:51.786972  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 78765.1us
I20260709 12:58:51.738075  1687 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:51.738408  1608 raft_consensus.cc:2368] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:51.787266  1612 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:51.679167  3030 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:58:51.706481  2960 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:51.725306  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:51.789239  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 83443.6us
I20260709 12:58:51.818033  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.790012  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:51.789772  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 83788.6us
I20260709 12:58:51.672147  3026 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.737960  2994 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.794938  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.794873  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.776347  3028 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.826349  3028 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.827775  2921 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.794057  1532 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:51.698542  1684 rpcz_store.cc:276] 0709 12:58:50.463068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.471370 (+  8302us) service_pool.cc:224] Handling call
0709 12:58:50.885165 (+413795us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:58:50.885425 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.885664 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:51.300413 (+414749us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.596536 (+296123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.598926 (+  2390us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:51.614841 (+ 15915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.623463 (+  8622us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.636071 (+ 12608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69531,"prepare.queue_time_us":582787,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":42727,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":22417,"spinlock_wait_cycles":15453568,"thread_start_us":478400,"threads_started":2,"wal-append.queue_time_us":299046}
I20260709 12:58:51.833324  1536 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:51.792945  2951 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.833976  2951 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.834319  2951 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.835956  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.836639  1614 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:51.739115  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.837636  2302 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:51.826366  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.839032  1539 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.839123  2998 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.839654  2998 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.788537  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.840634  1535 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:51.842406  3027 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.843194  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.788443  3043 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:51.737917  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.737598  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.708328  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.844645  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:51.844934  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 136700us
I20260709 12:58:51.793522  3011 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.824118  1537 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:51.846576  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.847625  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.848378  3046 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.848733  3046 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.849092  3046 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.851610  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:51.816730  2989 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:51.852676  2989 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:51.853449  2921 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.853878  2921 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.853581  2989 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.854615  2921 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.854874  3025 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.855262  3025 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.855604  3025 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.857340  3003 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.862401  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:51.862977  1538 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.863143  2997 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:51.792497  3044 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.864965  3044 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:51.865306  3044 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.866456  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1727) took 1264 ms. Trace:
I20260709 12:58:51.869640  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.869796  1539 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:51.869989  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.870776  3005 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:51.871479  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.872045  1611 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:51.872352  2872 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:51.874480  3026 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.874925  3046 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.878364  3028 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.879611  1616 raft_consensus.cc:2368] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:51.866798  1533 rpcz_store.cc:276] 0709 12:58:50.601954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.231896 (+629942us) service_pool.cc:224] Handling call
0709 12:58:51.232209 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.232533 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:51.546793 (+314260us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.830891 (+284098us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b1800327520. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:58:51.865954 (+ 35063us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800327520. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287
0709 12:58:51.866136 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.866188 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:51.866227 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.866296 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.866405 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33877,"prepare.queue_time_us":387453,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":91991,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5921,"spinlock_wait_cycles":37186688,"thread_start_us":435100,"threads_started":3,"wal-append.queue_time_us":99652}
I20260709 12:58:51.704483  2847 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.819139  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.780602  3033 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.708400  2919 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.905937  1615 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:51.824797  2994 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.825479  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:51.786049  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 159625us
I20260709 12:58:51.701323  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:51.894196  1538 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:58:51.904305  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 85240.2us
I20260709 12:58:51.924902  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:51.893731  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 275754us
I20260709 12:58:51.909961  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.863839  3000 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.926782  1507 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.918807  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.930102  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.931345  2872 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.931758  2872 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.874549  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:51.933110  1581 leader_election.cc:400] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:51.933466  1581 leader_election.cc:403] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:51.935635  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.936590  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.934413  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:51.903920  2847 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.939797  1507 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:51.932087  2872 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.940616  3045 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.925405  3020 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.950839  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:51.954983  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 168075us
I20260709 12:58:51.907526  2919 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.880067  3006 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.908764  3033 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.932703  3023 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.952756  1507 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:51.953383  1682 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:51.956082  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 108528us
I20260709 12:58:51.944003  2997 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:51.938493  2980 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.954624  3020 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.956634  2919 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.959977  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.939072  3026 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.985003  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.966182  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:51.951674  1683 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:51.945830  2926 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.965926  3029 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.954828  2855 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:51.950467  3045 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:51.974020  1507 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:51.959940  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 164388us
I20260709 12:58:51.958189  3011 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:51.982527  1682 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:51.963197  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.968502  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.976573  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:52.002592  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.004689  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:51.963917  3023 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:51.954110  2998 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:51.958406  3044 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.001799  2926 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.972029  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:51.982334  3020 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.003358  3029 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:52.060503  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.001816  3046 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.012633  3003 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:52.064726  1579 leader_election.cc:400] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:52.068318  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.037536  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.065135  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.068660  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.093196  1607 raft_consensus.cc:2393] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:52.061676  1614 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:52.093926  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.094843  1613 raft_consensus.cc:2368] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:52.095872  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.094417  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:52.096748  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.008493  3045 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:52.099543  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 133149us
I20260709 12:58:52.097229  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:51.984362  3026 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.098093  1616 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.072928  2997 raft_consensus.cc:1064] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:52.007607  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.039036  3053 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:52.092115  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 296553us
I20260709 12:58:52.062166  2926 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.105331  1579 leader_election.cc:400] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:52.061698  2994 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.092063  3029 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:52.120915  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 146952us
I20260709 12:58:52.080509  3044 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.078811  3028 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.104115  3026 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.037498  2921 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:52.091845  3003 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:52.112960  1579 leader_election.cc:403] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:52.109838  3016 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.118028  3000 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.112311  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.112526  2962 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:52.099205  2912 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:52.036271  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:52.033437  3023 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.101507  2951 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.148418  3011 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:52.140362  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.149076  3011 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:52.149740  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.150277  2951 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.149982  3011 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.120764  2880 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.151362  1579 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.160192  3055 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:52.161151  2919 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:52.162510  2276 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.163357  2919 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.164415  2960 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:52.164791  2960 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:52.165127  2960 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:52.139705  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 134200us
I20260709 12:58:52.168244  3043 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:52.171243  3033 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.166283  3029 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:52.122139  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:52.172956  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 50931.1us
I20260709 12:58:52.110776  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:52.099432  3017 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.079541  3025 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.174117  1507 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:52.174892  3030 raft_consensus.cc:2764] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:52.121016  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.127535  3010 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:52.144270  2962 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.178144  3044 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:52.178308  3010 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.179114  2962 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:52.178046  3020 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.139407  3050 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:58:52.181195  1608 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:52.151970  2998 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.152412  2776 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:52.138823  3003 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.182138  3020 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.182405  2776 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:52.179957  3029 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.173445  3043 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:52.152534  3028 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.183197  3043 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.183638  3043 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.119700  2909 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.184651  2909 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:52.185225  2921 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.185475  2909 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.154570  2880 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.188596  3000 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:52.189006  3000 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:52.156544  2872 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.172473  1615 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:52.190928  2872 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:52.175776  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65049.6us
I20260709 12:58:52.067900  2847 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:52.146582  2306 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:52.177470  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.177781  3025 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.180382  3010 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:52.182806  2776 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.156629  2309 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:52.141620  3016 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:52.190774  3043 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.098814  1611 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:52.164127  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:52.251189  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 87134us
I20260709 12:58:52.177714  1686 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.143097  2997 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.111271  1504 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.193634  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.195446  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.148018  1616 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:52.196480  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:52.189356  3000 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.154423  1687 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:52.190826  3006 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.244323  3020 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:52.245755  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:52.252480  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:52.272071  2276 leader_election.cc:400] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:52.254208  1682 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:52.275767  2847 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.277277  2980 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:52.243883  3017 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:58:52.257507  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61111.7us
W20260709 12:58:52.261787  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 150573us
I20260709 12:58:52.259703  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:52.262326  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:58:52.262501  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 68951.8us
W20260709 12:58:52.262560  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67173.8us
I20260709 12:58:52.262993  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.263082  3029 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:52.263576  3058 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:52.265813  3003 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.290231  2951 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.286104  1612 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:58:52.145009  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 137307us
I20260709 12:58:52.287897  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:52.255028  2981 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:52.256122  2880 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.270483  3016 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:52.387162  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.280938  2872 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:52.415341  1610 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.431165  2981 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:52.436628  2981 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.437485  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:52.438144  1540 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.442270  1610 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:52.463157  2960 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.292303  3027 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.292765  3017 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.368115  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:52.284911  3020 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.368392  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:52.369232  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 75119us
W20260709 12:58:52.361439  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 67705.6us
I20260709 12:58:52.367524  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:52.512804  1541 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:52.512730  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:52.281966  2776 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.179996  2962 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:52.487136  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 223306us
I20260709 12:58:52.491387  1683 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:52.467372  2926 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:52.503463  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 217656us
W20260709 12:58:52.504980  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 217192us
I20260709 12:58:52.423046  3058 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:52.416821  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:52.518959  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.515646  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:52.421101  3049 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 12:58:52.481940  2951 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:52.524422  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.506177  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:52.511246  2909 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.546751  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:52.547420  1538 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:52.526876  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.518960  3044 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:52.429204  3059 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 12:58:52.540238  2302 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:52.541468  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.543920  3043 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:52.544175  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.548950  1609 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:52.529024  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.560992  1607 raft_consensus.cc:2393] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:52.518914  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:52.510805  3027 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:52.523391  3025 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.526021  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.604162  1687 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.604904  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:52.606700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:52.607570  1537 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:52.583420  2921 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:52.611619  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.611747  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.580997  3027 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.613301  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.614392  3011 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.613312  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.615646  1613 raft_consensus.cc:2368] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:52.615787  2776 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:52.615917  1687 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:52.555970  2919 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:52.617147  2919 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.617866  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.618170  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.618994  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.619139  2919 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.619179  1681 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:58:52.536978  2880 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.620445  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.620800  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.620886  2880 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:52.621481  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.621897  2880 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.623824  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:52.590217  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:52.625842  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 107007us
I20260709 12:58:52.626063  1614 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:52.626544  1582 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.590761  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.538250  3033 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.601941  1538 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:52.602303  3017 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.602510  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.630587  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:52.603360  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:52.520787  3058 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.623875  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.569232  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.630746  1609 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.616490  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.632614  1613 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:52.633183  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.633414  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:52.633710  1613 raft_consensus.cc:2368] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:52.633991  1541 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.634619  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.635646  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:58:52.636329  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.555728  1532 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:52.562443  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.649070  1609 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:52.642268  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.651248  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.567755  2909 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:52.520320  3023 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:52.582396  3020 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.620532  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.650159  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.736356  2951 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.651172  3055 raft_consensus.cc:2764] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:52.648651  2981 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:52.729364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.641948  3025 raft_consensus.cc:697] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:52.770519  3016 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:58:52.815246  3045 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
W20260709 12:58:52.845610  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 219150us
W20260709 12:58:52.848742  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 197441us
I20260709 12:58:52.855078  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.814437  2301 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:52.849912  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.731145  3021 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:58:52.851925  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:52.914556  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 265069us
I20260709 12:58:52.739542  1686 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:52.916290  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:52.856813  1684 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:52.851116  3017 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.855762  2997 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:52.934428  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:52.854959  2981 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:52.949962  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 94965.3us
W20260709 12:58:52.947651  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 92411.7us
I20260709 12:58:52.942991  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.950716  1541 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:52.952260  2776 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:52.956038  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.952370  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.928264  1611 raft_consensus.cc:2368] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:52.964540  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:52.966157  3055 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:52.966655  3055 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:52.966041  3016 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.967023  3055 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.961007  2909 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.969264  3046 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.971719  2309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 192) took 1304 ms. Trace:
I20260709 12:58:52.912752  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:52.961488  1582 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.962836  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:52.972087  2309 rpcz_store.cc:276] 0709 12:58:51.667788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.667979 (+   191us) service_pool.cc:224] Handling call
0709 12:58:51.844508 (+176529us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800075f98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 12:58:52.971514 (+1127006us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400475754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:52.971641 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719165056}
I20260709 12:58:52.980432  1582 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:52.902328  3045 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.947913  2960 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.949230  3003 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:52.988209  3045 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.985031  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:52.990434  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:52.991080  3010 consensus_queue.cc:1059] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.976274  2926 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.993028  2926 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.993942  2926 raft_consensus.cc:3055] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.994270  2980 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:52.994381  2926 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:52.994899  2980 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:52.995774  2981 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:52.995836  2980 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:52.957799  2997 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:52.968461  3027 consensus_queue.cc:1059] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:58:52.998953  2997 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:52.999691  2997 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:53.000458  2951 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.000986  2951 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.003837  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.005247  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.006346  1612 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:53.007337  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.003037  2951 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:53.010100  3010 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:53.010655  3010 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.011550  3010 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:53.015251  3000 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 12:58:53.016798  2981 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.017336  2981 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.018162  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:58:53.018828  1540 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:58:53.019276  1540 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:53.019371  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.020558  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:53.020838  3023 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.021593  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:52.982692  3025 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.022166  1681 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:53.022938  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:53.023427  1681 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:53.023551  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:53.024281  2919 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.984122  3017 raft_consensus.cc:2764] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:52.984285  3074 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:52.984475  3058 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.028082  3017 consensus_queue.cc:1059] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:53.029282  3074 raft_consensus.cc:3055] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:53.029649  3074 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.029448  3058 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.028086  1687 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:53.032184  3074 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.033604  3074 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.036023  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.036614  1607 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.042122  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:53.042995  1611 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:53.019994  1684 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.047050  2962 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.048910  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:53.024165  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:53.050866  3050 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:53.050935  1681 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:53.051510  3050 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:53.052101  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.052978  1681 raft_consensus.cc:2368] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:53.053774  1581 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.054006  3028 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.054512  2834 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:53.054641  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.054932  2834 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.055330  3022 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:53.055572  2834 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.055893  3022 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.056362  3074 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:53.056756  3074 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.057114  3074 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.056939  3022 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.058511  3022 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.061054  2776 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:53.062628  2776 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:53.032778  3055 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.062927  2776 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.063627  2776 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.064484  3055 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:53.064826  2776 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.069727  1684 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:53.078869  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.080966  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.088925  1607 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:53.088979  1681 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:53.094336  2981 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:53.150589  1581 leader_election.cc:400] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:53.151808  1581 leader_election.cc:403] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:58:53.158576  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.158739  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 224384us
I20260709 12:58:53.160933  1656 leader_election.cc:400] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:58:53.000115  2997 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:53.162145  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.163362  1612 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:53.163446  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.015805  3000 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.165534  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:53.167429  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 70387.6us
I20260709 12:58:52.995606  2926 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.151000  2951 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.169523  2776 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:53.173094  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.173336  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.160790  2979 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.175698  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.177829  1688 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:53.177851  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.165480  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.179744  2776 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:53.077462  3050 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.168515  3003 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.172569  3006 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:53.164466  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 163520us
I20260709 12:58:53.172573  2951 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.170197  3079 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:53.170302  3078 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.177665  2979 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.179975  3046 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.201983  2834 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:53.202831  3082 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:58:53.189980  2847 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.203863  3000 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:53.208766  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.211202  2309 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.212641  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:53.250598  2307 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:53.195283  2998 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.194175  3061 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:53.214038  3050 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:53.216958  3026 consensus_meta.cc:287] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.002s
W20260709 12:58:53.257495  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 79659.2us
I20260709 12:58:53.190649  2925 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:53.220633  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:53.195330  2997 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.221339  2979 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.221390  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:53.227371  3074 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.182274  3055 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:53.230422  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:53.236747  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.252333  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.196755  2951 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:53.258052  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49384.8us
I20260709 12:58:53.258651  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.449010  2926 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.348984  1685 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.452427  1507 leader_election.cc:400] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:53.514647  2925 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.515487  1507 leader_election.cc:403] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:53.516111  3050 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:53.516883  3011 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.357854  1537 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.357331  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.266077  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.517967  1535 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.306468  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.518667  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:53.395898  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.518959  1686 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.520125  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.356350  2855 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:53.520946  1609 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:53.521216  2855 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.521938  3074 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.365845  3059 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:53.522877  3059 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.523303  2855 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.356863  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.524320  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:53.524453  1532 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:53.524925  3059 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.351918  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.525943  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.526738  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1036) took 1002 ms. Trace:
I20260709 12:58:53.526808  1532 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.527130  1616 rpcz_store.cc:276] 0709 12:58:52.524806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.351599 (+826793us) service_pool.cc:224] Handling call
0709 12:58:53.526672 (+175073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.448064  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 131) took 1953 ms. Trace:
I20260709 12:58:53.528064  1439 rpcz_store.cc:276] 0709 12:58:51.531071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.538309 (+  7238us) service_pool.cc:224] Handling call
0709 12:58:53.447992 (+1909683us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6,"reported_tablets":5}
I20260709 12:58:53.529035  3073 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.373961  1687 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.356678  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.529615  3073 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.530134  1541 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:53.530217  3073 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.531347  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.365357  2305 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:53.532191  1541 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:58:53.532655  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 280437us
I20260709 12:58:53.445166  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff79ac342d91424db634ca7802846535"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:53.357182  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.534452  2909 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.535953  1539 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.371184  1613 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:53.265903  2834 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.537318  3055 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.356999  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.354416  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.384582  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.379308  3044 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:53.534180  1536 raft_consensus.cc:606] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:58:53.544864  3055 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.383411  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:58:53.517074  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 64847.4us
I20260709 12:58:53.264793  3023 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:53.549997  1611 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.550733  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.517069  2925 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.552682  3050 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.553305  3050 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:53.554270  3058 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:53.554641  3058 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:53.555423  3058 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.442174  3029 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.556731  3029 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.558189  3058 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.559128  3029 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.356084  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.560364  1534 raft_consensus.cc:2368] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:58:53.561961  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.562537  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:53.482738  2880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.010s
W20260709 12:58:53.563896  2880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.005s	sys 0.011s
I20260709 12:58:53.258671  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:53.308740  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1026) took 1132 ms. Trace:
I20260709 12:58:53.266052  3061 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.564582  1682 rpcz_store.cc:276] 0709 12:58:52.176335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.177173 (+   838us) service_pool.cc:224] Handling call
0709 12:58:53.308496 (+1131323us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b540032cdd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:53.308653 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22745344}
I20260709 12:58:53.565853  3050 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.541785  3044 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.546617  2919 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:58:53.566248  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 307670us
I20260709 12:58:53.533383  1541 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.566846  2919 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:53.567477  3011 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.567878  3023 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.569002  2919 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.568836  3023 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:53.570569  2979 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.571674  3044 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.572239  1537 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.572386  1612 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.538625   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:53.534662  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 276102us
I20260709 12:58:53.575908  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.576989  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:53.578593  3078 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.578930  3078 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.579257  3078 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.579406  2925 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.580700  2962 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:53.581079  2962 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.581857  2962 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.260321  3026 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.431676  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 217) took 3778 ms. Trace:
I20260709 12:58:53.548151  2834 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:53.305658  3079 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.566190  3061 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.577966  3027 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.546911  1535 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:53.590999  2997 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:53.398550  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.563230  3022 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:53.589092  3079 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.585362  1539 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:53.349560  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 194) took 1674 ms. Trace:
I20260709 12:58:53.579272  2912 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:58:53.453361  1435 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.585346  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.569022  1507 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.602485  1507 leader_election.cc:400] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:53.602732  1507 leader_election.cc:403] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:53.586802  2962 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.587786  1533 raft_consensus.cc:2393] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:53.592293  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 1758) took 1071 ms. Trace:
I20260709 12:58:53.584216  1532 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:53.596282  2979 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.588543  2834 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:53.584935  1612 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:53.603349  2912 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:53.602408  1435 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to <none>, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:53.603682  2306 rpcz_store.cc:276] 0709 12:58:51.675399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.677529 (+  2130us) service_pool.cc:224] Handling call
0709 12:58:53.349298 (+1671769us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b54001342d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:53.349473 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191456640}
I20260709 12:58:53.590672  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.627405  1536 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:53.606386  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.628662  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:53.585917  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 355592us
I20260709 12:58:53.629364  1541 raft_consensus.cc:2368] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:53.629926  1681 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:53.630025  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.607190  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.607674  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.608109  3044 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:58:53.608629  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.590602  1537 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:53.608047  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:53.631624  1539 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.612056  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:53.632831  1690 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.555399  2951 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.604494  3029 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:53.608646  2921 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.627420  1682 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.609162  1656 leader_election.cc:400] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:53.646724  1656 leader_election.cc:403] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:53.621309  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1101) took 1018 ms. Trace:
I20260709 12:58:53.646126  1690 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:53.647176  1533 rpcz_store.cc:276] 0709 12:58:52.602978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.603109 (+   131us) service_pool.cc:224] Handling call
0709 12:58:53.621066 (+1017957us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400073354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:53.621237 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199806720}
I20260709 12:58:53.634524  1435 catalog_manager.cc:5697] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:58:53.635720  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.641187  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:53.642200  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.587646  3078 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.624765  2834 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:58:53.652895  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 43869.3us
I20260709 12:58:53.658666  1682 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:53.644897  1539 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:53.588723  1437 rpcz_store.cc:276] 0709 12:58:49.653308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.653467 (+   159us) service_pool.cc:224] Handling call
0709 12:58:53.431588 (+3778121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:51.217790 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:51.257165 (+ 39375us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:51.257196 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:58:51.257214 (+    18us) tablet.cc:662] Decoding operations
0709 12:58:51.267435 (+ 10221us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:51.267512 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:51.267536 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:51.267928 (+   392us) tablet.cc:701] Row locks acquired
0709 12:58:51.267948 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:58:51.268087 (+   139us) write_op.cc:270] Start()
0709 12:58:51.268191 (+   104us) write_op.cc:276] Timestamp: P: 1783601931268043 usec, L: 0
0709 12:58:51.268215 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:58:51.326269 (+ 58054us) log.cc:844] Serialized 1370 byte log entry
0709 12:58:52.035556 (+709287us) op_driver.cc:464] REPLICATION: finished
0709 12:58:52.271657 (+236101us) write_op.cc:301] APPLY: starting
0709 12:58:52.271753 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:52.271885 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:52.272008 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:52.272490 (+   482us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:52.272687 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:52.272734 (+    47us) write_op.cc:312] APPLY: finished
0709 12:58:52.272947 (+   213us) log.cc:844] Serialized 35 byte log entry
0709 12:58:52.273119 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:52.273222 (+   103us) write_op.cc:454] Released schema lock
0709 12:58:52.273262 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:52.273627 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:52.273655 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30238,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":206920,"apply.run_cpu_time_us":1986,"apply.run_wall_time_us":16188,"num_ops":3,"prepare.queue_time_us":301981,"prepare.run_cpu_time_us":36149,"prepare.run_wall_time_us":578714,"raft.queue_time_us":275344,"raft.run_cpu_time_us":15393,"raft.run_wall_time_us":160975,"replication_time_us":726149,"thread_start_us":545374,"threads_started":4,"wal-append.queue_time_us":329945,"wal-append.run_cpu_time_us":39602,"wal-append.run_wall_time_us":1602242}]]}
I20260709 12:58:53.668073  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.669140  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:53.626989  2912 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.673085  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.678824  1682 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:53.679375  1656 leader_election.cc:400] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:53.683015  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:53.683184  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:53.684134  1612 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:53.684376  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.686305  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:53.688022  3029 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:53.688578  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:53.689153  1616 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:53.688956  3029 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.692754  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.610070  1608 rpcz_store.cc:276] 0709 12:58:52.520791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.523172 (+  2381us) service_pool.cc:224] Handling call
0709 12:58:53.265917 (+742745us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b5800013e98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26eee 0000000000375939 00007f8d5db9a1e0 00007f8d5dc630c4 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 12:58:53.592080 (+326163us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400178ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:53.592203 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176200320}
I20260709 12:58:53.633124  3087 consensus_queue.cc:1059] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:58:53.694655  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.698737  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.673866  1611 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:53.704469  2921 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:53.705016  1538 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:53.682966  3050 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:58:53.666810  3053 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:53.705668  2847 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:53.706588  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:58:53.707147  1612 raft_consensus.cc:606] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:53.707504  3078 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:53.709275  1507 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.709741  1538 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.676631  3000 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:53.711702  1538 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:58:53.713346  1538 pending_rounds.cc:85] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 1
I20260709 12:58:53.711800  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.716173  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.716341  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.712404  2921 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:53.683671  3052 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.682780  2998 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:53.708106  2304 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:53.718364  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:53.724802  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.725546  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.726504  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff79ac342d91424db634ca7802846535"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:53.722266  1533 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:53.726653  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.727314  1537 raft_consensus.cc:606] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:58:53.723433  1539 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:53.713595  1538 pending_rounds.cc:107] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:53.729017  1538 raft_consensus.cc:2889] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:53.730013  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.699659  3059 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:53.733296  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.710798  2305 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.734884  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.735359  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.736089  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.682718  3010 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:58:53.703622  2834 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.738797  1533 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:58:53.712577  3092 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:53.739252  2979 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:53.720582  3054 raft_consensus.cc:2764] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:53.746282  1615 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:53.745509  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.733248  2994 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.743194  1533 pending_rounds.cc:85] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 4
I20260709 12:58:53.747411  1607 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:53.728492  3067 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.724045  2998 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.748076  1538 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:53.744623  3064 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:53.734040  3058 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.750778  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.750873  1533 pending_rounds.cc:107] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:58:53.753108  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:53.713598  3073 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.757143  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.712679  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.760747  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:53.748750  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.749505  3105 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:58:53.759753  2847 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.761756  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.765197  1533 raft_consensus.cc:2889] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:53.749238  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:53.750483  3055 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:53.761456  2921 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:53.768350  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.749670  3092 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:53.756325  2979 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.744776  2925 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:58:53.761067  2998 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.763850  3050 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.848141  1612 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:53.763270  3025 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:53.913575  3025 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.889812  2979 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:53.915817  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 147553us
I20260709 12:58:53.890244  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:53.892760  3092 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.894408  1685 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:53.917493  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.918654  3045 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.918568  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.894995  1686 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:53.886596  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:53.899190  2998 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:53.900840  3079 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:53.903179  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.816569  1532 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:53.905705  3052 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:53.906059  1426 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for ff79ac342d91424db634ca7802846535 already in progress [suppressed 8 similar messages]
I20260709 12:58:53.908923  2880 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:53.888674  2997 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.941236  2997 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:53.818831  3073 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:53.817148  2951 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:53.804344  2834 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.914435  1611 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:53.796669  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 94484.2us
I20260709 12:58:53.914616  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:53.878764  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 119062us
I20260709 12:58:53.964649  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.941746  2997 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.773016  2980 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:53.905377  3044 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:53.767171  3064 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:53.928799  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:53.926363  3087 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:58:53.922945  3058 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.926611  3017 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:58:53.930425  1581 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:53.932010  3025 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:53.932940  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:53.934633  3106 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:58:53.807794  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:53.796976  3061 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.773586  3026 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:53.827914  3109 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:53.960943  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 192962us
I20260709 12:58:53.768990  3006 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 12:58:53.920141  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.942314  1614 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:53.966600  1539 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:53.965940  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.999513  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.938359  2994 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.947190  3104 raft_consensus.cc:993] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower d3b488cf00f7497ea0bf5964b99f6e0e to start an election
I20260709 12:58:53.947546  3054 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:53.941892  2880 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:53.884759  2847 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.979128  3052 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:53.886153  3055 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:53.994524  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.000572  1582 leader_election.cc:400] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:58:53.983690  3044 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:54.012811  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:54.003422  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:53.962790  3045 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:58:54.009884  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 89819.1us
I20260709 12:58:54.014134  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:54.016903  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.018440  1656 leader_election.cc:400] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:58:54.018795  1656 leader_election.cc:403] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:54.003801  3025 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.035333  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.037197  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.038987  1687 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:54.032539  3067 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.040155  3067 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:54.009254  3027 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.041541  3027 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:54.041911  3027 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.044245  3006 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:54.044476  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:54.044839  3006 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.045642  3006 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.046052  3055 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:54.046703  3064 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.047465  3052 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:54.047103  3079 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:54.020440  3061 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.032606  2847 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:54.014307  3109 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.020844  2909 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.044337  1534 raft_consensus.cc:2410] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:54.036708  3025 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:54.020707  3053 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.022069  3058 raft_consensus.cc:1081] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Signalling peer d3b488cf00f7497ea0bf5964b99f6e0e to start an election
I20260709 12:58:54.014804  3000 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.030413  3078 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:58:54.063482  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.066478  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3306db491bf34b228d1100fd9c826528"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:54.077031  1537 raft_consensus.cc:606] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Received request to transfer leadership to TS d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.077401  1537 raft_consensus.cc:614] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:54.023491  3054 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:54.073220  3050 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.066123  2847 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:54.066502  3026 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.074596  3025 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:54.108124  1426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 202196us
I20260709 12:58:54.110132  3078 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:54.112870  1690 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:54.113993  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.033617  2880 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:54.117419  1690 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:54.119796  1690 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:54.122215  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.122815  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.123567  1689 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:54.041016  3067 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.104496  3000 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:54.127837  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.128163  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:54.129392  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:54.132000  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 151678us
I20260709 12:58:54.136513  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:54.138703  1683 raft_consensus.cc:2368] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:58:54.136430  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:54.114075  3109 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.148520  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.148406  2912 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.148998  2855 consensus_queue.cc:1059] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.112774  2847 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:54.156819  3067 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.108330  3050 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.107606  3053 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:58:54.075054  3044 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.200103  3044 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.114984  2998 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:54.120483  2921 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:58:54.100785  2997 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.205688  2997 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:54.116259  3087 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:54.206328  3087 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:54.165088  3119 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:58:54.182665  1686 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:54.182708  3109 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.190096  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:54.190146  2847 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:54.194077  3026 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.168771  2880 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.225955  3113 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:54.226342  3109 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:54.181079  3054 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.221801  1537 raft_consensus.cc:606] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:54.225154  3027 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.236042  3025 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.238119  3025 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:54.226341  3113 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:58:54.239902  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 309555us
I20260709 12:58:54.248703  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.240480  3112 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:54.245240  1614 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:54.253937  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff79ac342d91424db634ca7802846535"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:46818
I20260709 12:58:54.254653  1616 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.255085  1616 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.257414  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:54.258121  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 245368us
I20260709 12:58:54.258086  1607 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:54.259728  1686 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:54.260835  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:54.261519  3068 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.263058  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:54.263820  1537 raft_consensus.cc:606] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:54.265225  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 135902us
I20260709 12:58:54.268271  3000 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.269141  3000 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.253091  2912 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.262502  3123 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.278363  3091 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:58:54.282133  2847 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.282298  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:54.282596  2847 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.283032  3050 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:54.283795  3029 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:54.283484  2847 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:54.285835  2847 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.287144  3112 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:54.288122  3112 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.291391  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:54.292045  1537 raft_consensus.cc:606] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:54.292569  1537 raft_consensus.cc:614] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:54.291966  1616 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:54.284024  3050 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.272406  3052 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.298174  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:54.302747  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:54.308869  1609 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:54.307341  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:54.303256  3068 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.309981  1612 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:54.310679  1616 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:54.311290  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:54.313215  3027 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:54.317744  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:54.321811  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55700.9us
I20260709 12:58:54.295292  3123 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.323532  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:54.324235  1607 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:54.301373  3050 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.300194  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:54.329855  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.331233  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:54.332171  1685 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:54.320739  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:54.322373  3091 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.345039  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:54.343274  1541 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:54.327661  3050 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.326938  2926 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:54.321345  2880 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:58:54.347675  3073 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.358975  2951 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:54.360844  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff79ac342d91424db634ca7802846535"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:58:54.342046  2962 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:58:54.353881  3068 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.322152  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:54.348862  3091 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:58:54.373615  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.384375  3091 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.385710  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.386847  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:54.350893  1611 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:54.387881  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:54.397504  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:54.399263  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:54.409382  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 91752.9us
I20260709 12:58:54.412046  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.412276  2980 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.368150  2909 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:58:54.355894  3053 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:58:54.416333  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.413889  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.417711  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.356132  2926 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:54.391929  2921 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.421228  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.415485  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:54.415622  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47954.3us
I20260709 12:58:54.423142  1582 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:54.415144  1507 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:54.405195  2880 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.405333  3052 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.425655  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.426625  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:54.430960  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:54.409782  2998 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.440385  1541 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:54.440665  1535 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:54.441736  1541 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:54.438788  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:54.407209  1532 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:54.438750  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:54.439039  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.439312  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:54.391276  2919 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:58:54.409955  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 105164us
I20260709 12:58:54.452049  1536 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:54.454841  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:54.456359  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:54.439582  2962 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.355615  3123 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.480196  1614 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:54.475471  3130 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.419680  3026 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:58:54.489730  2302 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Advancing to term 3
I20260709 12:58:54.360867  3113 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.465723  2998 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.452088  3052 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.491812  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:54.496846  2880 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:54.497326  2926 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:54.490762  3109 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.491065  3074 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.507706  3109 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.514282  3109 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.502069  3123 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.508639  3113 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.503135  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:54.512110  3074 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.503516  3087 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:54.523557  3052 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.524302  3029 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:54.528846  2998 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.531018  3078 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:54.582481  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:54.604460  3116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.016s	sys 0.025s
W20260709 12:58:54.605075  3116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.016s	sys 0.026s
I20260709 12:58:54.571998  3078 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:54.579133  3067 raft_consensus.cc:993] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:54.580870  3055 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.624099  3067 raft_consensus.cc:1081] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Signalling peer c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:54.623005  3044 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.579278  3050 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.644414  3074 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:54.624425  3055 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.666491  1539 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:54.641386  3044 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:58:54.637044  3006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.015s	sys 0.026s
I20260709 12:58:54.620527  3109 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:54.675441  2921 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.681934  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:54.731076  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49270.9us
W20260709 12:58:54.685074  3006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.015s	sys 0.026s
W20260709 12:58:54.730177  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.752015  3064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.023s
I20260709 12:58:54.752038  2834 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:54.752197  2926 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.633679  3091 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:54.726464  3104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.016s	sys 0.016s
I20260709 12:58:54.640642  3078 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:54.754550  3045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.021s	sys 0.029s
I20260709 12:58:54.742766  2306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:56294
W20260709 12:58:54.761713  3054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.020s	sys 0.022s
I20260709 12:58:54.747575  2980 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:58:54.761521  3064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.004s	sys 0.023s
I20260709 12:58:54.788492  2980 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:54.778159  3045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.021s	sys 0.030s
I20260709 12:58:54.758530  2919 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:58:54.788898  2274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.031s	sys 0.012s
W20260709 12:58:54.755349  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 309846us
I20260709 12:58:54.793876  2309 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:54.767042  3067 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:54.796460  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.770991  3104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.016s	sys 0.016s
W20260709 12:58:54.784170  3054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.020s	sys 0.023s
I20260709 12:58:54.744846  2921 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:54.789438  2306 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.782563  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:54.860211  2274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.031s	sys 0.012s
I20260709 12:58:54.789258  3125 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
W20260709 12:58:54.901814  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.017s	sys 0.043s
W20260709 12:58:54.906611  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.017s	sys 0.043s
I20260709 12:58:54.856294  1608 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:54.791610  3123 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:58:54.779389  3044 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:54.920389  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.911651  1689 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:54.862169  2306 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.928385  1682 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:54.905841  3027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.042s
I20260709 12:58:54.927531  1689 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:54.902817  3010 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:54.861459  3067 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:54.934273  3027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.042s
I20260709 12:58:54.905015  1540 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:54.958284  1538 raft_consensus.cc:3055] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:55.003568  1538 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:55.004801  1538 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:55.006505  1538 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.966441  1614 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:54.960659  2951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.036s
I20260709 12:58:54.968858  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:54.969662  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.936384  3123 consensus_queue.cc:1243] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:54.948276  2919 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:55.022230  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.067068  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:54.955251  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:55.023002  2951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.001s	sys 0.036s
W20260709 12:58:55.077802  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 217867us
I20260709 12:58:55.080140  1612 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:55.080605  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 138332us
I20260709 12:58:55.085578  1506 leader_election.cc:400] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:58:55.085788  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:55.086118  1506 leader_election.cc:403] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:54.953126  3010 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.107880  1538 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:55.027277  3055 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.082974  3050 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:55.143796  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 376584us
I20260709 12:58:55.023015  3092 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:58:55.147742  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:55.083186  3109 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:55.149780  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64482.1us
W20260709 12:58:55.165719  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.116991  1534 raft_consensus.cc:606] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 12:58:55.102535  2304 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 LEARNER]: Advancing to term 3
W20260709 12:58:55.122865  2302 consensus_meta.cc:287] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.002s
I20260709 12:58:55.242173  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:55.107390  1532 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:55.139312  3132 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:55.266719  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:55.215905  3115 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:55.247136  1534 raft_consensus.cc:614] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:55.323068  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 969) took 1198 ms. Trace:
I20260709 12:58:55.331440  1612 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:55.277915  2855 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:55.276708  3155 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:58:55.264752  2925 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:58:55.109613  2919 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:55.285653  3132 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.147598  3055 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 12:58:55.265921  2980 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.331876  1690 rpcz_store.cc:276] 0709 12:58:54.127039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.127155 (+   116us) service_pool.cc:224] Handling call
0709 12:58:55.283765 (+1156610us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b540032dcd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:55.323000 (+ 39235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456160000}
I20260709 12:58:55.334478  3073 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:55.375128  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 227628us
I20260709 12:58:55.340032  3059 raft_consensus.cc:993] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower c445b7b7d94f48f99a3599ddfc92f462 to start an election
I20260709 12:58:55.350947  3026 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:55.345736  3017 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:55.186427  3091 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.341084  3045 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:55.341701  3074 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.342514  2921 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:55.382539  3136 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:58:55.377394  3052 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:55.382418  3168 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:55.438652  3130 raft_consensus.cc:1081] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Signalling peer c445b7b7d94f48f99a3599ddfc92f462 to start an election
W20260709 12:58:55.443468  3113 consensus_meta.cc:287] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.922s	user 0.006s	sys 0.005s
I20260709 12:58:55.450816  3067 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:55.495467  3149 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 12:58:55.495060  3146 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.252s
I20260709 12:58:55.454802  3074 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.496078  3127 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.474591  3168 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:55.509738  3156 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
W20260709 12:58:55.510051  3157 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 12:58:55.514278  3151 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
W20260709 12:58:55.529997  3150 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:58:55.530781  3169 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:58:55.525346  3171 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:55.516994  3127 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:55.538389  3168 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:55.539860  3145 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:58:55.564795  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.004s	sys 0.096s
W20260709 12:58:55.565917  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.004s	sys 0.096s
W20260709 12:58:55.566254  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.569159  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 85) took 1203 ms. Trace:
W20260709 12:58:55.570338  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.570904  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.571069  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1779) took 1123 ms. Trace:
I20260709 12:58:55.572553  1532 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:55.571884  1535 rpcz_store.cc:276] 0709 12:58:54.447358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.447508 (+   150us) service_pool.cc:224] Handling call
0709 12:58:54.450667 (+  3159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.942295 (+491628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.942349 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.954848 (+ 12499us) log.cc:844] Serialized 26 byte log entry
0709 12:58:55.139314 (+184466us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:55.139356 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.139426 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.570523 (+431097us) raft_consensus.cc:1685] finished
0709 12:58:55.570561 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.570904 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48033,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7643,"thread_start_us":549625,"threads_started":2,"wal-append.queue_time_us":249446}
I20260709 12:58:55.575609  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 87) took 1064 ms. Trace:
I20260709 12:58:55.576581  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 92) took 1158 ms. Trace:
I20260709 12:58:55.578106  1535 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:55.577013  1615 rpcz_store.cc:276] 0709 12:58:54.417683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.418345 (+   662us) service_pool.cc:224] Handling call
0709 12:58:54.418634 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.422739 (+  4105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.422780 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.423254 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.919160 (+495906us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:54.919248 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.921899 (+  2651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.575903 (+654004us) raft_consensus.cc:1685] finished
0709 12:58:55.575940 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.576210 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3740,"raft.queue_time_us":4560,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15383,"thread_start_us":457696,"threads_started":1,"wal-append.queue_time_us":776351}
I20260709 12:58:55.383234  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:55.576105  1536 rpcz_store.cc:276] 0709 12:58:54.510869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.511009 (+   140us) service_pool.cc:224] Handling call
0709 12:58:54.513700 (+  2691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.514008 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.514037 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.514486 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.777525 (+263039us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:54.777586 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.777672 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.575073 (+797401us) raft_consensus.cc:1685] finished
0709 12:58:55.575119 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.575384 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1767,"raft.queue_time_us":75170,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":8871,"thread_start_us":262329,"threads_started":1,"wal-append.queue_time_us":391755}
I20260709 12:58:55.378165  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:55.571694  1537 raft_consensus.cc:606] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:55.508524  3064 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.598413  2880 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.598610  2919 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.599915  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1070) took 1352 ms. Trace:
I20260709 12:58:55.600016  3010 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:55.354123  2302 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:58:55.600812  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.018s	sys 0.026s
I20260709 12:58:55.602859  2951 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:55.383373  2980 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.600420  3132 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.662106  3163 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:58:55.660006  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.018s	sys 0.026s
I20260709 12:58:55.663353  3163 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.664027  3064 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:58:55.669965  2274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.024s
W20260709 12:58:55.670518  2274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.014s	sys 0.024s
I20260709 12:58:55.669692  3064 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.681653  3173 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.569849  1533 rpcz_store.cc:276] 0709 12:58:54.365178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.365336 (+   158us) service_pool.cc:224] Handling call
0709 12:58:54.365666 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.365982 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.366014 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.384426 (+ 18412us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.800146 (+415720us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:54.855812 (+ 55666us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.969330 (+113518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.971203 (+  1873us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.568571 (+597368us) raft_consensus.cc:1685] finished
0709 12:58:55.568615 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.568909 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1154,"prepare.queue_time_us":59637,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":71628,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":17161,"spinlock_wait_cycles":1338624,"thread_start_us":527718,"threads_started":2,"wal-append.queue_time_us":1145399}
I20260709 12:58:55.687279  3134 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:55.688364  3155 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:55.687465  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1068) took 1793 ms. Trace:
I20260709 12:58:55.690717  1608 rpcz_store.cc:276] 0709 12:58:53.893861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.915098 (+ 21237us) service_pool.cc:224] Handling call
0709 12:58:53.929602 (+ 14504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.916437 (+986835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.685266 (+768829us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003d6dd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:55.687234 (+  1968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996631424}
I20260709 12:58:55.347920  2855 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.693763  2880 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.684808  3173 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.701251  2855 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.702611  2951 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.703884  2980 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.712407  3010 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.713265  3010 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.715886  3010 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:55.705348  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 322068us
I20260709 12:58:55.706096  3091 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.716536  2926 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.705065  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.688648  3134 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.723770  3178 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.728675  3125 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:55.451748  3017 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:54.500254  3058 consensus_queue.cc:1175] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "631fb66c0070402b8f78fd74633dae6f" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:55.731712  3017 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:55.725848  1616 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:55.699054  3155 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.737607  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 215) took 1245 ms. Trace:
I20260709 12:58:55.738461  2855 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.691123  3168 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:55.697412  3127 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:55.732285  3140 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 12:58:55.642649  1687 rpcz_store.cc:276] 0709 12:58:54.247455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.253528 (+  6073us) service_pool.cc:224] Handling call
0709 12:58:54.291546 (+ 38018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.349463 (+ 57917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.350520 (+  1057us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.414950 (+ 64430us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.850003 (+435053us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:54.857650 (+  7647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.888587 (+ 30937us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.599182 (+710595us) raft_consensus.cc:1685] finished
0709 12:58:55.599230 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.599583 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41906,"raft.queue_time_us":41870,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3206,"thread_start_us":309325,"threads_started":1,"wal-append.queue_time_us":1081231}
I20260709 12:58:55.738266  2302 rpcz_store.cc:276] 0709 12:58:54.481224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.483321 (+  2097us) service_pool.cc:224] Handling call
0709 12:58:54.489566 (+  6245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.672831 (+1183265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.726361 (+ 53530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:55.749976  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.750265  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.751061  1608 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:55.751150  1615 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:55.752537  2855 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.756652  3091 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.759757  3091 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.759442  2855 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.760988  2951 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.760661  2926 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.762967  3173 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.763345  3168 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.743741  3132 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.767200  2998 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.767323  2301 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:55.757084  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:55.769889  3052 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:55.778825  3155 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:55.778900  3168 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:55.767999  3163 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.780717  3064 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.781134  3179 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.779943  3127 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.768046  2880 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.787218  3132 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:55.794783  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1082) took 1502 ms. Trace:
I20260709 12:58:55.797742  3163 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:55.796607  3052 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 12:58:55.804889  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 66055us
I20260709 12:58:55.800693  1610 rpcz_store.cc:276] 0709 12:58:54.292755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.293417 (+   662us) service_pool.cc:224] Handling call
0709 12:58:54.293748 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.294091 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.294123 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.294566 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.848892 (+554326us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:54.849004 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.853981 (+  4977us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.794349 (+940368us) raft_consensus.cc:1685] finished
0709 12:58:55.794401 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.794625 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32365,"raft.queue_time_us":975,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4061,"spinlock_wait_cycles":28416,"thread_start_us":491704,"threads_started":1,"wal-append.queue_time_us":1242936}
W20260709 12:58:55.810051  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 53103.5us
I20260709 12:58:55.805863  3044 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.812348  3179 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:55.812080  3174 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 12:58:55.818207  2306 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.874s	user 0.009s	sys 0.008s
W20260709 12:58:55.819159  3068 consensus_meta.cc:287] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.453s	user 0.013s	sys 0.007s
I20260709 12:58:55.818493  3134 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.819639  3068 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:55.819857  2306 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.821341  1607 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:58:55.821477  2998 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:55.823474  2310 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:55.824810  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1141) took 1139 ms. Trace:
I20260709 12:58:55.806205  3017 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.825707  1541 rpcz_store.cc:276] 0709 12:58:54.685782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.685945 (+   163us) service_pool.cc:224] Handling call
0709 12:58:54.686385 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.716546 (+ 30161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.716590 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.717192 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.969806 (+252614us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:54.971623 (+  1817us) log.cc:844] Serialized 14 byte log entry
0709 12:58:55.065707 (+ 94084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.065789 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.820406 (+754617us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b180035f3e0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:58:55.824314 (+  3908us) raft_consensus.cc:1685] finished
0709 12:58:55.824427 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.824613 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67859,"prepare.queue_time_us":391,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":119240,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":19014,"spinlock_wait_cycles":12623616,"thread_start_us":251321,"threads_started":1,"wal-append.queue_time_us":382289}
I20260709 12:58:55.828651  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1146) took 1036 ms. Trace:
I20260709 12:58:55.829146  1539 rpcz_store.cc:276] 0709 12:58:54.792472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.976140 (+183668us) service_pool.cc:224] Handling call
0709 12:58:54.977139 (+   999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.071142 (+ 94003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:55.071185 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:55.071729 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:58:55.572953 (+501224us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:55.573048 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.573173 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.811170 (+237997us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:58:55.825250 (+ 14080us) raft_consensus.cc:1685] finished
0709 12:58:55.825269 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.828435 (+  3166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93217,"raft.queue_time_us":105661,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":25732,"spinlock_wait_cycles":13375744,"thread_start_us":461257,"threads_started":1,"wal-append.queue_time_us":422254}
I20260709 12:58:55.833393  3162 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:55.833840  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:55.834705  1609 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.835762  3052 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.836110  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34864 (request call id 76) took 1490 ms. Trace:
I20260709 12:58:55.837152  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.834270  3162 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.837289  1534 rpcz_store.cc:276] 0709 12:58:54.345252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.347612 (+  2360us) service_pool.cc:224] Handling call
0709 12:58:55.835676 (+1488064us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b5400225bd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c45853 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:55.835862 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737776384}
I20260709 12:58:55.839800  2926 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.839555  3052 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.837947  1685 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:55.843766  1684 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:55.844007  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:55.845237  3130 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.849116  3132 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.853552  3134 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:55.854084  3144 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:55.856581  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.851415  2834 raft_consensus.cc:993] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:58:55.824146  2998 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.826813  3017 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.859742  3134 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.860384  1684 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:55.871416  3078 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:55.872547  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.872987  2926 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:55.873701  2926 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.874364  1690 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:55.872103  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.861183  3179 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.863884  3162 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:55.857899  3144 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:55.865172  2306 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.814038  3178 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.866781  3132 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:55.866854  3115 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:55.867865  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:55.881029  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56294 (request call id 263) took 1193 ms. Trace:
I20260709 12:58:55.866801  1507 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:55.869402  3148 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:55.870955  1685 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:55.871081  3134 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:55.878831  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:55.859719  1653 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:55.885437  1609 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:58:55.876192  2926 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.877136  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.881276  3132 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:55.890034  3132 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.890784  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.891479  1682 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:55.892369  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:55.892637  2303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:56294
I20260709 12:58:55.892501  3181 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:55.877876  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.878460  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.876502  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:55.896517  2303 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:55.880620  3144 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.896945  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.897639  3144 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.897490  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.879340  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.876699  2834 raft_consensus.cc:1081] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:58:55.898681  2307 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:55.884774  2306 rpcz_store.cc:276] 0709 12:58:54.687863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.714826 (+ 26963us) service_pool.cc:224] Handling call
0709 12:58:55.880881 (+1166055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:55.901625  3165 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:55.902134  3165 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:55.902596  3165 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.887970  3115 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.901435  3134 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:55.885838  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.903240  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.903940  1682 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:55.894199  3181 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.908509  2305 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:55.906816  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:55.910143  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 52676.6us
I20260709 12:58:55.896976  2303 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:55.911983  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.912186  3108 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.912433  1688 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:58:55.912737  3108 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:55.915927  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.913780  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.909771  3181 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:55.919076  1685 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:55.922513  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:55.914615  3134 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:55.923453  1683 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:55.921459  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.927520  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:55.913381  3148 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.929883  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:55.919329  3162 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:55.920960  3064 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.936256  3162 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.943013  3162 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:55.933382  3179 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:55.941681  3017 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:55.947999  2962 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:58:55.951952  3146 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:55.951987  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.964674  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:55.965299  1582 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:58:56.023944  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.032528  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 91911.6us
I20260709 12:58:55.956543  3146 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.972501  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.031781  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.972476  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:56.048172  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.048522  3113 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:56.049623  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.050542  1609 raft_consensus.cc:2393] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:55.961660  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.961282  1608 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:55.960775  3064 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:55.961575  3148 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.059604  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.008344  3178 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.044430  3146 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.044467  2962 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:56.061427  1539 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:56.011461  3108 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:55.971625  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.974107  3131 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.007620  3179 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.080268  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 129455us
I20260709 12:58:56.085532  3029 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.086217  3029 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.090714  2303 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.091495  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.092693  1615 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:56.093684  2303 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.095124  3006 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.095544  3064 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.095595  3006 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:56.093806  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:55.969236  3134 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.079083  2304 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.690s	user 0.004s	sys 0.010s
I20260709 12:58:56.101639  1614 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:56.061822  1610 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:56.079267  3148 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.080353  3113 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:56.100909  1534 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:56.085155  2962 raft_consensus.cc:697] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:56.111478  3148 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.114427  1686 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:56.114849  1686 pending_rounds.cc:85] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:58:56.115087  1686 pending_rounds.cc:107] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:56.115368  1686 raft_consensus.cc:2889] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:56.109992  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.131796  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1781) took 1720 ms. Trace:
I20260709 12:58:56.132253  1607 rpcz_store.cc:276] 0709 12:58:54.411033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.413408 (+  2375us) service_pool.cc:224] Handling call
0709 12:58:54.432427 (+ 19019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.821851 (+1389424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.131511 (+309660us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400321c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:56.131749 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3192804224}
W20260709 12:58:56.137526  3180 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.362s	user 0.004s	sys 0.000s
I20260709 12:58:56.137010  2962 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:56.120929  3029 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.141547  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 264) took 1201 ms. Trace:
I20260709 12:58:56.141942  2310 rpcz_store.cc:276] 0709 12:58:54.940006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.940142 (+   136us) service_pool.cc:224] Handling call
0709 12:58:54.979482 (+ 39340us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800075f98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:58:54.979704 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.823967 (+844263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.141307 (+317340us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54002e5ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:56.141489 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945974912}
I20260709 12:58:56.143864  3179 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.093704  3074 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.143472  3181 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.164498  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64539.1us
I20260709 12:58:56.101434  3131 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.171844  3115 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.172623  3165 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:56.177170  1487 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0f82bbd9193f4b71a0c17a0357cf0ce9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:56.181640  3131 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.184152  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1088) took 1219 ms. Trace:
W20260709 12:58:56.184943  1487 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:58:56.185616  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:58:56.185981  3187 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:58:56.188514  2308 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:56.184616  1613 rpcz_store.cc:276] 0709 12:58:54.964440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.968317 (+  3877us) service_pool.cc:224] Handling call
0709 12:58:56.008095 (+1039778us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800013e98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:58:56.008504 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.105898 (+ 97394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.105928 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:56.105985 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:56.106020 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.183821 (+ 77801us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b54003f4b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:56.183870 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.183981 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218222080}
I20260709 12:58:56.193806  1537 raft_consensus.cc:614] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:56.194705  1538 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:56.194845  3181 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.195046  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38368 (request call id 8) took 1874 ms. Trace:
I20260709 12:58:56.195698  1537 rpcz_store.cc:276] 0709 12:58:54.321043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.323384 (+  2341us) service_pool.cc:224] Handling call
0709 12:58:56.193708 (+1870324us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002916a0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc8520 00007f8d58c45652 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:56.194887 (+  1179us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400309654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c45853 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:56.194996 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200192512}
I20260709 12:58:56.169459  2925 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:56.196616  2925 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.196969  2925 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.198246  3074 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:56.198830  3074 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.199563  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.199846  3148 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.200284  2301 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:56.201010  3074 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.201218  2880 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:56.201825  2880 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.174844  3115 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.203045  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.205422  3179 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:56.206557   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:56.207963  2309 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.208964  3028 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:56.209836  3028 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.211448  3091 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:56.144810  3113 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.212481  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1147) took 1297 ms. Trace:
I20260709 12:58:56.212985  1538 rpcz_store.cc:276] 0709 12:58:54.915238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.336939 (+421701us) service_pool.cc:224] Handling call
0709 12:58:55.823770 (+486831us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b5800002a98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:58:55.824102 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.195027 (+370925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.212167 (+ 17140us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400309654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:56.212420 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868631168}
W20260709 12:58:56.198455  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.215160  1537 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.216374  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.216853  1539 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.216740  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.209753  3006 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.155249  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.219276   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:56.219816  1536 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.203876  2880 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.229131  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.229255  1437 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.174858  3165 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.231046  1540 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:56.232316  3006 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.168552  3029 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.234969  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.235220  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.242215  1537 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:56.244643  1539 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:56.245802  3115 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:56.212050  3091 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.253155  1613 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:56.247740  3162 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.255051  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:56.256848  3029 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.261482  3028 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.262377  1608 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.275312  1610 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:56.263106  1609 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.266470  1681 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.276244  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.276876  1607 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:56.277738  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.278890  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.246925  3115 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.237376  3148 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.280298  3115 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:56.280642  3148 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.281690  3115 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.283123  3148 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:56.284476  3193 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 12:58:56.237545  3074 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:58:56.286140  3074 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:56.286512  2998 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.286859  3078 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.287192  2998 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.287427  3078 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.252404  2304 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:56.288486  3027 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.289181  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 478) took 1353 ms. Trace:
I20260709 12:58:56.269173  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.289479  2998 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.289588  2304 rpcz_store.cc:276] 0709 12:58:54.936022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.937992 (+  1970us) service_pool.cc:224] Handling call
0709 12:58:55.080265 (+142273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.288781 (+1208516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.289114 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:56.274775  3109 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:58:56.286598  3074 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:56.277086  2994 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.298276  1688 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.298326  3131 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.298462  2994 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.289191  3027 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.299140  3131 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.301275  3131 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.301468  3078 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.302042  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.302903  3029 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.303421  3029 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.303568  3168 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:56.303759  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.304217  3168 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.304646  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.305478  1688 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:56.307051  3027 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:56.308463  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 67556.4us
I20260709 12:58:56.313100  1681 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
W20260709 12:58:56.288520  3127 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.006s
W20260709 12:58:56.314206  3184 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:58:56.307812  3155 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:56.319540  3155 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:56.320619  3155 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.321631  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.321225  1688 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:56.322271  1536 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.303931  3029 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.307749  3027 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:58:56.302922  3108 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.308301  3168 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.330170  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 241) took 6405 ms. Trace:
I20260709 12:58:56.330536  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.308040  1439 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.315227  3115 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.335820  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.322264  3131 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:56.332443  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.344444  1686 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.322243  3155 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.342020  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.325426  1437 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.345753  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.347316  1539 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:56.348150  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:56.359195  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:56.365768  3052 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.365927  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.366484  3052 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.367153  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.367964  1607 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:56.368257  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.368772  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.368939  3061 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:56.369442  3061 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.369571  2304 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:56.369817  3061 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.370342  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:56.371411  3148 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:56.371476  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.372756  3148 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:56.373116  3148 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:56.373494  3148 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.373747  1688 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.373685  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.371533  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:56.376559  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.379143  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.379796  1533 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.380671  2994 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.382928  3029 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.346359  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.395026  3027 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.395334  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.395601  3027 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.345996  3131 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.397571  3131 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.397717  3027 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.398656  3027 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:56.405678  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.402282  1437 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 4, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.363355  1439 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 2 to 1, leader changed from <none> to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:56.356042  2951 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:56.414078  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.362769  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.416667  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.417465  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.368800  3052 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.421597  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:56.422183  1613 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.422024  1614 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:56.427729  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.428453  1537 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
W20260709 12:58:56.432091  3196 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:58:56.433285  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.433897  1609 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:56.434821  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.434995  3179 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:56.435357  3179 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.435426  1615 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:56.435755  3179 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.436455  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.437402  1608 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:56.437526  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:56.438016  3132 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 12:58:56.438457  3132 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.439163  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.441362  2847 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.413781  2951 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.426896  3078 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.442230  2951 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.442569  3078 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.433323  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:56.444705  3078 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.415642  3029 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:56.459545  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.447659  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:56.452638  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.452895  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.462361  1683 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.453347  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.463490  1688 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:56.454913  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.455358  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.456487  3091 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.456634  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.331907  1435 rpcz_store.cc:276] 0709 12:58:49.810880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.811016 (+   136us) service_pool.cc:224] Handling call
0709 12:58:49.841030 (+ 30014us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb5090 00007f8d58c53f3a 00007f8d5ea0a1cc 00007f8d5eb0837e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc 00007f8d5cfc8392 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:56.215929 (+6374899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:53.723505 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:53.773328 (+ 49823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:53.774566 (+  1238us) write_op.cc:435] Acquired schema lock
0709 12:58:53.821198 (+ 46632us) tablet.cc:662] Decoding operations
0709 12:58:53.895985 (+ 74787us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:53.896045 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:53.896071 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:53.896397 (+   326us) tablet.cc:701] Row locks acquired
0709 12:58:53.896415 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:58:53.896558 (+   143us) write_op.cc:270] Start()
0709 12:58:53.896665 (+   107us) write_op.cc:276] Timestamp: P: 1783601933896517 usec, L: 0
0709 12:58:53.896686 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:53.897261 (+   575us) log.cc:844] Serialized 1336 byte log entry
0709 12:58:54.723464 (+826203us) op_driver.cc:464] REPLICATION: finished
0709 12:58:55.531004 (+807540us) write_op.cc:301] APPLY: starting
0709 12:58:55.531104 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:55.531250 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:55.531365 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:55.532527 (+  1162us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:55.537882 (+  5355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:55.537922 (+    40us) write_op.cc:312] APPLY: finished
0709 12:58:55.538099 (+   177us) log.cc:844] Serialized 35 byte log entry
0709 12:58:55.538209 (+   110us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:55.538275 (+    66us) write_op.cc:454] Released schema lock
0709 12:58:55.538306 (+    31us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:55.538564 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:55.538580 (+    16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":566014,"reported_tablets":10,"spinlock_wait_cycles":61646208,"child_traces":[["op",{"apply.queue_time_us":807287,"apply.run_cpu_time_us":2108,"apply.run_wall_time_us":7588,"num_ops":3,"prepare.queue_time_us":71807,"prepare.run_cpu_time_us":15909,"prepare.run_wall_time_us":247887,"raft.queue_time_us":664996,"raft.run_cpu_time_us":18360,"raft.run_wall_time_us":213990,"replication_time_us":826618,"thread_start_us":885483,"threads_started":4,"wal-append.queue_time_us":112828}]]}
I20260709 12:58:56.460287  1533 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.457435  1534 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.424742  1532 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:56.444154  1610 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.469696  1685 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:58:56.429077  1437 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.457140  3125 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.472389  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.478972  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.480192  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.485356  1688 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:56.492544  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.493427  1507 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.494525  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.495107  1537 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:56.497152  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.497825  3029 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:56.498205  3029 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.498536  3029 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:56.502568  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 48512.2us
I20260709 12:58:56.502846  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57982
I20260709 12:58:56.503516  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.503669  1688 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:56.504202  1688 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.504801  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.491782  1437 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:58:56.427495  2925 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.521435  3052 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.522821  3168 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:56.523386  3168 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.523825  3168 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.524716  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.527240  2994 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:56.527631  2994 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.527969  2994 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.528242  2998 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.526152  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:56.544872  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 130156us
I20260709 12:58:56.566272  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.491204  3132 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.570335  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.512939  3027 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.528988  2998 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.512458  3162 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.485217  3125 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.609094  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.624955  2926 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.625417  2962 raft_consensus.cc:1064] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:56.625550  2926 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.632921  3074 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:56.634917  3177 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:56.635697  2998 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:56.638731  3198 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:58:56.642156  3199 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:58:56.604790  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.665627  1613 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:56.681807  1539 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 12:58:56.693131  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.665433  2926 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.645346  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:56.712407  2962 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.715751  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.666404  3134 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.725416  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 220675us
I20260709 12:58:56.700973  1688 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.739457  2306 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:58:56.747324  3134 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.720896  3044 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.744405  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:56.750291  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:56.703143  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:56.753594  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:56.758757  1688 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.759977  3028 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:56.748848  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.754410  2309 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:56.760512  3028 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.767221  3028 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.760931  3044 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.771085  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 74089.7us
I20260709 12:58:56.771333  3044 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.765043  2305 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.772253  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.773849  2304 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:56.735973  3173 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:56.722543  3029 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:56.797717  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.798624  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:56.808701  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:56.804032  1539 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.816685  1539 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:56.803722  3091 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:56.787583  1540 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:56.824709  1535 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.831734  1535 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:56.832293  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.832966  1537 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:56.832628  1535 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.833753  1535 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.840528  3132 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:56.841125  3132 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.843178  3132 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.811870  2834 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:58:56.804394  3173 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.851696  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.865165  1614 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:56.867393  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.868774  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:56.821859  3027 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:56.873448  1615 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:56.862422  1539 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.820127  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 174897us
I20260709 12:58:56.818334  3052 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:56.880259  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:56.863916  3108 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.524s	user 0.017s	sys 0.006s
I20260709 12:58:56.840548  2998 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.819319  3179 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.881886  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 129339us
I20260709 12:58:56.897994  3173 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.901007  1539 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.901300  3028 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.901628  2305 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:58:56.903172  3061 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.026s
I20260709 12:58:56.903445  3028 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.903595  3061 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:56.904120  2847 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:56.904737  1607 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:56.905462  2847 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:56.894116  1541 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:56.874267  2925 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:56.853709  3134 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.893436  3125 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.876688  3132 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.840119  2951 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.909147  3131 consensus_meta.cc:287] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.002s
I20260709 12:58:56.890816  3115 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:56.934861  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:56.913777  3179 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:56.913677  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.939980  2309 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:56.905748  3061 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:56.947436  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:56.998301  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 51669.2us
I20260709 12:58:56.935937  3132 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:56.998121  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.918072  1610 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:58:56.905887  3052 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:56.941256  3146 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.006s
I20260709 12:58:57.002909  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:57.039395  2307 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:57.007495  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.040659  1613 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.007786  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.009020  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.009661  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:57.009703  2994 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.001591  3055 consensus_queue.cc:1059] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.210s
W20260709 12:58:57.013959  3144 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.116s	user 0.008s	sys 0.005s
I20260709 12:58:57.014787  3074 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.018395  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:57.020917  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.073395  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.020792  3125 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.021112  2921 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.076274  1687 raft_consensus.cc:2410] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:58:57.022964  3202 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:58:57.023468  3212 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.023952  1608 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:57.043756  3146 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.081905  1613 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:57.082661  3146 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.075528  3078 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.083803  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:57.027691  3155 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.014s
I20260709 12:58:57.027812  1539 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
W20260709 12:58:57.027959  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 80643.9us
I20260709 12:58:57.028255  3054 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 12:58:57.028867  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:57.037254  3148 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.010s
I20260709 12:58:57.028120  3061 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:57.038056  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51066.9us
I20260709 12:58:57.087788  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.088357  3044 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.088853  3044 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:57.089018  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:57.089124  3132 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.089326  2925 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.089841  3109 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:57.090368  3109 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.091270  2925 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:57.091645  2925 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:57.092411  3212 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:57.092689  3214 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:57.092864  3212 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:57.093122  3214 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:57.093289  3212 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.093526  3214 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.041913  1535 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
W20260709 12:58:57.042063  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 136139us
I20260709 12:58:57.094559  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.945497  3115 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:56.940474  3131 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.096414  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:56.957795  3028 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:58:57.097513  3115 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.098208  1536 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:58:57.074365  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 53525.2us
I20260709 12:58:57.098816  3109 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.099614  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.101276  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.101640  2847 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.102696  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.104377  3027 consensus_queue.cc:1059] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.104925  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.105329  3006 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.106707  3215 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:57.107280  3029 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.107463  3144 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.109009  3144 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.110937  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:57.111433  1610 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:57.111721  2307 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:57.114012  2994 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.114794  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.116057  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.116669  1616 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:57.116955  1616 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:57.116883  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.117611  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.118057  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.072006  1532 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:57.078491  3168 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.119016  1609 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:57.081975  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.020087  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.120518  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.026351  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.120891  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.121143  1614 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
W20260709 12:58:57.121436  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 95172.8us
I20260709 12:58:57.077894  1534 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:57.122300  1614 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:57.111461  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.123427  1614 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:57.122308  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.124090  3055 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.124532  3055 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.124877  3055 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.125240  3068 raft_consensus.cc:2764] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:57.092451  3148 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.120543  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:57.102707  2847 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:57.127337  3148 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.097544  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.128002  1533 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:57.107316  3215 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:57.128451  1539 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:57.128821  3215 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.089162  1581 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.114909  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.040337  3091 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:57.118299  1615 raft_consensus.cc:2368] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:57.121579  1612 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:57.122097  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.117802  1616 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.136869  1607 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:58:57.136875  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47766.2us
I20260709 12:58:57.106779  3006 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:57.064901  1504 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.119966  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.132158  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.125171  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.115986  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:57.074301  1537 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.135568  1541 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:57.149747  2951 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.152796  1653 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:57.157107  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.158674  1616 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.155449  2921 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.130350  3052 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.170110  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.156138  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.172653  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.119976  3168 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.164422  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:57.165124  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.089761  3044 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.176296  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.177690  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.160741  2921 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.179633  1615 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.179965  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.182812  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.185673  1682 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:58:57.186134  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:57.183996  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 132035us
I20260709 12:58:57.188721  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.142489  3178 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.138836  3006 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:57.178785  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:57.191059  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:57.191375  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 66275.4us
I20260709 12:58:57.193594  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.189878  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.199831  1609 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:57.201104  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.202706  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.169324  2994 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.188458  3078 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.183120  2921 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.205837  1504 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.129503  2925 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.151619  3148 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:58:57.192397  3178 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.208350  1685 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:57.194715  2926 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.205224  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.215202  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.221211  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.222318  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.228914  3179 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.232311  3011 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:57.216774  3178 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.232914  3011 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:57.233470  2962 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:57.233951  3011 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.221802  3155 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:57.206166  3068 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.238128  1582 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.206646  3168 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:57.209867  3113 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.245182  1615 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:58:57.244009  1537 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:57.249294  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.213608  3078 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:57.253695  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.236490  3155 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:57.273628  1504 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.275503  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.277033  1504 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.278175   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:57.278647  3078 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.282909  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.283689  1686 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:58:57.284335  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.284495  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.285645  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.294534  1616 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:57.254776  3108 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.297761  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.299762  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.304412  3148 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.306871  1536 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:57.307435  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.285656  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.318848  1533 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.308152  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.309154  3061 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.285318  3022 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:57.303996  3179 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.259372  3028 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.296728  2994 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.322449  3165 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:57.323539  1539 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:57.323757  3165 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:57.324625  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:57.324744  3165 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.324625  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:57.321945  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 140337us
I20260709 12:58:57.274588  3155 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.331616  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.246523  3168 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.285817  3029 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.336830  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.317258  3108 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:57.322860  2994 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.346810  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.322710  3028 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.274415  2880 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:58:57.354557  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.360858  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.361697  1689 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.245393  3091 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.333937  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:57.364823  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.366096  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.366863  1616 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.367147  1535 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.268767  3006 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.391122  1685 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:57.393225  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.398851  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.354607  3108 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.392421  2307 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEARNER]: Advancing to term 3
I20260709 12:58:57.366492  3064 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:57.367147  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 123294us
I20260709 12:58:57.360559  2994 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.401973  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.366253  3028 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.410086  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.411091  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.412894  1582 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.410827  1538 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
W20260709 12:58:57.380731  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 194699us
I20260709 12:58:57.379583  1535 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:57.404246  3144 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.416859  1581 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.400295  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:57.424126  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 101654us
I20260709 12:58:57.422600  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:57.421377  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:57.426769  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.427738  3134 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:57.412051  3178 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.430274  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.430392  3178 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.431100  3134 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:57.431582  3134 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:57.425462  3078 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.434674  1689 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:58:57.435322  3134 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.443500  3006 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.436120  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:57.448196  1616 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:58:57.438067  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:57.433506  2998 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:58:57.439247  3228 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:57.449638  3146 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:57.449473  3228 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.450176  3146 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:57.451253  3146 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.452410  3228 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.415393  3052 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.415160  3027 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.462538  2998 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:57.462320  3078 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:57.462980  2998 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:57.463912  2998 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.464759  1535 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:57.465217  2998 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.464532  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:57.459915  3173 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:57.466908  3173 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:57.467761  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.467913  3173 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:57.469292  3173 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:57.470340  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:57.470217  3173 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.471463  3173 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.471580  1656 leader_election.cc:400] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:57.471966  1656 leader_election.cc:403] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:57.417872  3226 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:57.468526  3237 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:57.485692  2307 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:57.457701  3221 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.459231  3178 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.485062  3162 raft_consensus.cc:2764] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:57.491006  3134 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.491606  3134 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:57.425791  3144 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.476778  3226 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:57.482817  3228 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.491544  3162 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:58:57.492993  3227 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:58:57.473827  3052 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.482676  3235 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:57.492182  3146 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.489923  3221 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:57.533861  3224 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:58:57.497644  3168 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.495615  3212 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.572172  3212 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.524109  3226 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:57.522979  3055 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.587105  1533 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
W20260709 12:58:57.588733  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 117314us
I20260709 12:58:57.567489  3221 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.590989  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.580935  2302 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.595438  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.492930  3134 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:57.604388  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.607450  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.612378  1681 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:57.597491  3235 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.614318  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.599781  3223 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.583949  2921 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:57.618192  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.615916  3237 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:57.627413  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.628660  3144 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.631724  2921 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.632339  2994 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.633436  1686 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:57.603801  3215 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:57.644436  3127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.016s
I20260709 12:58:57.654635  1537 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:57.658587  1688 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:57.643800  3237 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:58:57.656571  3127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.009s	sys 0.016s
I20260709 12:58:57.645563  3022 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:58:57.622323  3223 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:57.682194  3131 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.682758  3064 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:57.683301  3064 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:57.683584  3219 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.591s	user 0.006s	sys 0.000s
W20260709 12:58:57.685411  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64538.7us
I20260709 12:58:57.694947  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:58:57.696571  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.700997  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 226790us
W20260709 12:58:57.696873  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 75450us
I20260709 12:58:57.701308  2834 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:57.685657  3162 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:58:57.704773  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:57.707042  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 981) took 1826 ms (client timeout 1582 ms). Trace:
W20260709 12:58:57.713585  1687 rpcz_store.cc:269] 0709 12:58:55.874073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.878551 (+  4478us) service_pool.cc:224] Handling call
0709 12:58:57.700064 (+1821513us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400392e54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:57.700259 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731193600}
W20260709 12:58:57.715728  3236 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:58:57.716208  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.710729  3179 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:57.716967  1687 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:57.717173  3179 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.717821  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.720686  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.703738  3052 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.725961  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.726377  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.726526  1536 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.734109  1536 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:58:57.735741  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:57.737375  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:57.738601  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.748261  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.742631  3028 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.743417  1615 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:57.749480  1610 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:57.743626  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.746443  3064 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:57.748775  3210 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.724s	user 0.006s	sys 0.001s
I20260709 12:58:57.754354  3052 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:57.754489  3214 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.003s
I20260709 12:58:57.755357  3214 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.755923  3237 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.756855  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:57.758188  3214 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.758853  3214 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:57.759341  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.759729  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:57.703088  2994 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.775997  1540 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:58:57.780084  3214 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:58:57.780388  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.781216  1608 raft_consensus.cc:2368] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:57.735275  3240 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:57.784922  2276 leader_election.cc:400] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:57.785255  1681 raft_consensus.cc:2410] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:57.785267  2276 leader_election.cc:403] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:57.769965  2301 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:57.789036  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.789637  1541 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:57.784116  2921 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.791280  3221 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.791915  3215 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.759281  3055 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.709194  3091 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:58:57.792500  1687 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:57.789736  1533 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:57.863903  3223 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.869344  3221 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.783587  3240 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:57.794911  1689 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:57.802831  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.807344  2925 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.810804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:57.811311  3022 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.821089  3064 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.824651  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:58:57.883767  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 81054.3us
I20260709 12:58:57.829560  3044 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:58:57.831522  3206 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.887s	user 0.000s	sys 0.003s
W20260709 12:58:57.841246  3222 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.477s	user 0.005s	sys 0.000s
I20260709 12:58:57.842587  3028 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.846805  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:57.895545  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.848380  1504 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:58:57.898025  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 49742.9us
I20260709 12:58:57.899729  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:57.900612  1533 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:57.902204  3165 raft_consensus.cc:2764] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:57.904544  1609 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:57.904609  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:57.906296  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:58:57.854161  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 50118.9us
I20260709 12:58:57.781229  3214 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.825734  1615 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:57.884760  1613 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:58:57.908205  3255 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:58:57.766970  3248 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.140s
I20260709 12:58:57.867980  2921 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:57.877105  3240 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:57.877079  3125 raft_consensus.cc:3055] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:57.795734  3108 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.897114  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:57.922256  1608 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:58:57.850605  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.910660  2276 leader_election.cc:400] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:57.886881  3221 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.920465  1690 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:57.922989  2276 leader_election.cc:403] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:57.888046  3260 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:57.937122  1613 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:57.938966  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:57.930604  3242 consensus_queue.cc:1059] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:58:57.909998  3215 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:58:57.918740  2302 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:57.889786  3044 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.943856  3239 consensus_queue.cc:1059] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:58:57.944208  3242 raft_consensus.cc:3055] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:57.945053  2921 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.889086  3022 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:57.959357  3108 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.938288  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1094) took 1487 ms. Trace:
I20260709 12:58:57.927924  3078 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:57.969602  3078 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:57.969871  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:57.946166  3233 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.960410  3022 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.973737  3044 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:57.954702  3155 consensus_meta.cc:287] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 12:58:57.919551  3125 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:57.948634  3249 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:57.938361  3260 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.944638  1534 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:57.946969  3246 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:58:57.955566  3242 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:58.127338  3242 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.128666  3242 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.972584  3078 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:57.943814  3221 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:57.960803  2847 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:57.985589  3125 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.130697  3078 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:58.130942  2847 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.131495  3125 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:58.133363  2847 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:57.955189  3237 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:58:57.999392  3260 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:57.981501  3155 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.138191  3155 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:57.967190  1684 rpcz_store.cc:276] 0709 12:58:56.449109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.452377 (+  3268us) service_pool.cc:224] Handling call
0709 12:58:56.452782 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.458182 (+  5400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.458215 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.458756 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:58:56.628392 (+169636us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:56.628434 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.628506 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.830855 (+1202349us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:58:57.910713 (+ 79858us) raft_consensus.cc:1685] finished
0709 12:58:57.916269 (+  5556us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.936596 (+ 20327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4926,"raft.queue_time_us":5177,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":320408832,"thread_start_us":152961,"threads_started":1,"wal-append.queue_time_us":419071}
I20260709 12:58:57.987332  1681 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:58:58.140354  1534 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:58:58.493719  1681 pending_rounds.cc:85] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:58:58.494055  1681 pending_rounds.cc:107] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:58:58.494307  1681 raft_consensus.cc:2889] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:58.221578  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.502149  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 106) took 1161 ms. Trace:
I20260709 12:58:58.502597  1534 rpcz_store.cc:276] 0709 12:58:57.340925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.342273 (+  1348us) service_pool.cc:224] Handling call
0709 12:58:58.501945 (+1159672us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54004358d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:58.502061 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178706816}
I20260709 12:58:58.266419  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:58.506448  3052 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.506963  3052 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.507865  2275 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:58.508392  3267 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.508859  3267 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.509203  3214 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.510959  3267 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.267269  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:58.276081  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:58.282084  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 371833us
I20260709 12:58:58.513339  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.514565  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.515772  3283 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.292667  1688 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:58.516503  3283 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.209224  3179 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.276703  3022 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:58.302047  1536 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:58.525067  2305 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.274489  3155 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.529366  3155 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.531409  3155 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.271433  3165 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.532581  3165 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.534677  3165 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:58.011934  3226 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:58.538260  3226 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.013885  3233 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:58:58.305425  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:58:58.273615  3044 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.540524  3044 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.542604  3044 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.019404  3240 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.543469  3022 raft_consensus.cc:1064] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
W20260709 12:58:58.543926  3022 raft_consensus.cc:1068] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Unable to promote non-voter c445b7b7d94f48f99a3599ddfc92f462: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:58.167217  3125 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.545114  3240 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.309047  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:58:58.230348  3251 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
I20260709 12:58:58.547356  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:58:58.198774  3253 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.401s	user 0.000s	sys 0.004s
I20260709 12:58:58.312062  1614 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.549892  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:58.551121  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.551143  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:58.312599  1609 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.313908  1611 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:58.094923  3265 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.246s	user 0.004s	sys 0.000s
I20260709 12:58:58.250948  3027 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:58.568619  3027 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:58.222127  3144 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.570112  3144 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.267338  3134 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:58.575758  3162 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:58.575387  3134 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.577690  3134 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.174013  2925 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.290961  3248 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.326169  1533 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:58.338864  3239 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:58.579636  3248 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.580137  3239 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:58.581063  3239 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.581653  3248 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.340651  1610 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:58.582243  3239 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:58.583164  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 132) took 4643 ms. Trace:
I20260709 12:58:58.583303  2301 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:58:58.350517  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:58:58.584074  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 233630us
I20260709 12:58:58.585008  1609 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:58.572185  3144 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:58.354177  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:58.587663  1687 raft_consensus.cc:2410] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:58.361393  1616 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:58.365140  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.588470  3028 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.366029  2921 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.589602  2921 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.590680  2304 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:58:58.370085  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 953385us
I20260709 12:58:58.372906  1607 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:58.592706   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:58.385509  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:58:58.391543  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.619321  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.619663  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:58.620612  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.393457  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:58.395859  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 234) took 1285 ms. Trace:
I20260709 12:58:58.631310  3214 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:58.631534  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.583544  1437 rpcz_store.cc:276] 0709 12:58:53.940006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.962807 (+ 22801us) service_pool.cc:224] Handling call
0709 12:58:58.583089 (+4620282us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:57.267628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:57.304795 (+ 37167us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:57.304824 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:58:57.304844 (+    20us) tablet.cc:662] Decoding operations
0709 12:58:57.305482 (+   638us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:57.305527 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:57.305552 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:58:57.306064 (+   512us) tablet.cc:701] Row locks acquired
0709 12:58:57.306082 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:58:57.306206 (+   124us) write_op.cc:270] Start()
0709 12:58:57.309811 (+  3605us) write_op.cc:276] Timestamp: P: 1783601937306166 usec, L: 0
0709 12:58:57.309840 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:58:57.310463 (+   623us) log.cc:844] Serialized 2069 byte log entry
0709 12:58:58.038921 (+728458us) op_driver.cc:464] REPLICATION: finished
0709 12:58:58.047100 (+  8179us) write_op.cc:301] APPLY: starting
0709 12:58:58.047152 (+    52us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:58.047269 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:58.047329 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:58.047923 (+   594us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:58.048086 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:58:58.048121 (+    35us) write_op.cc:312] APPLY: finished
0709 12:58:58.048358 (+   237us) log.cc:844] Serialized 47 byte log entry
0709 12:58:58.048492 (+   134us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:58.048556 (+    64us) write_op.cc:454] Released schema lock
0709 12:58:58.048583 (+    27us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":116048,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":7983,"apply.run_cpu_time_us":1658,"apply.run_wall_time_us":1657,"num_ops":5,"prepare.queue_time_us":552479,"prepare.run_cpu_time_us":3176,"prepare.run_wall_time_us":49821,"replication_time_us":728954,"thread_start_us":12032,"threads_started":1}]]}
I20260709 12:58:58.631474  2302 rpcz_store.cc:276] 0709 12:58:57.110186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.120323 (+ 10137us) service_pool.cc:224] Handling call
0709 12:58:58.395655 (+1275332us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54005fffd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:58.395773 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029820672}
I20260709 12:58:58.419492  2847 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.637398  1610 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:58.637553  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:58.638497  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.422780  1608 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:58.642531  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.432602  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1810) took 1039 ms. Trace:
I20260709 12:58:58.645020  1540 rpcz_store.cc:276] 0709 12:58:57.393079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.399757 (+  6678us) service_pool.cc:224] Handling call
0709 12:58:57.484327 (+ 84570us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:57.575768 (+ 91441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.581886 (+  6118us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:57.711782 (+129896us) log.cc:844] Serialized 532 byte log entry
0709 12:58:57.775822 (+ 64040us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:57.914652 (+138830us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.432316 (+517664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.432390 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.432423 (+    33us) raft_consensus.cc:1685] finished
0709 12:58:58.432432 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.432549 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":518015,"raft.queue_time_us":530481,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":9858,"thread_start_us":24577,"threads_started":1,"wal-append.queue_time_us":24941}
I20260709 12:58:58.436291  3168 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.451419  3282 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.458184  3127 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.461824  3006 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:58:58.458540  3284 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.467761  2880 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.472295  3108 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:58.657893  2880 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.473184  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.482314  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:58:58.659348  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 186255us
I20260709 12:58:58.659740  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:58.661180  3285 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:58.482210  3078 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:58.662046  3285 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.662429  3078 consensus_queue.cc:1243] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:58.663028  3165 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.663220  3249 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:58.663399  3285 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.167642  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.515836  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.669648  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:58.669750  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 153983us
I20260709 12:58:58.670342  1611 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:58.671320  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.671536  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.517654  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:58.528479  3237 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:58:58.538014  3260 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:58.545017  3125 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.273039  3109 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:58.713047  2921 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.748216  3109 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:58.546044  1534 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:58.546453  1612 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:58.752307  2921 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.753243  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1821) took 1027 ms. Trace:
I20260709 12:58:58.553857  1536 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.551678  1614 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:58.753786  1612 rpcz_store.cc:276] 0709 12:58:57.725546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.725681 (+   135us) service_pool.cc:224] Handling call
0709 12:58:57.725974 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:58.752271 (+1026297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.752952 (+   681us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540009bad4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:58.753169 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886712192}
I20260709 12:58:58.564553  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:58.755295  2307 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:58:58.547914  1539 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:58.560034  3286 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:58:58.577970  3162 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.759351  1684 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:58.559468  3233 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:58:58.761139  3249 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:58.761540  3233 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:58.586607  3052 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.586796  3146 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:58.588025  3179 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.616873  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:58:58.622303  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:58:58.624147  1615 raft_consensus.cc:2368] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:58:58.625996  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:58.772421  1535 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:58.627322  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:58.631021  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:58.633894  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:58.773651  1537 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:58:58.773975  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 140165us
I20260709 12:58:58.628938  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:58.632371  3239 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.637118  2847 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.421125  3221 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.635800  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:58:58.429749  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1013) took 1109 ms. Trace:
I20260709 12:58:58.649758  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:58.652623  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65830.6us
I20260709 12:58:58.781512  1616 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:58.653405  3282 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.649341  3127 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.654963  3168 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.649607  3240 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:58.656785  3284 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.800717  3168 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.801993  3284 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.658577  3044 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:58.784899  3248 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:58:58.803736  3282 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.804442  3242 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:58.804952  3242 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.805608  3109 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:58.806842  3242 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.780103  3022 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:58.808516  1533 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:58.808635  3022 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:58.673902  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.690688  1507 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:58.698261  1538 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.699090  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:58.889365  1540 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
I20260709 12:58:58.695844  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 207) took 5162 ms. Trace:
W20260709 12:58:58.889851  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 209262us
I20260709 12:58:58.706420  1682 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:58:58.674490  2880 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:58.692443  3108 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.655879  3006 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.679713  1532 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:58.691777  3078 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:58.705346  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.690557  3235 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:58.731729  3125 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:58.733196  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:58.886821  3109 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.737761  3027 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.752969  2921 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.578810  2925 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:58.353034  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:58.762864  3144 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:58.764699  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:58.768277  1539 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:58:58.777565  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:58.931183  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 153729us
W20260709 12:58:58.897948  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 269121us
I20260709 12:58:58.779397  1613 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:58:58.783630  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 147929us
I20260709 12:58:58.933514  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.780443  1686 rpcz_store.cc:276] 0709 12:58:57.319992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.320205 (+   213us) service_pool.cc:224] Handling call
0709 12:58:58.429549 (+1109344us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540035be54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:58:58.429689 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689672448}
I20260709 12:58:58.785965  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.937140  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:58.937809  1608 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
W20260709 12:58:58.938436  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 173864us
I20260709 12:58:58.789137  3267 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:58.802740  3044 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:58:58.677977  3283 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.809880  3022 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.780310  3179 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.771819  3291 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.792779  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:58.880635  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 206846us
I20260709 12:58:58.893404  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:58.959854  1607 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:58:58.960538  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:58.961833  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 68493.6us
I20260709 12:58:58.962131  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:58.918237  1611 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:58.896807  3214 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.791157  3221 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.890261  1439 rpcz_store.cc:276] 0709 12:58:53.533821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.544664 (+ 10843us) service_pool.cc:224] Handling call
0709 12:58:58.695785 (+5151121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:57.028786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:57.034264 (+  5478us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:57.034308 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:58:57.034320 (+    12us) tablet.cc:662] Decoding operations
0709 12:58:57.034853 (+   533us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:57.034947 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:57.034973 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:57.035336 (+   363us) tablet.cc:701] Row locks acquired
0709 12:58:57.035383 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:58:57.035529 (+   146us) write_op.cc:270] Start()
0709 12:58:57.035669 (+   140us) write_op.cc:276] Timestamp: P: 1783601937035471 usec, L: 0
0709 12:58:57.035707 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:58:57.112634 (+ 76927us) log.cc:844] Serialized 987 byte log entry
0709 12:58:57.685328 (+572694us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:58:57.841094 (+155766us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b20000b1d78. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d587f9b91 00007f8d5881ba19 00007f8d587e68c3 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169 00007f8d587ef131 00007f8d587ee42d 000000000038f354
0709 12:58:57.998596 (+157502us) op_driver.cc:464] REPLICATION: finished
0709 12:58:58.040642 (+ 42046us) write_op.cc:301] APPLY: starting
0709 12:58:58.040787 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:58.040917 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:58.040950 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:58.045951 (+  5001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:58.046119 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:58.046160 (+    41us) write_op.cc:312] APPLY: finished
0709 12:58:58.046320 (+   160us) log.cc:844] Serialized 29 byte log entry
0709 12:58:58.046469 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:58.046527 (+    58us) write_op.cc:454] Released schema lock
0709 12:58:58.046566 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:58.046825 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:58.046844 (+    19us) write_op.cc:454] Released schema lock
0709 12:58:58.051253 (+  4409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:58.051274 (+    21us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160080,"reported_tablets":6,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":39299,"apply.run_cpu_time_us":1898,"apply.run_wall_time_us":8302,"num_ops":2,"prepare.queue_time_us":573396,"prepare.run_cpu_time_us":23811,"prepare.run_wall_time_us":223338,"raft.queue_time_us":131903,"raft.run_cpu_time_us":7523,"raft.run_wall_time_us":59219,"replication_time_us":962687,"spinlock_wait_cycles":13188992,"thread_start_us":589522,"threads_started":4,"wal-append.queue_time_us":214599}]]}
I20260709 12:58:58.905038  1541 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:58.664054  3285 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:58:58.892573  3253 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:58:58.992758  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.912019  1609 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:58:58.897241  3282 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:58.939301  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:58:58.898738  3292 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:58.941309  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:58.932114  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:58.943405  1613 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.945047  3027 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:58.945366  2847 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:58.918635  3078 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:58:58.945904  2921 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:58.946324  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.948680  3242 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:58.949954  2307 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:58.895955  3299 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:58.937922  3052 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.953572  3284 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:59.055672  3284 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:59.056259  3284 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:58.955293  3144 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:59.058391  3144 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.060578  3144 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.016381  3282 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:59.061292  3282 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:58.995553  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:59.019763  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 87716.7us
I20260709 12:58:59.066071  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:58.996045  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:59.022274  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81043.1us
I20260709 12:58:59.023064  1688 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.984087  3108 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:59.032342  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:58:58.996721  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 57505.7us
I20260709 12:58:58.979555  3109 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.044306  3299 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.021581  3226 raft_consensus.cc:2764] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:58:59.050333  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 159804us
I20260709 12:58:58.985512  3267 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:58:59.081202  3267 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:58.992368  3179 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:59.067502  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 72055.5us
I20260709 12:58:59.085104  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:59.016207  3165 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.042783  3221 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:59.024621  3233 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:58:59.048789  3293 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:58:59.026261  3091 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:59.089352  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 121990us
I20260709 12:58:58.984760  3214 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:59.094739  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 131801us
I20260709 12:58:58.980458  3291 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.067849  3127 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.066974  3155 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.112352  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46362.7us
I20260709 12:58:59.088145  2302 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:59.065446  3297 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:59.078210  3131 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.116590  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:59.072924  3302 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.092886  3285 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.094122  3165 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.025074  3292 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.099155  3233 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:59.143743  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:59.089324  3240 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:58:59.109735  3283 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.149053  1689 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:58:59.139078  3248 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.064558  3044 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:59.166802  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81794.8us
I20260709 12:58:59.138881  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:59.144488  3302 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.168393  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88629us
I20260709 12:58:59.113297  3296 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:58:59.172886  1507 leader_election.cc:400] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:58:59.144008  3155 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:59.149638  3006 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:59.179291  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.180079  1537 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:59.181185  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:59.183032  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.183760  1536 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:59.152014  3233 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.172847  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:59.176826  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:59.157394  3091 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.157598  3248 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.174683  1507 leader_election.cc:403] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:59.190423  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.197547  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:59.191567  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:59.198101  1536 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:59.198434  1537 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.171468  2925 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.199043  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:59.199574  1536 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.151495  3165 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.170714  3302 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.168483  3027 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:59.193614  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:59.196718  1540 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:59.205991  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.208194  1613 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:59.202031  3308 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:59.209045  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.206666  3027 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.209931  3027 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.204758  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.184329  3146 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:58:59.151834  3306 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:58:59.193873  3044 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.221549  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:58:59.222255  1540 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:58:59.223743  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.223956  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:59.200722  3248 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.204746  1538 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:59.219161  1616 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:59.219786  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.172257  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:59.228282  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.223117  3125 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:59.229800  3301 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.230021  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.230347  3299 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.242534  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:58:59.242816  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 88743.5us
I20260709 12:58:59.243608  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.244143  1540 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:58:59.244932  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.245760  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:59.206075  3006 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:59.234840  1541 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:59.192408  3318 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:59.218470  3221 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.233317  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44485.8us
I20260709 12:58:59.218524  3144 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.216923  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.250555  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:59.251953  1536 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:58:59.205607  3314 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
W20260709 12:58:59.251353  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 58003.6us
I20260709 12:58:59.291492  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:59.292145  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.234571  3301 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.227229  3308 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:58:59.288658  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 116521us
I20260709 12:58:59.290164  1537 raft_consensus.cc:2410] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:59.290931  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.293196  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:59.285125  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.232257  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:59.201313  3091 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:59.399016  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 105893us
I20260709 12:58:59.400202  1541 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:58:59.400695  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:58:59.402555  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 120323us
I20260709 12:58:59.246819  3078 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.405876  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:58:59.408622  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:59.246732  3125 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:59.286752  3144 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.333138  2847 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:59.289997  3109 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:59.337210  3260 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.415827  3162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.006s	sys 0.061s
I20260709 12:58:59.352614  3006 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:58:59.314759  2331 debug-util.cc:398] Leaking SignalData structure 0x7b08002e54c0 after lost signal to thread 434
I20260709 12:58:59.447458  3214 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.451031  3319 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.460580  3319 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:59.460958  3319 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:59.461918  3294 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.442s	user 0.003s	sys 0.000s
I20260709 12:58:59.423976  3312 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:58:59.337915  3301 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.337330  3242 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:59.415179  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:59.420102  3314 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:59.292650  3221 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.338490  3291 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.457835  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.426983  3144 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:59.446305  3304 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:58:59.463587  3284 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:58:59.450363  3162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.061s
W20260709 12:58:59.460952  2331 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5ba0 after lost signal to thread 1473
I20260709 12:58:59.473287  2847 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:59.460952  3006 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.491187  1612 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:58:59.507481  1682 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:58:59.485633  3305 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:58:59.507617  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 99036.1us
I20260709 12:58:59.516640  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:58:59.458398  3285 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:58:59.476326  3325 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:59.509367  3307 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 12:58:59.619603  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 105493us
I20260709 12:58:59.450743  3260 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.444204  3146 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.498714  1684 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:58:59.623836  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:59.634327  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.622928  3240 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.635303  3240 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.635474  3309 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.636183  3309 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.506228  3155 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:58:59.631182  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.627213  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:58:59.512480  3305 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:58:59.635684  3240 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.645345  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:59.646732  2276 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:58:59.519552  3078 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:58:59.618772  3125 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:59.641397  3311 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.518920  2847 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.638278  3165 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:58:59.672399  2331 debug-util.cc:398] Leaking SignalData structure 0x7b080035c9a0 after lost signal to thread 1565
I20260709 12:58:59.657856  3305 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.673621  3214 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:59.741832  2331 debug-util.cc:398] Leaking SignalData structure 0x7b0800286ca0 after lost signal to thread 1640
I20260709 12:58:59.742595  2847 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.743064  3284 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:58:59.697798  3078 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.746405  3091 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.748885  3221 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.748974  2304 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:59.751147  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:58:59.751631  3027 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.003s
I20260709 12:58:59.752061  3027 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.695247  3320 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:59.753131  3282 consensus_meta.cc:287] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 12:58:59.719084  3311 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.753696  3311 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.755091  3214 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:59.755532  3214 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.561220  3308 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:59.751138  3310 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.498s	user 0.000s	sys 0.001s
W20260709 12:58:59.764036  1653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.009s	sys 0.002s
W20260709 12:58:59.764987  1653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.009s	sys 0.002s
I20260709 12:58:59.659435  3022 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:58:59.781167  1688 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:59.785754  3044 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.559s	user 0.003s	sys 0.005s
I20260709 12:58:59.763128  3282 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.787158  3260 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.788018  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:59.788200  1535 raft_consensus.cc:2410] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:59.788489  3282 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.795344  3319 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.797710  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:59.798417  1534 raft_consensus.cc:606] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:58:59.798859  1534 raft_consensus.cc:614] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:59.800590  3319 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.802119  2304 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:59.805549  3027 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:58:59.810159  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.001s	sys 0.006s
W20260709 12:58:59.810524  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.001s	sys 0.006s
I20260709 12:58:59.763885  3320 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:58:59.815217  3282 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:58:59.869483  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:59.869701  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:58:59.815405  3027 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.869735  1653 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:58:59.885056  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89771.5us
I20260709 12:58:59.841768  3006 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.873447  3328 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:58:59.839736  3286 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:58:59.841444  3282 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:58:59.914670  3327 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:58:59.915035  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:58:59.915684  1534 raft_consensus.cc:606] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:58:59.916112  3318 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.916692  3318 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:59.918879  3318 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.884022  3027 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.937331  3337 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:59.938828  3339 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:58:59.940361  3333 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:58:59.885598  3301 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.944536  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:58:59.909889  3221 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:58:59.949231  3027 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.907639  3006 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.932811  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:58:59.955578  3301 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.955760  3282 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.963303  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 137) took 1185 ms. Trace:
I20260709 12:58:59.920179  3240 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:58:59.963796  1614 rpcz_store.cc:276] 0709 12:58:58.777998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.778162 (+   164us) service_pool.cc:224] Handling call
0709 12:58:58.778554 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:58.973396 (+194842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.973428 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.994332 (+ 20904us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.402241 (+407909us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:59.402278 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.402341 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:59.963042 (+560701us) raft_consensus.cc:1685] finished
0709 12:58:59.963066 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.963231 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7008,"raft.queue_time_us":26686,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":464417,"threads_started":2,"wal-append.queue_time_us":620642}
W20260709 12:58:59.970293  3233 consensus_meta.cc:287] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.003s
I20260709 12:58:59.944494  3311 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:58:59.992412  1616 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:58:59.986145  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 126) took 1046 ms. Trace:
I20260709 12:58:59.985682  3006 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.991031  3233 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:59.988679  3144 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.000357  3078 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:58:59.996574  3127 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:00.001742  3237 raft_consensus.cc:1068] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Unable to promote non-voter c445b7b7d94f48f99a3599ddfc92f462: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.002159  3144 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:00.002907  1685 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:00.001739  3127 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.006606  3127 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:00.006965  3292 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:58:59.992532  3221 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.018798  2306 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:00.038023  3144 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.049536  3240 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.042526  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:00.043218  3311 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.045117  3330 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:00.055068  2301 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.055514  3330 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.056569  3330 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.057823  3330 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.056569  3233 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.039330  3214 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:58:59.994462  1532 rpcz_store.cc:276] 0709 12:58:58.940075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.950122 (+ 10047us) service_pool.cc:224] Handling call
0709 12:58:59.020193 (+ 70071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:59.116684 (+ 96491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.118866 (+  2182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:59.140172 (+ 21306us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:59.141918 (+  1746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.985884 (+843966us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b5400073854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:58:59.985942 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.986083 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186429824}
I20260709 12:59:00.061980  3305 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.063002  1612 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
W20260709 12:59:00.064850  3302 consensus_meta.cc:287] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.001s
I20260709 12:59:00.065237  3302 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.067202  3302 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.067821  2302 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:00.040135  3248 consensus_meta.cc:287] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.000s
I20260709 12:59:00.050405  3144 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.064013  3305 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.080101  3237 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.015712  3221 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.081562  3311 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:59:00.081378  3248 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.104875  1688 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:00.107301  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.108304  1685 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:00.109930  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.112718  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.113413  1609 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:00.114504  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:00.114811  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:00.115523  2307 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 2: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:00.115572  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:00.117991  1507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 1.648s (SENT) [suppressed 3 similar messages]
I20260709 12:59:00.117462  2301 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.120301  3108 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:00.120826  3108 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.095135  3237 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.125188  3297 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:00.125555  3297 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.126538  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:00.127631  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.127817  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.127941  3237 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.128400  1532 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:00.128626  1582 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:00.129113  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.129218  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.129830  1533 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:59:00.130012  1532 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:00.130764  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.133052  3144 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.133563  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.133013  1532 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:00.134115  3226 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:00.135673  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.135949  3028 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:00.136425  1536 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:00.136552  3028 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.137094  3028 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:00.137598  3353 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:00.138159  3298 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:00.138706  3298 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.143836  1536 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:00.133167  3292 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.145761  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.151081  1536 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.152684  3214 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.146588  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.155567  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.124099  3108 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:00.146800  3221 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.160887  1609 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:00.157855  3248 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.159667  1582 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:00.166692  1540 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:00.167273  1536 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:00.169685  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.172247  1685 raft_consensus.cc:2368] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
I20260709 12:59:00.177501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:00.179797  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61846.8us
I20260709 12:59:00.150583  1533 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:00.139621  3298 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:00.176236  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.186681  1684 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:00.165656  3292 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.188575  3292 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.178705  3297 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.189966  3297 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.190361  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.191015  1684 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:00.173471  3296 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.185796  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:00.176329  3330 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:00.185590  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:00.195559  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.197283  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.198261  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:00.203665  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.202081  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.192550  3296 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:00.183534  3325 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:00.209875  3325 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:00.210456  3249 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.200620  3292 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:00.193423  3146 consensus_queue.cc:1175] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:00.199373  3311 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:00.212865  3299 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:00.218910  2276 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:00.199080  3168 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.199034  3214 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:00.225687  2331 debug-util.cc:398] Leaking SignalData structure 0x7b0800327300 after lost signal to thread 1714
W20260709 12:59:00.229705  2331 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8300 after lost signal to thread 2334
W20260709 12:59:00.231711  3357 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:00.226117  3168 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.235615  3168 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.226794  3311 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.237262  3311 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.227419  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:00.196904  3343 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:00.241969  3343 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.242460  3343 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.219946  3292 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.247002  3292 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:00.249195  3296 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.253930  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:00.254316  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.255204  1685 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:00.210340  3325 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.257899  3028 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.262701  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:00.272068  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:00.259573  3134 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:00.256028  3317 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:00.282300  1581 leader_election.cc:400] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
I20260709 12:59:00.288734  3317 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:00.281819  3343 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.289135  2921 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.317770  3313 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:00.273674  3146 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:00.279994  3168 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:00.280956  3298 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:00.327046  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 125064us
I20260709 12:59:00.325939  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:00.332525  3321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.009s
I20260709 12:59:00.338208  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.338291  3168 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:00.339847  3300 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.618s	user 0.003s	sys 0.000s
I20260709 12:59:00.340332  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.381574  1538 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.340595  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.335304  3305 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:00.311060  3325 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.334782  2921 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:00.384934  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.385288  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 135) took 1607 ms. Trace:
I20260709 12:59:00.334590  3146 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:00.357723  3367 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.386067  2921 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:00.386201  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1126) took 2042 ms (client timeout 2164 ms). Trace:
I20260709 12:59:00.386440  3367 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:00.386622  1689 rpcz_store.cc:269] 0709 12:58:58.352631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.352753 (+   122us) service_pool.cc:224] Handling call
0709 12:59:00.386003 (+2033250us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54004402d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:00.386145 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502938368}
I20260709 12:59:00.387665  3131 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.388126  3131 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.388468  3367 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.390050  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:00.390635  3131 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.390981  3146 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.366246  3168 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:00.371331  3303 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 1.250s	user 0.014s	sys 0.010s
I20260709 12:59:00.337153  3313 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.393409  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 125) took 1453 ms. Trace:
I20260709 12:59:00.393734  1539 rpcz_store.cc:276] 0709 12:58:58.939785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.940336 (+   551us) service_pool.cc:224] Handling call
0709 12:58:58.940642 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:58.948661 (+  8019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.948690 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.949147 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.098830 (+149683us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:59.098887 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.098983 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.370958 (+1271975us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b240011ebc8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d559e49c4 00007f8d559e2acb 00007f8d55b9ddc9 00007f8d55b9da55 00007f8d55b9d09d 00007f8d587cf10e 00007f8d587e688c 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221
0709 12:59:00.393149 (+ 22191us) raft_consensus.cc:1685] finished
0709 12:59:00.393170 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.393354 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7661,"raft.queue_time_us":8648,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":4646,"spinlock_wait_cycles":40543616,"thread_start_us":149338,"threads_started":1,"wal-append.queue_time_us":171875}
I20260709 12:59:00.349368  3343 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.395494  3343 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.396296  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.397433  3343 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.396359  2303 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:00.376454  3317 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.394731  3313 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.335333  3298 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:00.373358  3028 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.398953  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.385674  1615 rpcz_store.cc:276] 0709 12:58:58.777461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.778352 (+   891us) service_pool.cc:224] Handling call
0709 12:58:58.778635 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.241628 (+1462993us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b180041bc00. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c43bfb 00007f8d58c4e64b
0709 12:59:00.241746 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:00.241770 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:00.242200 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:59:00.314651 (+ 72451us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:00.324346 (+  9695us) log.cc:844] Serialized 14 byte log entry
0709 12:59:00.334223 (+  9877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.385006 (+ 50783us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001b6054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:00.385055 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.385096 (+    41us) raft_consensus.cc:1685] finished
0709 12:59:00.385109 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.385235 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49112,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":104604,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":9470,"spinlock_wait_cycles":491818112,"thread_start_us":134760,"threads_started":2,"wal-append.queue_time_us":90659}
I20260709 12:59:00.409336  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.410054  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:00.398973  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73111.5us
I20260709 12:59:00.418231  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.407047  3308 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:00.434310  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.434938  1688 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:59:00.435791  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.433624  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.437402  1689 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:00.408869  3298 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:00.436403  1685 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:59:00.441093  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.450904  1540 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:00.452090  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.453398  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.454010  1609 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.458865  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.459591  1540 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:00.458845  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.460788  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.434262  3308 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.464037  1536 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.442963  2925 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:00.465651  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.466846  1612 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:00.466780  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:00.467592  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.468164  1615 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:00.471095  1540 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:00.471910  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.472262  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.472555  1540 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:00.472837  1536 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:00.473539  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.474082  1540 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.475198  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.464962  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.479333  3330 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:00.479681  3052 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:00.482147  3358 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 12:59:00.483506  1538 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:00.484754  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.485445  1532 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.486431  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.488427  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.489111  1534 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:00.490613  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.491238  1684 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.479750  3330 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.500325  3330 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.498503  3309 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.464187  3323 raft_consensus.cc:1064] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:59:00.454890  3296 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.508734  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:00.506958  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 43512.8us
I20260709 12:59:00.509451  1688 raft_consensus.cc:2368] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:00.509754  1689 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:00.510178  1689 pending_rounds.cc:85] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:59:00.510492  1689 pending_rounds.cc:107] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:00.510591  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.510931  1689 raft_consensus.cc:2889] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:00.511298  1688 raft_consensus.cc:2368] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:00.511839  1540 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.512814  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.513602  1689 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:00.513859  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.512925  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.515934  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.516597  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.466790  3308 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.517271  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.521359  1538 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:00.464433  3325 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:00.473930  3267 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.518111  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.519446  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.523353  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.519920  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.524022  1536 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.465736  3343 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:00.520661  1682 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:00.522037  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.525543  1615 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.466835  2925 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.527729  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.528393  1616 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.526862  2925 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.539234  3306 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:00.539644  3306 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.540422  3306 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.541715  3306 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.522368  3325 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.546119  3325 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:00.546150  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 206219us
I20260709 12:59:00.508366  3052 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:00.552680  3052 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.554684  3052 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.556342  3267 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.558667  3267 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:00.565229  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.572968  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.574090  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.576013  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.574687  1540 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.582104  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.582810  1686 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:00.583438  1536 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.584427  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.585896  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.586876  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.588865  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.589622  1538 raft_consensus.cc:2410] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:00.591240  1685 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:00.526721  3343 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.593376  1540 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.551528  3323 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.581060  3311 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.596359  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.518101  3296 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.600469  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.601692  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.603313  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.614787  1614 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.604710  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.605373  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.615998  1608 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:00.607689  3340 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.803s	user 0.003s	sys 0.000s
I20260709 12:59:00.576402  3131 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.523097  3146 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.604043  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.588717  3367 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:00.620877  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.596845  3343 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:00.583391  3052 consensus_queue.cc:1059] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:59:00.638085  1609 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:00.639950  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.597098  3292 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:59:00.643409  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.645577  1538 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.643488  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.625846  3131 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.617328  3127 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:00.661867  1608 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.646697  1615 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.656522  3237 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:00.672866  3237 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:00.672662  3127 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.673734  3237 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.675206  3237 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:00.675259  3127 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:00.650202  3131 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.681723  3297 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:00.686259  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.690377  1686 raft_consensus.cc:2368] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:00.692739  1688 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:00.616528  3311 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.701946  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.707926  1538 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:00.702558  1686 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:00.737011  1616 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.741221  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.744944  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.745664  1688 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:00.747222  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:00.750590  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 136100us
I20260709 12:59:00.747962  1686 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:00.757431  1686 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:00.757761  1686 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:00.777336  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.781368  3179 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.782024  2925 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:00.782127  3179 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:00.784526  3362 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.636s	user 0.005s	sys 0.000s
I20260709 12:59:00.704901  3298 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.787019  3298 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.790453  1612 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:00.790581  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.791294  1682 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:00.794945  1616 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:59:00.795825  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 176238us
I20260709 12:59:00.796742  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.797047  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:00.798132  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:00.799019  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.799916  1538 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:00.800676  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.800355  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:00.805733  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:00.807714  1533 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:00.809242  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.811316  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:00.811830  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:00.767655  1686 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.792891  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.813512  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:00.791854  2925 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.822803  1686 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:00.826195  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:00.804584  3248 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:00.806677  3291 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:00.833940  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.814064  3267 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.810820  3367 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:00.825279  3127 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.829701  3134 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.844799  3381 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 12:59:00.825568  2921 consensus_queue.cc:1175] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:00.836510  1534 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:00.854344  3134 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.848297  3127 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.831941  3296 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.856586  1690 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
W20260709 12:59:00.880389  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 68618.4us
I20260709 12:59:00.887876  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.891053  3134 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.863652  3179 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.895283  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.896193  1613 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:00.896693  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:00.915874  1615 raft_consensus.cc:606] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:00.897676  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.917737  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.919111  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:00.897677  3380 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:59:00.899228  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.915992  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.902922  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:00.901947  3127 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:00.921900  1613 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:00.924624  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.925182  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.929826  1609 raft_consensus.cc:2368] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
W20260709 12:59:00.930739  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89646.7us
I20260709 12:59:00.934372  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.935075  2305 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:00.935460  3306 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:00.914618  3308 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.936175  3306 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:00.938223  3308 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.938743  3309 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:00.927274  3367 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.939244  3309 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.939658  3309 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:00.940697  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:00.917158  3321 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.924178  3343 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.945128  1610 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:00.946004  3343 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:00.948473  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.949568  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.949857  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.957657  1608 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:00.943985  1607 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:00.969496  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.970244  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.971135  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.971786  1614 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:00.971026  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.908135  1684 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:00.973323  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.915374  3131 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:00.975118  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.973318  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.978683  1608 raft_consensus.cc:2410] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:00.975838  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:00.976423  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.974175  2921 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:00.979488  3343 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:00.979995  3052 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:00.980068  3343 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:00.980872  2305 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:59:00.981225  2305 pending_rounds.cc:85] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 2
I20260709 12:59:00.981467  2305 pending_rounds.cc:107] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:59:00.981715  2305 raft_consensus.cc:2917] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:59:00.979624  2921 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.980564  3052 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.983623  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:00.982100  2305 raft_consensus.cc:2889] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:01.006208  1686 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:59:00.975869  3291 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:00.984525  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:00.986249  3393 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:59:00.974618  3221 raft_consensus.cc:2764] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:00.997452  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:01.013713  1541 raft_consensus.cc:606] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:01.001816  3330 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.003s
I20260709 12:59:00.975649  3267 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:00.967826  3392 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:01.003521  2921 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.025884  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:00.982245  3343 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.026829  3330 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.029573  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.030449  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:01.031116  3330 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.031723  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:00.983474  3131 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:01.015604  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.014689  3127 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.018867  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:01.032888  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.008863  1686 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 3
I20260709 12:59:01.060885  1686 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:59:01.061210  1686 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:59:01.036862  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:01.041369  3391 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 12:59:01.045011  1609 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:01.106839  1609 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:01.008869  3052 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:01.028621  1685 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:01.029589  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:01.108733  1681 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:01.111047  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 127468us
I20260709 12:59:01.050407  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:01.112102  1541 raft_consensus.cc:606] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.112594  1541 raft_consensus.cc:614] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:01.046486  3306 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:01.077491  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:01.025238  3267 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.124581  3267 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.070465  3022 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:01.075176  1686 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:01.047343  3392 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.095243  3309 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.013616  3325 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:01.097764  3394 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:59:01.101198  3237 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:01.114590  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:01.115432  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:01.116456  3127 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:01.130466  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 93759.3us
W20260709 12:59:01.136943  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 159228us
W20260709 12:59:01.158365  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46421.5us
I20260709 12:59:01.159149  1507 leader_election.cc:400] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:01.159430  1507 leader_election.cc:403] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:01.162387  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.163651  3291 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:01.163813  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.164469  3267 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.164649  3291 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.147904  3311 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.165295  3022 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:01.165998  1533 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:01.166556  3267 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.166275  3022 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.155596  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:01.169231  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:01.169474  3305 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.170776  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:01.171494  1533 raft_consensus.cc:606] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:01.171947  1533 raft_consensus.cc:614] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:01.147634  3309 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.165132  1538 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:01.179951  1609 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:01.148450  1608 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:01.173972  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.152647  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.138391  3392 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.144721  3297 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:01.157851  3400 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:01.214641  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 99322.8us
I20260709 12:59:01.178371  1681 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:01.170511  3127 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.172456  3311 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:01.278142  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61204.9us
I20260709 12:59:01.164482  1534 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:01.290647  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.291602  1686 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:01.320019  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 160998us
I20260709 12:59:01.321393  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.322022  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:01.265069  3306 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:01.278626  3384 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:01.278855  3127 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.330811  3237 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:01.197147  3323 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.123s
W20260709 12:59:01.339452  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 171591us
I20260709 12:59:01.340696  1506 leader_election.cc:400] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:01.342990  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.345765  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:01.346450  1539 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:01.346853  3146 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.348459  1538 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:01.348658  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:01.350659  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.350555  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.351678  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.352206  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:01.352393  1538 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:01.355749  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.356693  1538 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:01.356586  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.357712  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.356467  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.358327  1535 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:01.362787  3399 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:59:01.340298  3389 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:01.366439  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:01.331971  3309 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:01.296633  3296 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:59:01.336253  3384 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:01.402635  1612 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:01.335862  3306 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.278348  3400 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:01.378934  3389 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:01.408000  3384 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.425223  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.482537  1539 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:01.459287  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.459868  3409 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:01.407403  3309 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:59:01.497114  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 175796us
I20260709 12:59:01.465233  3146 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:59:01.465783  3052 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.488113  3325 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:01.498709  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 155818us
I20260709 12:59:01.505777  1690 raft_consensus.cc:2368] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:59:01.496421  1534 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:01.509450  1506 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.511337  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:01.507247  3403 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:59:01.495416  3237 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.498409  3408 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:59:01.512198  3415 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:01.531792  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:01.532930  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 319989us
W20260709 12:59:01.577806  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 46112.1us
I20260709 12:59:01.581812  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:01.532708  3345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.008s	sys 0.015s
I20260709 12:59:01.586086  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:01.588706  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.524596  2921 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.528236  3411 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:01.584540  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.599282  1689 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:01.600875  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.606436  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.513258  3389 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:01.590926  3345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.015s
I20260709 12:59:01.614346  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:01.619539  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 113261us
I20260709 12:59:01.620378  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.583346  3413 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.597524  3402 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:01.602728  3405 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:01.590648  3416 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:01.602985  3406 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:01.607122  3401 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:01.607107  3306 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.632339  3421 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.633457  3267 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:01.637301  2921 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.637660  3392 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.641589  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:01.642202  3127 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:01.652283  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 141069us
I20260709 12:59:01.624830  3221 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:01.624648  3312 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:01.659245  3221 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:01.650218  3406 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.660539  3127 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.660665  3406 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.660131  3221 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.628196  3309 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.662360  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:01.625279  3400 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.628666  3415 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.626339  3052 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.629077  3402 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:01.696381  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 76087.8us
I20260709 12:59:01.627300  3409 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:01.700721  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 59205.9us
I20260709 12:59:01.654287  3416 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:01.706139  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.653106  3248 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:01.697477  3267 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:01.707255  3402 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.717881  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.713524  3419 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:01.722370  3419 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.716609  3392 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.722746  3419 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.722896  3345 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.723282  3131 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:01.708544  3421 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:01.716763  3248 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.713639  3400 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:01.713711  3341 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:01.709667  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:01.714385  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:01.719203  3409 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:01.720902  1506 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:01.708415  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 94134.9us
I20260709 12:59:01.713779  3299 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:01.693928  3384 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.723531  3422 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.716028  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.732470  3421 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.732679  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.733986  3131 raft_consensus.cc:993] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:59:01.743454  3131 raft_consensus.cc:1081] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:59:01.726665  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 1870) took 1125 ms. Trace:
I20260709 12:59:01.730592  1582 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:01.732288  1607 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:01.756194  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.759668  3296 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:01.761793  1534 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:01.764605  1506 leader_election.cc:400] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3.
I20260709 12:59:01.765444  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.727358  3400 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.771009  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:01.736879  3299 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:01.748548  3313 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:01.739248  3384 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.774243  3299 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:01.786207  3299 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.787475  3267 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.733552  3248 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:01.754925  3422 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.777884  3127 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.780877  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.782130  3052 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:01.774585  3367 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:01.774984  3400 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:01.783154  3418 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:01.755059  3306 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:01.776098  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:01.778271  3410 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:59:01.779405  3313 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.758095  3405 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:01.763885  3388 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:01.763430  3415 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:01.793737  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88106.1us
I20260709 12:59:01.734827  3325 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:59:01.754546  1610 rpcz_store.cc:276] 0709 12:59:00.601225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.601377 (+   152us) service_pool.cc:224] Handling call
0709 12:59:01.726448 (+1125071us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400320854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:01.726583 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750700288}
I20260709 12:59:01.860991  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:01.861595  1610 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.862058  3173 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:01.862732  3173 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:01.787993  1439 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193), VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194), VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195), VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:01.809876  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59471.9us
I20260709 12:59:01.774359  3414 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:01.864933  3414 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:01.865321  3414 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:01.866439  3321 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:01.820369  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.820776  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:01.822119  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:01.825449  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.869043  1614 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.828029  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:01.869541  1616 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:01.829057  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.773051  3408 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:59:01.812039  3420 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:59:01.834856  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.870628  3173 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:01.838033  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.849241  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.893316  1615 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:01.855705  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:01.871785  1612 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:01.872434  3405 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.835942  3313 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.740481  3416 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.885250  3425 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:01.885780  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.898205  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:01.916033  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.901325  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.901899  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.902374  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.917965  1539 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:01.913580  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.921901  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.922920  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:01.923074  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:01.927594  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1180) took 1024 ms. Trace:
I20260709 12:59:01.931895  3411 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:01.932807  3411 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.933323  3411 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:01.913580  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.937157  1534 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:01.837432  3291 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:01.943378  3291 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:01.935949  3345 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:01.944720  3348 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.946151  3408 consensus_queue.cc:1059] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.880079  3325 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:01.990701  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 155968us
I20260709 12:59:01.835075  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:01.986018  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:01.991899  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.991964  1613 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:01.992491  1539 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.986901  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:01.993556  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:01.928081  1609 rpcz_store.cc:276] 0709 12:59:00.903479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.113696 (+210217us) service_pool.cc:224] Handling call
0709 12:59:01.114075 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.193862 (+ 79787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.927329 (+733467us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b5400321754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:01.927529 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150975360}
I20260709 12:59:01.987921  1439 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.995874  1439 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 2 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:59:01.947647  3127 raft_consensus.cc:993] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:59:01.998922  1439 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.988847  1612 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:02.001065  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:02.001009  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 211825us
I20260709 12:59:02.003427  1439 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:02.004204  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:02.007098  1616 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:02.006867  1439 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.014894  1541 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:02.015028  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:02.018267  1439 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:59:02.022607  1439 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.978590  3291 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:02.031168  1539 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:02.033047  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:01.993817  1611 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:01.977094  3345 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:02.035310  1439 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 2, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.000726  3392 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:02.019933  3410 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:02.038678  3423 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:02.040108  1439 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.043673  1614 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:01.997929  3325 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:02.044873  1613 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:02.057613  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1175) took 1155 ms. Trace:
I20260709 12:59:02.058051  1607 rpcz_store.cc:276] 0709 12:59:00.902143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.103971 (+201828us) service_pool.cc:224] Handling call
0709 12:59:01.727623 (+623652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.755301 (+ 27678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.992914 (+237613us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5400320854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:02.057410 (+ 64496us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400320850. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:02.057552 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440000768}
I20260709 12:59:02.060418  3410 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.060752  3419 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.061827  3414 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.063795  3414 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.064586  3422 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.064509  3406 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.066567  3406 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.066934  3414 raft_consensus.cc:1081] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:59:02.069433  1533 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.072182  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:02.137157  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54683.6us
I20260709 12:59:02.138059  1581 leader_election.cc:400] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:59:02.137930  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.138373  1581 leader_election.cc:403] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:02.036656  3309 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.139369  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:02.063072  3419 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:02.141492  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65887.2us
I20260709 12:59:02.141590  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:02.158833  1682 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.068549  2880 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:02.046211  3423 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:02.165823  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:02.144879  3406 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:02.148766  3179 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3.
I20260709 12:59:02.173173  2304 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:02.172875  3406 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.174731  1689 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:59:02.175081  1689 pending_rounds.cc:85] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 2
I20260709 12:59:02.175340  1689 pending_rounds.cc:107] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:59:02.175568  1689 raft_consensus.cc:2917] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:59:02.175768  3406 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:02.175953  1689 raft_consensus.cc:2889] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:02.160526  2921 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:02.177409  3345 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.177636  2921 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.178594  3345 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:02.178781  3414 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:02.179180  3414 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.179533  3414 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:02.179644  2921 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.148882  2925 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.181491  3022 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:02.182063  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:02.182180  3325 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.183230  3306 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:02.183445  3325 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.184362  3419 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:02.184860  3419 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.185307  2305 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.185108  3311 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.186830  3419 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:02.144809  3411 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.188818  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:02.189443  2308 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:59:02.189657  1682 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:02.199075  1533 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:02.001058  3348 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.201884  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:02.212576  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:02.213735  1607 raft_consensus.cc:2410] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:02.215420  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:02.216306  1613 raft_consensus.cc:2368] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:59:02.192873  3423 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:02.207477  3305 raft_consensus.cc:993] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:59:02.242159  3348 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.162006  3319 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
W20260709 12:59:02.258567  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.217320  3385 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:02.269340  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 232512us
I20260709 12:59:02.270933  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:02.217058  1610 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
W20260709 12:59:02.271406  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:02.270166  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 266048us
I20260709 12:59:02.278311  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:02.267671  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 234063us
I20260709 12:59:02.178620  3402 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.257628  3306 raft_consensus.cc:1081] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 12:59:02.286651  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:02.260941  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:02.262889  3384 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.308109  1690 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:02.309134  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:02.220747  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:02.320191  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:02.322448  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 99793.4us
I20260709 12:59:02.329697  1539 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:02.340008  1682 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:02.365059  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 45196.8us
I20260709 12:59:02.308329  3267 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:02.263243  3313 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.371034  1537 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:02.375109  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:02.279855  3385 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:02.376168  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 97997.5us
I20260709 12:59:02.387679  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:02.389130  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:02.382321  3343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.005s	sys 0.012s
I20260709 12:59:02.318560  3322 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:02.386380  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:02.339218  3309 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:02.317915  3392 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:02.392733  3226 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:02.334451  3384 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.313498  3438 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:02.394155  1506 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:02.394924  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 174262us
I20260709 12:59:02.321648  3237 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:02.391193  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:02.367164  3396 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:02.339444  3146 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:02.449565  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 55485.7us
W20260709 12:59:02.453073  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 178333us
I20260709 12:59:02.360122  3248 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
W20260709 12:59:02.441787  3432 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:59:02.606419  3406 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:02.606992  3406 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:02.607846  1683 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:02.547091  3438 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.610005  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57982
I20260709 12:59:02.610276  3438 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:02.610572  1681 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:02.611007  1681 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:02.611405  3431 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
W20260709 12:59:02.442364  3343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.005s	sys 0.013s
I20260709 12:59:02.441569  3437 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.433583  3411 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:02.375514  3305 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:59:02.454684  3127 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:02.626415  3400 consensus_meta.cc:287] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.003s
I20260709 12:59:02.626863  3400 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.628099  1535 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:02.629739  2305 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:59:02.630125  2305 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 3
I20260709 12:59:02.630360  2305 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:59:02.589505  1611 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:02.613687  3146 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.459340  2302 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:02.440706  3226 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:02.450404  3442 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:02.594902  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 257983us
I20260709 12:59:02.663215  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:02.547133  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:02.666983   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:02.443681  3322 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.665899  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:02.631978  3091 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:02.613833  1685 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:02.683216  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.614054  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:02.684576  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.686015  3455 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:02.687394  1539 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:02.688514  1686 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:02.688553  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:02.690405  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:02.690619  1539 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:59:02.665913  1534 consensus_meta.cc:287] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.000s
I20260709 12:59:02.691534  3146 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.691648  1534 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:02.692006  3455 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:02.692687  3455 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:02.693595  3455 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.694367  3400 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.663640  3226 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.452046  3392 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.570010  3309 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:02.615263  3313 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.668653   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:02.708280  3309 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.582741  2303 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
W20260709 12:59:02.662811  3405 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.749s	user 0.006s	sys 0.006s
I20260709 12:59:02.680964  3402 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.697633  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.694249  3467 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:02.699071  3406 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:02.700167  3345 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 12:59:02.700635  3413 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:02.753381  3416 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:02.696512  3091 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.753635  3413 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:02.667387  3438 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:59:02.761687  1684 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:02.761682  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.753870  3416 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:02.763228  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:02.763279  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:02.763512  3416 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.764835  3416 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:02.765755  3408 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:02.772352  3408 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:02.774937  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57984
I20260709 12:59:02.775569  1689 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:02.775976  1689 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.404706  3425 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:02.707173  3322 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:02.687590  3414 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.005s
I20260709 12:59:02.716393  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57984
I20260709 12:59:02.793149  1683 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:02.793680  1683 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:02.794734  1684 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:02.815083  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.831264  1684 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:02.796131  3414 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.860203  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:02.832415  3299 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:02.724620  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:02.702214  3451 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:59:02.726426  3442 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.726630  3440 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:02.666720  3385 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.733353  3392 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.734373  3405 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.738638  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.697532  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:02.924429  1685 raft_consensus.cc:2410] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:02.758098  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:02.754522  3413 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:02.630611  2305 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:59:02.770908  3292 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.943638  3298 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.769678  3091 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.944350  3298 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:02.739600  3248 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:02.945665  3248 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.946926  3298 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.773456  3408 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.949380  3248 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:02.780385  3291 consensus_meta.cc:287] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.000s
I20260709 12:59:02.941059  3306 consensus_queue.cc:1059] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:59:02.954936  3291 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.783226  3384 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.878054  1683 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:02.919303  3458 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:59:02.920245  3022 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:02.941458  3311 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.962437  3291 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.962275  3311 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:02.921562  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 197051us
I20260709 12:59:02.921772  1541 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:59:02.923246  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49416.7us
I20260709 12:59:02.967514  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:02.968293  1683 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:02.982667  1535 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:02.985304  3311 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:02.985831  3022 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:02.992192  3414 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.993443  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.995011  1535 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:02.932792  3442 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.996199  1687 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:02.997417  1540 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:02.998752  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.932539  3415 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.932866  3323 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.000011  3442 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:02.999939  3323 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.959483  1688 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:02.955924  3306 raft_consensus.cc:3055] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:03.003625  3306 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:03.004630  3306 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.006152  3306 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:02.941197  1689 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:02.959349  3413 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:02.977349  3422 raft_consensus.cc:3055] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:02.978107  3443 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:02.970705  3425 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:02.960980  2305 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:02.966773  3423 consensus_meta.cc:287] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.001s
I20260709 12:59:03.002063  3323 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.009418  3297 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:02.994269  3022 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:02.959482  3440 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.012252  1535 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:03.027766  3384 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.022382  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:02.998942  1685 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:03.053762  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:03.003126  3052 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:03.056012  3428 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:03.055830  3052 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.056546  3428 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:03.061898  1538 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.002s	sys 0.016s
W20260709 12:59:03.062239  1538 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.002s	sys 0.016s
I20260709 12:59:03.011224  3422 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:03.045425  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 498956us
I20260709 12:59:03.022934  3442 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:59:02.899144  1681 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.066533  3422 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.068140  1687 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:03.087384  1507 leader_election.cc:400] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:59:03.087800  1507 leader_election.cc:403] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:03.035857  3423 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.046627  3297 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.105027  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:03.109045  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:03.109822  1611 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:03.111071  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:03.111610  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.112314  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.112778  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.115644  1607 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:03.119434  1689 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:03.014354  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.094549  3415 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4.
I20260709 12:59:03.120396  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:03.121522  3436 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:59:03.124348  1681 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.126741  3423 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:03.085005  3384 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.130146  3419 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:03.094408  3345 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:59:03.118366  1610 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:03.133728  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.010s
I20260709 12:59:03.117676  3022 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:03.359375  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.010s	sys 0.010s
I20260709 12:59:03.122954  3052 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:03.106815  3422 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:03.135361  3367 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.167407  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:03.373184  1682 raft_consensus.cc:2410] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:03.174794  1539 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:03.131022  3226 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.198057  1688 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:03.200518  1614 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:03.202273  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:03.210731  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 187997us
W20260709 12:59:03.211480  2275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.006s	sys 0.011s
W20260709 12:59:03.384836  2275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.006s	sys 0.011s
W20260709 12:59:03.212064  2276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.000s	sys 0.012s
I20260709 12:59:03.205747  3450 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:59:03.260842  3267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.006s
W20260709 12:59:03.332736  1536 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.008s	sys 0.038s
W20260709 12:59:03.392848  1536 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.009s	sys 0.038s
W20260709 12:59:03.324330  3237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.006s	sys 0.006s
W20260709 12:59:03.211808  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.009s	sys 0.009s
W20260709 12:59:03.394942  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.009s	sys 0.010s
I20260709 12:59:03.394881  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:03.212349  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.009s	sys 0.010s
W20260709 12:59:03.397081  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.010s	sys 0.011s
W20260709 12:59:03.291620  1615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.012s	sys 0.014s
W20260709 12:59:03.394729  3237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.006s	sys 0.007s
I20260709 12:59:03.324967  3475 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:59:03.401203  3237 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:03.403518  3237 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:03.385790  2276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.000s	sys 0.012s
I20260709 12:59:03.388271  3481 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.400501  3425 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:03.411962  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:03.412844  2303 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:03.416216  3226 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.372539  3443 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.357458  3428 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:03.382117  3345 consensus_queue.cc:1243] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:03.438156  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:03.394913  3267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.010s	sys 0.007s
I20260709 12:59:03.454881  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:03.398649  1615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.013s	sys 0.015s
I20260709 12:59:03.358808  3419 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:03.457947  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.397914  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 1.03199e+06us
I20260709 12:59:03.381246  3367 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:03.488023  3299 consensus_meta.cc:287] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:59:03.492533  3052 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.487217  3470 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:03.528541  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 74456.3us
I20260709 12:59:03.455260  3267 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:03.501155  3423 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.533358  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:03.536429  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:03.539350  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:03.365041  1653 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:03.439043  3297 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.508847  3311 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:03.541786  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 176864us
I20260709 12:59:03.549880  3401 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:03.549989  3430 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:03.538586  3442 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:03.406561  3481 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.595644  3384 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.456808  3443 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:03.568293  1439 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.428s	user 0.006s	sys 0.012s
W20260709 12:59:03.563385  3479 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:59:03.562907  3436 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.560353  3450 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:03.530004  3052 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:03.578045  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.551631  3423 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.534461  3470 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.623206  3470 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.625062  3052 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:03.628424  3436 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.630867  3436 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.631453  3436 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.634198  3423 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:03.638815  3413 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.002s
I20260709 12:59:03.602689  3267 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.607702  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:03.649289  1688 raft_consensus.cc:2410] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:03.609550  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:03.599028  3472 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:03.697395  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:03.611655  3481 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.584417  3311 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.578886  3430 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.621125  3419 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:03.621433  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1884) took 1252 ms. Trace:
I20260709 12:59:03.576838  3401 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:03.641727  3367 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:03.596956  1439 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.500s	user 0.007s	sys 0.012s
W20260709 12:59:03.703289  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.035s	sys 0.080s
W20260709 12:59:03.765254  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.035s	sys 0.080s
I20260709 12:59:03.631940  3436 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.595634  3442 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.700389  3413 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:03.762223  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.013s	sys 0.022s
I20260709 12:59:03.705192  1537 rpcz_store.cc:276] 0709 12:59:02.371866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.371960 (+    94us) service_pool.cc:224] Handling call
0709 12:59:02.372272 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.376077 (+  3805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.376105 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.376537 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.395522 (+1018985us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:03.395561 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.395693 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.621235 (+225542us) raft_consensus.cc:1685] finished
0709 12:59:03.621256 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.621382 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3468,"raft.queue_time_us":14733,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":38813,"thread_start_us":1018712,"threads_started":1,"wal-append.queue_time_us":829469}
I20260709 12:59:03.773051  3419 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.777355  3419 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:03.778333  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1258) took 1022 ms. Trace:
I20260709 12:59:03.779489  3419 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:03.778734  1534 rpcz_store.cc:276] 0709 12:59:02.756427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.002423 (+245996us) service_pool.cc:224] Handling call
0709 12:59:03.028646 (+ 26223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:03.085657 (+ 57011us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:03.089274 (+  3617us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:03.118968 (+ 29694us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.598435 (+479467us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:03.602155 (+  3720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.621517 (+ 19362us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.778085 (+156568us) raft_consensus.cc:1685] finished
0709 12:59:03.778111 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.778275 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3354,"raft.queue_time_us":34906,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3693,"thread_start_us":441061,"threads_started":1,"wal-append.queue_time_us":654497}
W20260709 12:59:03.781009  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.013s	sys 0.022s
W20260709 12:59:03.765925  3292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.021s	sys 0.012s
W20260709 12:59:03.781935  3292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.021s	sys 0.012s
I20260709 12:59:03.785987  3425 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:03.786605  3425 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:03.793903  3415 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:03.794446  3415 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:03.794597  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:03.698076  3306 consensus_meta.cc:287] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.676s	user 0.002s	sys 0.010s
I20260709 12:59:03.765852  3401 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:03.812428  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:03.818785  3408 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:03.821749  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1249) took 1492 ms. Trace:
I20260709 12:59:03.822234  1541 rpcz_store.cc:276] 0709 12:59:02.329326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.331611 (+  2285us) service_pool.cc:224] Handling call
0709 12:59:02.331926 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.968320 (+636394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.821438 (+853118us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54004227d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:03.821673 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356072192}
I20260709 12:59:03.702060  3472 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.843860  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1250) took 1512 ms. Trace:
I20260709 12:59:03.708130  3430 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:03.815989  3475 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.795428  3415 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.805282  3413 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.853454  1536 rpcz_store.cc:276] 0709 12:59:02.331814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.332667 (+   853us) service_pool.cc:224] Handling call
0709 12:59:02.332915 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.333108 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:03.393223 (+1060115us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.843467 (+450244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:03.843521 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:03.843565 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.843677 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.843802 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71532,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3455,"thread_start_us":1474607,"threads_started":2}
W20260709 12:59:03.842474  2304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.003s	sys 0.040s
I20260709 12:59:03.866022  3443 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:03.868921   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:03.861660  3345 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:03.863641  2304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.004s	sys 0.040s
I20260709 12:59:03.866894  3022 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.858269  3475 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:03.882753  1681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.078s	sys 0.294s
I20260709 12:59:03.872946  2303 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:59:03.884770  3487 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:59:03.892953  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 404474us
I20260709 12:59:03.876159  3450 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:03.930804  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 391563us
I20260709 12:59:03.934937  3343 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.935283  3367 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.935847  3367 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.935581  3343 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.936896  3226 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.937557  3226 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.937980  3343 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.938549  3388 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.938670  3343 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.939045  3388 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.939107  3343 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.939733  3226 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.940819  3226 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.937960  3367 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.941175  3343 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:03.942922  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:03.943297  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 180) took 1956 ms. Trace:
I20260709 12:59:03.947561  1613 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:03.883008  3022 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:03.954411  1613 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:59:03.954918  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.945916  1615 rpcz_store.cc:276] 0709 12:59:01.987184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.988444 (+  1260us) service_pool.cc:224] Handling call
0709 12:59:01.988720 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:01.989104 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.989134 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:02.014092 (+ 24958us) log.cc:844] Serialized 52 byte log entry
0709 12:59:02.281586 (+267494us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:03.486506 (+1204920us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.502309 (+ 15803us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.830526 (+328217us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b18003fa5a0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:03.899642 (+ 69116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.899763 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.943090 (+ 43327us) raft_consensus.cc:1685] finished
0709 12:59:03.943109 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.943245 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17602,"prepare.queue_time_us":921743,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":7153,"raft.queue_time_us":31894,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":43315,"spinlock_wait_cycles":26966016,"thread_start_us":1751748,"threads_started":3,"wal-append.queue_time_us":368207}
I20260709 12:59:03.978322  1613 pending_rounds.cc:85] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 1
I20260709 12:59:03.979734  1613 pending_rounds.cc:107] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:03.979967  1613 raft_consensus.cc:2889] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:03.900004  3458 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:03.982611  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:03.983500  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:03.983917  1613 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:03.986892  1607 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:03.942531  3311 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.941179  3388 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:03.944006  3452 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:03.985879  3443 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:03.991956  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:03.992970  3413 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:04.021432  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.007s	sys 0.016s
W20260709 12:59:04.021853  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.007s	sys 0.016s
W20260709 12:59:04.024286  3312 raft_consensus.cc:670] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:04.024816  1612 raft_consensus.cc:1217] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3]   Dedup: 4.3->[]
W20260709 12:59:04.025302  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.025305  1612 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:59:04.026273  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.026551  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.027607  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.028019  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.028752  1612 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:04.029543  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.030540  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.031006  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.031441  3475 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.032450  1689 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:04.033388  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.033947  1689 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:04.034634  3423 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.035092  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.035974  3423 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:04.031031  1612 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:04.052125  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.052955  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1211) took 1061 ms. Trace:
I20260709 12:59:04.053356  1687 rpcz_store.cc:276] 0709 12:59:02.991642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.996910 (+  5268us) service_pool.cc:224] Handling call
0709 12:59:02.997183 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.068816 (+ 71633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.052721 (+983905us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b540032cdd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:04.052895 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162676096}
I20260709 12:59:04.057621  1535 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:04.058111  1535 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:04.058985  1535 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.064822  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.065963  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:04.066708  1685 raft_consensus.cc:1217] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 12:59:04.066974  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.067211  1685 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:04.067965  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:04.068550  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1058) took 1384 ms (client timeout 1651 ms). Trace:
I20260709 12:59:04.068912  3443 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:04.069131  1690 rpcz_store.cc:269] 0709 12:59:02.684355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.690149 (+  5794us) service_pool.cc:224] Handling call
0709 12:59:04.068326 (+1378177us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540035af54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:04.068486 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850570624}
I20260709 12:59:04.071004  3443 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.003587  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1257) took 1625 ms. Trace:
I20260709 12:59:04.005575  3022 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:04.007690  3422 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.000s
I20260709 12:59:04.008445  3472 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.010864  1608 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:03.977316  3345 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:03.977396  3436 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.012596  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.083122  1613 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:03.984403  3442 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:03.984489  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 536) took 1720 ms. Trace:
I20260709 12:59:04.015223  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.017704  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.018399  1615 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:04.092370  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.092800  1607 raft_consensus.cc:2410] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:03.941347  3226 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.068145  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:04.000823  3486 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:04.097990  1615 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:04.098474  1615 pending_rounds.cc:85] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 2
I20260709 12:59:04.098767  1615 pending_rounds.cc:107] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:04.099048  1615 raft_consensus.cc:2889] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:04.075822  1616 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:04.101727  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.102515  1616 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:04.077060  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.106439  1687 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:03.980881  3469 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:59:04.073829  1533 rpcz_store.cc:276] 0709 12:59:02.377993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.734323 (+356330us) service_pool.cc:224] Handling call
0709 12:59:02.734653 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:02.735021 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.735067 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:02.735732 (+   665us) log.cc:844] Serialized 52 byte log entry
0709 12:59:03.781464 (+1045732us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:03.782580 (+  1116us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.783713 (+  1133us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.784109 (+   396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.784179 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.003345 (+219166us) raft_consensus.cc:1685] finished
0709 12:59:04.003367 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.003524 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1407,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":1846,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":6742,"thread_start_us":1045367,"threads_started":1,"wal-append.queue_time_us":1207613}
I20260709 12:59:04.019932  3452 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:03.989204  3458 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.060073  1535 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:03.984282  3237 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:59:04.093103  1613 raft_consensus.cc:2393] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:04.097235  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 79602.8us
W20260709 12:59:04.157876  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 459936us
I20260709 12:59:04.159274  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.077797  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:03.992977  3450 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.120273  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.081496  3413 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:04.149142  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.150171  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.110140  3472 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.093134  3475 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:04.115540  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.110142  3422 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:04.094449  3345 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.086469  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.165004  3442 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:04.169091  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.203708  1615 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:04.170548  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.165988  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.204665  1613 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:04.205008  1613 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:04.173709  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1252) took 1835 ms. Trace:
I20260709 12:59:04.208702  1538 rpcz_store.cc:276] 0709 12:59:02.338593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.372598 (+ 34005us) service_pool.cc:224] Handling call
0709 12:59:02.372964 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.392991 (+ 20027us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:03.062525 (+669534us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.130663 (+ 68138us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b48002ac3d8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5db6bb37 00007f8d5db6b9ca 00007f8d5dc6326f 00007f8d5dc62f37 00007f8d5dc7755c 00007f8d5dc77508 00007f8d5dc77488 00007f8d5dc77443 00007f8d5dc766ec 00007f8d5cba0a96
0709 12:59:03.772411 (+641748us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:03.780627 (+  8216us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.780768 (+   141us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:03.780805 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.780874 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.173413 (+392539us) raft_consensus.cc:1685] finished
0709 12:59:04.173522 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.173651 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14507,"prepare.queue_time_us":153312,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":34684,"raft.run_cpu_time_us":2476,"raft.run_wall_time_us":727775,"spinlock_wait_cycles":64731520,"thread_start_us":1371980,"threads_started":2,"wal-append.queue_time_us":813327}
I20260709 12:59:04.180205  3179 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.188457  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.212193  3179 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.190968  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.214993  3179 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.191425  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1073) took 1491 ms. Trace:
I20260709 12:59:04.215659  1684 rpcz_store.cc:276] 0709 12:59:02.699566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.846427 (+146861us) service_pool.cc:224] Handling call
0709 12:59:02.848129 (+  1702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.955108 (+106979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.955151 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.955205 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:02.955242 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.191170 (+1235928us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001a5254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:04.191232 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.191366 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236952960}
I20260709 12:59:04.194315  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:04.217839  2308 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.220505  3419 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.169822  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.174563  3472 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.176465  3414 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:04.225497  3414 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:04.180744  3319 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:59:04.205857  1613 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.229384  1613 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.207240  1688 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:04.234572  3472 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:04.207746  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.236258  1686 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:04.186282  3345 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.242857  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:04.243965  3179 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:04.245061  3179 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:04.245488  3179 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:04.246496  3179 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.197654  3226 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:04.207430  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 121058us
I20260709 12:59:04.247936  3179 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:04.249068  1507 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.250284  3345 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:04.250456  1507 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.250746  3345 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.251245  3345 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.214731  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:04.251976  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 63646.4us
I20260709 12:59:04.252406  3226 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:04.252876  3226 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.253252  3226 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.261806  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:04.262079  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47435.2us
I20260709 12:59:04.262774  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.267290  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.270314  1535 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:04.274540  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1259) took 1517 ms. Trace:
I20260709 12:59:04.274940  1535 rpcz_store.cc:276] 0709 12:59:02.756728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.050662 (+293934us) service_pool.cc:224] Handling call
0709 12:59:03.096061 (+ 45399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:04.057502 (+961441us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400245a20. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc2dc0 00007f8d58c4d1c0 00007f8d58c4e231 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c
0709 12:59:04.274231 (+216729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.274474 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801427328}
I20260709 12:59:04.283701  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.284461  1611 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:04.284665  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.289985  3401 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.173767  3443 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 12:59:04.291523  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.292127  1607 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:04.259794  3442 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:04.292965  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.296372  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.295545  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.297647  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.310770  1615 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:04.309069  2308 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:04.297005  1689 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:04.298310  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:04.309490  2276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.030s	sys 0.079s
I20260709 12:59:04.293227  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:04.313082  2276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.030s	sys 0.079s
I20260709 12:59:04.178759  3022 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.177695  3367 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.304203  1613 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
W20260709 12:59:04.296669  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.019s	sys 0.096s
W20260709 12:59:04.329643  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.019s	sys 0.096s
I20260709 12:59:04.174322  3440 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:04.330209  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.043s
W20260709 12:59:04.335454  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.004s	sys 0.043s
I20260709 12:59:04.335721  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.331261  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.338627  1535 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:04.339660  2925 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:04.341662  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.321362  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.334646  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:04.292301  3409 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:59:04.351711  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.353070  1540 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.331529  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.354171  1533 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:04.354285  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.337643  3389 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:04.356989  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:04.335963  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 541503us
I20260709 12:59:04.342998  1614 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:04.333709  1536 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:04.343664  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.347434  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.358336  1504 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:04.358899  1538 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:04.361994  1686 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:04.327723  1611 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:04.296046  3419 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:04.285030  3438 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.344305  1507 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.283102  3422 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.351718  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.352347  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.332664  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.294503  3442 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.292200  3401 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.294564  3428 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.307569  3436 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:04.359573  3389 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.356185  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.172487  3413 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.208910  3425 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.372140  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.293615  3430 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.374775  1533 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:04.360630  3267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.032s	sys 0.083s
I20260709 12:59:04.359732  3443 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.380959  3442 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.373605  3496 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:04.404675  3267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.032s	sys 0.084s
I20260709 12:59:04.428133  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.429409  1535 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:04.385782  3319 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.397907  3389 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:04.402056  3502 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:04.422660  3384 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.439965  3384 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.442051  3384 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:04.362030  3298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.021s	sys 0.027s
W20260709 12:59:04.314563  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 513061us
I20260709 12:59:04.449294  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.449424  3436 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.450016  3436 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.452672  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.428023  3496 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.454223  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.393590  1540 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:04.342422  3367 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.368495  3419 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.341260  3022 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.457010  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.362531  1534 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:04.407742  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.396600  3458 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:04.447196  3298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.021s	sys 0.027s
I20260709 12:59:04.438859  3502 raft_consensus.cc:3055] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:04.404675  3500 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.422936  3438 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.394680  3428 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.383590  1538 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:04.467955  1533 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:04.459056  1536 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:04.425913  3495 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:59:04.403258  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:04.360558  3292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.001s	sys 0.046s
I20260709 12:59:04.473021  3422 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:04.452060  3436 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.430550  3226 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.470629  1539 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:04.470629  3419 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:04.472568  3496 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.438149  3319 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.476424  3475 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.359447  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:04.476336  3502 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:04.505481  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.503248  3237 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.508301  3442 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.510653  3345 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.487720  3438 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:04.516746  3497 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:59:04.483328  3498 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:04.493777  3292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.046s
W20260709 12:59:04.519750  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.482029  3443 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.341050  3388 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:04.524348  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.034s
W20260709 12:59:04.547988  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.011s	sys 0.034s
I20260709 12:59:04.548918  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1219) took 1507 ms. Trace:
W20260709 12:59:04.522256  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.013s	sys 0.031s
I20260709 12:59:04.551582  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.090902  2304 rpcz_store.cc:276] 0709 12:59:02.260841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.263079 (+  2238us) service_pool.cc:224] Handling call
0709 12:59:02.310334 (+ 47255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.339490 (+ 29156us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:02.453998 (+114508us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.979269 (+525271us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b18000fb8c0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a 00007f8d58c55a2a
0709 12:59:03.894590 (+915321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:03.930690 (+ 36100us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:03.932633 (+  1943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.943913 (+ 11280us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.981261 (+ 37348us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66076,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":144340,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":29446400,"thread_start_us":899094,"threads_started":1,"wal-append.queue_time_us":1603844}
I20260709 12:59:04.537786  1532 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:04.545418  1535 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:04.552335  1536 raft_consensus.cc:2376] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3. Re-sending same reply.
I20260709 12:59:04.545580  3298 raft_consensus.cc:1064] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:59:04.549343  1681 rpcz_store.cc:276] 0709 12:59:03.041706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.227252 (+185546us) service_pool.cc:224] Handling call
0709 12:59:03.345391 (+118139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.345612 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:03.885645 (+540033us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.548468 (+662823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.548548 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:04.548606 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.548688 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.548851 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1904,"prepare.queue_time_us":1011239,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":1167446,"threads_started":2}
W20260709 12:59:04.557174  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.012s
W20260709 12:59:04.565624  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 206252us
W20260709 12:59:04.557062  3385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.013s
W20260709 12:59:04.570137  3385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.011s	sys 0.014s
I20260709 12:59:04.570729  1612 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:04.568760  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.014s	sys 0.012s
I20260709 12:59:04.571852  3345 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.574249  3438 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:04.554443  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.014s	sys 0.031s
I20260709 12:59:04.577472  3442 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.582257  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:04.556258  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.538714  3475 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.579591  3436 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:04.538628  3237 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.592098  1541 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:59:04.594456  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 286255us
I20260709 12:59:04.584703  3401 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.598377  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.635814  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.550973  3443 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.590718  3438 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.592378  3311 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:04.545063  3498 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.588677  3442 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:04.578423  3502 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:04.646862  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.036s
W20260709 12:59:04.668092  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.036s
I20260709 12:59:04.635387  3500 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:04.678504  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 303811us
I20260709 12:59:04.649468  3415 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.597301  3413 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.593708  3345 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 12:59:04.694154  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 138540us
I20260709 12:59:04.695247  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:04.653347  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.699154  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:04.700549  3052 raft_consensus.cc:2764] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:04.701284  3052 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:04.702175  3507 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:59:04.702636  3052 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:04.703903  3052 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:04.704524  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:04.705402  1532 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 12:59:04.706238  3505 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:59:04.694286  3500 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.711900  3500 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.712333  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:04.713853  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.714282  3237 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:04.715348  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.716804  3450 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.653632  3461 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:04.717837  3461 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.718874  3298 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.665710  3438 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.720945  3428 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.721063  3345 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.671424  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.721587  3345 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.722205  2302 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:04.701442  3452 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.722594  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.723227  3500 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.723371  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.723691  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:04.723884  3500 consensus_queue.cc:1243] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:04.728380  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.729760  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.725095  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.736712  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.648173  3401 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.747875  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1221) took 1700 ms. Trace:
I20260709 12:59:04.717339  3450 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:04.748381  1683 rpcz_store.cc:276] 0709 12:59:03.047331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.339941 (+292610us) service_pool.cc:224] Handling call
0709 12:59:03.340340 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.340614 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:04.022242 (+681628us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.747566 (+725324us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.747616 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:04.747657 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.747722 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.747818 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":987921,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3960,"raft.queue_time_us":79481,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5685,"spinlock_wait_cycles":30132992,"thread_start_us":1395870,"threads_started":3,"wal-append.queue_time_us":648078}
W20260709 12:59:04.752696  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 84939.7us
I20260709 12:59:04.731050  3052 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:04.756279  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.759506  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.760990  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.764424  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.765717  1537 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:04.766280  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.766866  1533 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:04.747589  3367 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.768949  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:04.773938  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 254702us
I20260709 12:59:04.774665  3475 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.779733  3430 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.765252  3052 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:04.768466  3226 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.784492  3438 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.786126  3502 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:04.788357  3345 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.789654  3401 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.796669  3461 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.797502  2303 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:04.799023  3450 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.799556  3443 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.804466  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:04.807502  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.807189  1653 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:04.808066  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.824698  2307 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:04.824988  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:04.825819  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:04.827172  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.809325  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.766983  3419 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.801411  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.848521  2301 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:04.849711  3425 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.773655  3319 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.854224  2310 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:04.828917  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.827975  1533 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:04.856146  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.856364  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.856802  1611 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:04.856950  1616 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.857518  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.857963  1611 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:04.858418  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.859051  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.811775  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.831051  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.832429  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.859937  1609 raft_consensus.cc:2376] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5. Re-sending same reply.
I20260709 12:59:04.860450  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.861223  1612 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:04.832682  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.836268  1610 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:59:04.862329  1608 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:04.839284  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.842003  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:04.864447  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.864998  1608 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
W20260709 12:59:04.865180  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.865566  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.868285  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.872546  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.873070  1614 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.873385  3525 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:04.873811  3525 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.874181  3525 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:04.876504  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:04.877090  3452 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.879637  3469 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:04.880017  3469 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.880368  3469 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.881088  3472 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:04.883281  1616 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:04.885552  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.887887  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:04.887107  1614 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:04.887199   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:04.868803  1615 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:04.890853  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:04.891887  3267 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:04.892280  3267 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:04.893124  3524 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.893019  3267 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.893549  3022 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.893635  1539 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:04.862159  3401 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:04.895275  3401 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:04.895638  3401 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.893669  3524 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:04.898443  3524 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:04.901098  3237 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:04.901497  3237 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.901849  3237 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.903213  3414 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.904681  3414 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.912961  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.913574  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.914317  1688 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:04.915669  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:04.916266  1682 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:04.918910  3389 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:04.921541  3517 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:04.922072  3237 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.923437  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:04.867609  3498 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.924320  3520 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.924782  3520 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:04.925634  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.926420  3237 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:04.926806  3520 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.927359  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:04.927966  2303 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.928612  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.936483  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.937328  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:04.889768  1579 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:04.955716  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:04.962795  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 73087.6us
I20260709 12:59:04.964779  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:04.966979  3297 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:04.967578  1532 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:04.971277  1507 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.866058  3455 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:04.979422  1690 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:04.983547  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.983533  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.985653  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:04.986017  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:04.988679  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 162191us
I20260709 12:59:04.989374  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:04.954881  3311 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.999598  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:04.990955  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.005636  3323 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:05.005407  1538 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:05.002020  3408 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.006482  3408 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.006824  3408 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.982786  3022 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:59:05.003000  3527 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:05.006016  3323 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.990170  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.933595  3496 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.047307  3496 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.010814  1579 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.010912  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.048714  3388 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.049122  1538 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:04.969645  3482 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:05.012748  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:05.049700  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:05.050045  1690 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:59:05.049925  3482 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:04.990000  3415 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.050676  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.050894  3415 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:05.049728  3495 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.051415  3415 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.050715  3388 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.052062  3388 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:05.052109  3482 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:04.998663  3455 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:05.068521  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:04.989845  3297 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.057416  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.056910  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:05.052186  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.070887  1539 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:05.057468  3323 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.041476  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:05.052650  3495 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:05.052966  3388 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.083907  3384 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.076732  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.062227  3527 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:05.085594  3527 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.088400  3389 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:05.089601  3502 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:05.090276  3502 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:05.091084  3502 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.053894  3267 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.080447  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:04.984608  3525 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.081048  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.094048  1539 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:05.071614  3496 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.052780  3460 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:59:05.081866  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:05.101099  1689 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.107870  3388 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:05.110263  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:05.110946  1540 raft_consensus.cc:606] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.111312  1540 raft_consensus.cc:614] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:05.096807  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.114296  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:05.114902  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.115007  1540 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:05.116030  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.116621  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.117256  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.015641  3237 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:05.117372  1541 raft_consensus.cc:2376] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5. Re-sending same reply.
I20260709 12:59:05.118127  1540 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:05.095232  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 105095us
I20260709 12:59:05.120108  1507 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:05.121981  1541 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.124652  1507 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:05.077688  3472 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.014778  3311 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.135166  1689 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:05.057574  3533 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 12:59:05.004113  3498 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.113s
W20260709 12:59:05.126683  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 48151.4us
I20260709 12:59:05.138649  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:05.140985  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.174319  1539 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:05.142585  3469 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.102735  3496 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.149623  3525 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:05.110350  3388 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:05.129472  3472 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.156643  1540 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:05.137240  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:05.079430  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.175515  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.121018  3422 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:05.180002  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:05.183133  3237 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:05.185840  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.128435  3425 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:05.185259  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:05.193526  1686 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:59:05.194006  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 56840.5us
I20260709 12:59:05.194535  1582 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.175225  3442 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.202523  1611 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:05.202883  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.202996  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:05.189229  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:05.192499  1656 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 2.019s (SENT) [suppressed 18 similar messages]
I20260709 12:59:05.195482  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:05.185181  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:05.195495  1614 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:05.195726  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:05.196362  3422 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:05.196450  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:05.197091  3292 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:05.198215  3367 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.198917  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.199612  3469 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:05.188416  3419 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:05.201153  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:05.205735  1685 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:05.207314  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:05.208053  1614 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.208856  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.191262  3472 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.216691  1615 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:05.188637  3496 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.203797  3425 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.200165  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:05.228941  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.230795  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.221480  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.184597  3226 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:59:05.246277  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61195.4us
I20260709 12:59:05.246740  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.246966  2276 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:05.192632  3297 consensus_queue.cc:1059] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:59:05.239431  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
W20260709 12:59:05.193353  3509 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:05.254971  1610 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:05.205389  3179 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.256510  3022 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.182047  3052 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:05.214187  3389 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.220451  3442 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.217394  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:05.251451  1608 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:05.238631  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.224054  2925 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:05.222895  3367 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.253865  1614 raft_consensus.cc:606] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:05.243706  3425 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.258163  3298 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:05.325559  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 70988.3us
I20260709 12:59:05.245280  1540 raft_consensus.cc:2368] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6.
I20260709 12:59:05.255215  3461 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.351114  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.351585  1535 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:05.325639  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 71290.2us
W20260709 12:59:05.329713  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 94697.3us
I20260709 12:59:05.337047  3551 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.338224  3460 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.342764  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.191933  3455 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:05.319134  3440 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.256767  3179 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.346930  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.347450  1683 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.348951  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:05.342136  3542 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.198s	user 0.003s	sys 0.002s
I20260709 12:59:05.353835  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.229657  3526 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:05.340718  3367 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.342669  2302 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.357635  1533 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:05.368440  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:05.338203  3401 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:05.386221  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.341816  3292 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:05.364441  3298 raft_consensus.cc:3055] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:05.366504  3551 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:05.415045  3551 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:05.406435  3540 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:05.340529  3422 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.409545  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.411473  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.368323  3312 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.413394  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.428929  1539 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:05.415115  3541 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:59:05.416724  1687 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:05.356290  3508 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.430330  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.511921  1533 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:05.513667  1533 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:05.410207  3452 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.349396  3237 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:05.431160  3482 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.370918  3520 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:05.436756  3528 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:05.442132  3442 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:05.443169  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.410812  3311 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.452121  1539 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:05.454631  1608 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.455358  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:05.459580  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:05.461254  3312 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:05.462069  3549 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:05.462584  3323 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.464011  3401 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:05.464071  3292 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.467546  3179 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.470973  1532 pending_rounds.cc:85] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 1
I20260709 12:59:05.403121  3526 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:05.499630  3415 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.412964  3298 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:05.524622  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 277967us
I20260709 12:59:05.523877  3440 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:05.531303  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:05.572171  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 344970us
I20260709 12:59:05.539052  1611 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:05.539203  1535 raft_consensus.cc:606] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.516848  3452 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:05.526984  3528 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:05.570178  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.583292  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.578405  1507 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:05.584373  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.585707  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.415942  3551 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.573697  1535 raft_consensus.cc:614] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:05.555388  1532 pending_rounds.cc:107] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 12:59:05.605239  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 252332us
I20260709 12:59:05.548390  3442 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:59:05.614440  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 405659us
I20260709 12:59:05.589140  1540 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:05.607183  3495 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.620940  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:05.582186  3452 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.630302  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:05.627288  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:05.631052  1685 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.621064  2308 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:05.631465  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.622673  3554 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.604696  3323 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.610615  3028 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.628298  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:05.629163  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:05.637225  1611 raft_consensus.cc:2368] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6.
I20260709 12:59:05.587811  3551 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.605010  3414 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.588459  1532 raft_consensus.cc:2889] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.586643  3052 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:05.605196  3022 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.582480  3401 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:59:05.624277  3482 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:05.659885  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 78955.4us
I20260709 12:59:05.626469  3495 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:05.624195  3415 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.607359  3533 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:59:05.706442  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 56103.1us
I20260709 12:59:05.706552  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:05.707625  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 273098us
I20260709 12:59:05.632920  3298 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.636845  3442 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:05.723608  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.725155  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:05.650063  3414 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:05.726404  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 74687us
I20260709 12:59:05.736723  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:05.627652  3559 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 12:59:05.754357  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:05.722414  3495 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.755048  1504 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:05.707432  3028 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:05.640923  3550 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 12:59:05.734109  3414 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.706040  3482 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:05.763533  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:05.767068  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:05.740824  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:05.760818  1582 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.767082  3226 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.784011  3502 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.805119  3226 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.787804  3557 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:05.790355  2302 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
W20260709 12:59:05.805120  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44510.8us
I20260709 12:59:05.805876  3557 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.806529  2305 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:59:05.791329  3408 consensus_meta.cc:287] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.000s
W20260709 12:59:05.789659  2303 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.861s	user 0.006s	sys 0.003s
I20260709 12:59:05.807407  2303 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:05.807293  3408 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.810287  3226 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:05.810418  1537 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:05.810817  3226 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.811457  3408 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.735049  3052 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:05.805194  3502 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.806778  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.734800  3442 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.740345  3547 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:05.771461  1534 consensus_meta.cc:287] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.000s
I20260709 12:59:05.821864  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:05.785689  3545 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
I20260709 12:59:05.825595  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.742082  3527 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.921058  1538 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:05.921167  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:05.937527  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.938217  1538 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
W20260709 12:59:05.911948  3367 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.004s
I20260709 12:59:05.742161  3179 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:05.949424  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:05.740365  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:05.954145  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 213918us
W20260709 12:59:05.929275  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 195352us
I20260709 12:59:05.818521  3547 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:05.942096  2925 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:05.939869  3496 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
I20260709 12:59:05.950903  1533 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:05.958806  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:05.937947  3460 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:05.937376  3557 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:05.936630  3527 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:05.917299  1534 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:05.993762  1536 raft_consensus.cc:606] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:05.994324  1536 raft_consensus.cc:614] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:05.995329  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:05.948366  3415 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:05.991014  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:05.963591  3547 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.911672  3425 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:05.963392  3052 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.963816  3526 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:06.008499  3422 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:05.948673  3452 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:05.925168  3482 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.022251  1685 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:06.001550  3527 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.963444  3179 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:05.961944  3367 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:05.991824  3496 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.024000  3557 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.014808  3052 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:06.026503  3481 raft_consensus.cc:476] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:06.079041  3496 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.025758  3442 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.011688  3415 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.050295  3560 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.093071  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:06.087075  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:06.101992  3452 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:06.105149  3425 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:06.105810  3553 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.645s	user 0.005s	sys 0.000s
I20260709 12:59:06.067945  3482 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.113296  3367 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.087692  3557 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.023422  3422 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.115435  3557 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.085587  3052 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.116645  3422 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:06.117143  3564 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:59:06.113341  3179 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.058836  3567 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:59:06.104128  3495 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.193773  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1931) took 1078 ms. Trace:
I20260709 12:59:06.194716  1532 rpcz_store.cc:276] 0709 12:59:05.115225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.470281 (+355056us) service_pool.cc:224] Handling call
0709 12:59:05.470722 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.727113 (+256391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.735504 (+  8391us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:05.800771 (+ 65267us) log.cc:844] Serialized 26 byte log entry
0709 12:59:06.192584 (+391813us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:06.192788 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.193002 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.193122 (+   120us) raft_consensus.cc:1685] finished
0709 12:59:06.193161 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.193493 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":390383,"threads_started":1,"wal-append.queue_time_us":249314}
I20260709 12:59:06.208038  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:06.212965  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:06.215814  1607 raft_consensus.cc:2368] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:59:06.215809  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.218189  1613 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.057525  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:06.227952  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 170418us
W20260709 12:59:06.061920  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 107096us
I20260709 12:59:06.231182  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.233621  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.234555  1687 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.234617  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:06.240661  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:06.241946  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.243583  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.249385  3550 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:06.250319  3550 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:06.252610  3237 raft_consensus.cc:2764] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:59:06.252435  3550 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.254012  3527 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.139271  3415 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.256985  3384 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:06.257392  3267 consensus_meta.cc:287] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.146s	user 0.008s	sys 0.004s
I20260709 12:59:06.257771  3384 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:06.259032  1681 raft_consensus.cc:2410] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:06.259325  3384 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.123222  3414 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.264845  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:06.268518  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.268550  3415 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:06.250414  3401 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:06.271584  3422 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:06.284732  3401 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:06.286391  3401 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.287333  3414 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.289146  1611 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.290367  3495 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.293217  3422 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.297010  3527 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.300369  3415 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.311697  3415 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.304726  1613 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:06.312568  3415 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:06.313845  1682 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:06.311791  1687 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:06.313606  3415 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:06.308634  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:06.315097  3422 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:06.306592  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 311197us
I20260709 12:59:06.316668  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 1918) took 1121 ms. Trace:
I20260709 12:59:06.320358  1607 rpcz_store.cc:276] 0709 12:59:05.195669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.196178 (+   509us) service_pool.cc:224] Handling call
0709 12:59:06.316348 (+1120170us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400216454. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:06.316586 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294660480}
I20260709 12:59:06.327435  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:06.333194  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 57313.4us
I20260709 12:59:06.335891  3455 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:06.336746  3559 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:06.338629  3455 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:06.341426  1689 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.342636  1683 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.339640  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.347187  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.351811  3533 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:06.353919  3526 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.354925  3567 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:59:06.356531  3581 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:59:06.356688  3028 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:06.357146  3028 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:06.351780  3237 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.362708  3428 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.363191  3428 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:06.363075  3028 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.369170  3297 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:06.369634  3297 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:06.352618  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:06.370381  3415 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.372262  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:06.373464  3297 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.374639  3297 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.364315  3428 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.378398  3428 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.378281  3547 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:06.379715  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52466us
I20260709 12:59:06.389854  2276 leader_election.cc:400] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6.
I20260709 12:59:06.390203  2276 leader_election.cc:403] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:59:06.391309  3571 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.282s	user 0.004s	sys 0.000s
W20260709 12:59:06.391876  3551 consensus_meta.cc:287] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.004s
I20260709 12:59:06.389859  1682 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.381793  3471 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.383327  3312 raft_consensus.cc:3055] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.394845  3312 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:06.395090  1504 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.396891  3576 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.396107  3312 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.398047  3508 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6.
I20260709 12:59:06.398432  3312 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.364338  3028 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:06.405051  3472 consensus_meta.cc:287] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.157s	user 0.012s	sys 0.006s
I20260709 12:59:06.405563  3472 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.407908  1684 raft_consensus.cc:2368] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5.
I20260709 12:59:06.412253  2310 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:06.414198  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 94122.6us
I20260709 12:59:06.416524  3388 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.417076  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.417431  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:06.417636  3237 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:06.418042  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:06.418238  3237 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.418982  3389 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:06.419305  3559 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:06.419615  3389 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:06.419960  3559 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:06.421000  3389 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.421597  1581 leader_election.cc:400] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5.
I20260709 12:59:06.421217  3559 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.421726  3443 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.421968  1581 leader_election.cc:403] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:06.422230  3443 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:06.423733  3388 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.424962  1656 leader_election.cc:400] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:59:06.425294  1656 leader_election.cc:403] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:06.425964  3544 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3.
I20260709 12:59:06.423444  3443 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.435433  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.435760  3052 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.436255  2307 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:06.439622  1686 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.443450  3576 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:06.444161  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.444205  3576 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.445415  1535 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.447724  3576 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.451948  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:06.453974  3555 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.717s	user 0.003s	sys 0.003s
I20260709 12:59:06.455890  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1234) took 1133 ms. Trace:
I20260709 12:59:06.456344  1610 rpcz_store.cc:276] 0709 12:59:05.322161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.322516 (+   355us) service_pool.cc:224] Handling call
0709 12:59:05.342921 (+ 20405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:05.343342 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.343385 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:05.348492 (+  5107us) log.cc:844] Serialized 52 byte log entry
0709 12:59:05.525868 (+177376us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:05.525909 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.525979 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.453043 (+927064us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:06.455358 (+  2315us) raft_consensus.cc:1685] finished
0709 12:59:06.455378 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.455690 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21443,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6412,"spinlock_wait_cycles":7221504,"thread_start_us":156928,"threads_started":1,"wal-append.queue_time_us":258022}
I20260709 12:59:06.457783  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1291) took 1314 ms. Trace:
I20260709 12:59:06.458024  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.458232  1540 rpcz_store.cc:276] 0709 12:59:05.142816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.346705 (+203889us) service_pool.cc:224] Handling call
0709 12:59:06.457441 (+1110736us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400074c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:06.457591 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515505408}
I20260709 12:59:06.459364  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.459571  1610 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:59:06.460098  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.463076  3226 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.465623  1610 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.466346  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.467015  1607 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:06.467589  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.468052  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.468576  3443 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.468864  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.470999  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.468238  1610 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.471639  1611 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:06.480281  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.480912  1690 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:06.485954  3519 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.486442  3519 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:06.489187  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.489305  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.417093  3550 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:59:06.490410  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.491310  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.444264  3525 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:06.491746  3525 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:06.492403  1507 leader_election.cc:400] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6.
I20260709 12:59:06.492789  1507 leader_election.cc:403] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:59:06.492887  3525 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.494102  3525 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.494318  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.497296  3576 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:06.498492  3554 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:59:06.473875  3547 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:06.502000  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.487535  3519 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.510533  3414 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.513700  1535 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:06.517712  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.519564  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.522569  2310 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:06.512077  3577 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:59:06.529600  1685 raft_consensus.cc:2368] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6.
I20260709 12:59:06.508754  3388 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5.
I20260709 12:59:06.532976  1690 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:06.537240  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:06.537803  1688 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:06.539970  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 45797.5us
I20260709 12:59:06.544049  3425 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.545087  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.544765  3425 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:06.545498  3563 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.553s	user 0.012s	sys 0.006s
I20260709 12:59:06.547758  3425 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.548857  3472 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:06.560359  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.533074  3401 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:06.565801  3298 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.566962  3319 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:06.567395  3319 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:06.571519  3562 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:06.572263  3562 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.573122  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1922) took 1493 ms. Trace:
I20260709 12:59:06.573482  1537 rpcz_store.cc:276] 0709 12:59:05.079174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.079384 (+   210us) service_pool.cc:224] Handling call
0709 12:59:05.079678 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.810939 (+731261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.572631 (+761692us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54002d82d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:06.572936 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680222592}
I20260709 12:59:06.571532  3519 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:06.577083  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 67667.4us
I20260709 12:59:06.553292  3554 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.587069  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:06.588181  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46751.1us
I20260709 12:59:06.593575  1610 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:06.594720  3428 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:06.595235  3052 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.595341  3028 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:06.595827  3428 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:06.583408  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1243) took 1670 ms (client timeout 1830 ms). Trace:
I20260709 12:59:06.574301  3562 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:06.598142  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:06.596915  1681 rpcz_store.cc:269] 0709 12:59:04.912839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.923241 (+ 10402us) service_pool.cc:224] Handling call
0709 12:59:06.583185 (+1659944us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540001c554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:06.583325 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3068966144}
I20260709 12:59:06.587139  3576 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6.
I20260709 12:59:06.578451  3422 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:06.580358  3237 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:06.577736  3388 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:06.604625  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:06.579438  3414 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:06.596302  3428 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:06.582269  2310 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:06.612207  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 84270.3us
I20260709 12:59:06.612865  3528 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.613884  3414 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.618161  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.627699  1611 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:06.629570  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 1918) took 2092 ms (client timeout 2123 ms). Trace:
I20260709 12:59:06.627061  1685 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:06.614768  3422 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:06.586944  3319 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.635496  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.636276  3425 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:06.636264  3452 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:59:06.637889  3425 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.638362  3471 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.638840  3471 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:06.639082  3422 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.639887  3425 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:06.630031  1534 rpcz_store.cc:269] 0709 12:59:04.536818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.540248 (+  3430us) service_pool.cc:224] Handling call
0709 12:59:06.626996 (+2086748us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002260d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:06.628621 (+  1625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064276352}
I20260709 12:59:06.579016  3520 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:06.648401  3425 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.648777  3319 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.639736  3471 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.650528  3428 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.653586  3428 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.645398  3414 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:06.645524  3588 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.167s	user 0.003s	sys 0.000s
I20260709 12:59:06.643049  3528 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.643486  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.656041  3471 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.660671  1507 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:06.663779  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.668771  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:06.675933  3591 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:59:06.692549  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.692654  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.693459  1688 raft_consensus.cc:2368] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6.
I20260709 12:59:06.694556  1686 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:06.694629  3028 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:06.696031  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 63344.7us
I20260709 12:59:06.693454  3552 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.696694  3552 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.697016  3552 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.697814  3414 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:06.698217  3414 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:06.698607  3414 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.691751  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:06.708571  3592 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:06.715059  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 133) took 7658 ms. Trace:
I20260709 12:59:06.716485  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.717177  1540 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:06.720284  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.724407  3425 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:06.732868  1540 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:06.733903  1690 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.735849  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:06.742954  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 109770us
I20260709 12:59:06.732168  3552 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.737560  3425 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:06.722478  3422 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.747237  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:06.749074  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.749934  1534 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.755110  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.756832  3425 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.758080  1541 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:06.761241  1686 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:06.767249  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.772984  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.774595  3552 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.759533  1532 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:06.776407  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.769318  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.769335  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.772904  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.781853  1684 raft_consensus.cc:2410] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:06.780941  3312 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:06.786332  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.787789  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.794816  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.793316  3443 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:06.803138  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 56530.5us
I20260709 12:59:06.804957  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.806816  3573 raft_consensus.cc:993] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:59:06.807451  3573 raft_consensus.cc:1081] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 12:59:06.809420  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.811136  3179 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.811626  3179 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:06.796177  3312 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:06.812105  3179 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.813108  3312 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.816419  3443 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.818787  3443 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.819314  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.818647  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:06.820739  3388 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.820869  1683 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:59:06.821413  1683 pending_rounds.cc:85] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:59:06.821693  1683 pending_rounds.cc:107] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:59:06.822077  1683 raft_consensus.cc:2889] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.822448  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.824787  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.827525  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.828212  3179 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.831009  3179 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.831095  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.834836  1538 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:06.836560  1613 raft_consensus.cc:2410] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:06.795958  3415 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:06.715489  1439 rpcz_store.cc:276] 0709 12:58:59.056533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.071912 (+ 15379us) service_pool.cc:224] Handling call
0709 12:59:06.714831 (+7642919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:03.832054 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:03.929865 (+ 97811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:03.932048 (+  2183us) write_op.cc:435] Acquired schema lock
0709 12:59:03.942337 (+ 10289us) tablet.cc:662] Decoding operations
0709 12:59:04.186308 (+243971us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:04.186366 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:04.186396 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:59:04.187151 (+   755us) tablet.cc:701] Row locks acquired
0709 12:59:04.187169 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:04.187299 (+   130us) write_op.cc:270] Start()
0709 12:59:04.187406 (+   107us) write_op.cc:276] Timestamp: P: 1783601944187258 usec, L: 0
0709 12:59:04.187427 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:04.188055 (+   628us) log.cc:844] Serialized 4424 byte log entry
0709 12:59:05.201625 (+1013570us) op_driver.cc:464] REPLICATION: finished
0709 12:59:05.480964 (+279339us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d55b410ac 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d5c681ef0
0709 12:59:05.817628 (+336664us) write_op.cc:301] APPLY: starting
0709 12:59:05.823085 (+  5457us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:05.963235 (+140150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:05.986821 (+ 23586us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:06.141917 (+155096us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:06.158794 (+ 16877us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:59:06.158866 (+    72us) write_op.cc:312] APPLY: finished
0709 12:59:06.159282 (+   416us) log.cc:844] Serialized 77 byte log entry
0709 12:59:06.286536 (+127254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:06.286888 (+   352us) write_op.cc:454] Released schema lock
0709 12:59:06.286984 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:06.287762 (+   778us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:06.287806 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13335,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":546171,"apply.run_cpu_time_us":7286,"apply.run_wall_time_us":502713,"num_ops":10,"prepare.queue_time_us":1734852,"prepare.run_cpu_time_us":70477,"prepare.run_wall_time_us":846200,"raft.queue_time_us":216060,"raft.run_cpu_time_us":15330,"raft.run_wall_time_us":480813,"replication_time_us":998904,"spinlock_wait_cycles":6679936,"thread_start_us":2810004,"threads_started":5,"wal-append.queue_time_us":636053,"wal-append.run_cpu_time_us":35287,"wal-append.run_wall_time_us":1293679}]]}
I20260709 12:59:06.840492  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:06.840713  2302 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:06.846482  1536 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:06.849323  1610 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:06.853752  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.853888  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.854559  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:06.868988  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:06.871654  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.872787  3323 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:06.873302  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.874958  1536 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:06.876585  1613 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.877167  3585 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.877761  3585 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:06.878242  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 136029us
I20260709 12:59:06.888609  1536 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.892925  1613 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:06.865530  3415 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.907737  1535 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:06.908051  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:06.897382  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 205750us
I20260709 12:59:06.861931  1534 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:06.896652  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.897895  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.910327  1538 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.901981  3297 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:06.902871  1610 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:06.906354  1611 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:06.911846  2308 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:06.904414  1683 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:06.904716  1685 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:06.908667  1681 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:06.880146  3585 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:06.863492  3573 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:59:06.911093  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:06.920250  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.921452  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:06.924499  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.924019  1437 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.925562  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:06.926280  1536 raft_consensus.cc:606] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.925861  1437 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.930183  3443 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:06.930815  3443 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.933182  3443 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.927485  1437 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:06.937976  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:06.897526  3028 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.938776  3028 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:06.926596  1536 raft_consensus.cc:614] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:06.945302  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:06.943826  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:06.946919  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:06.949532  1535 raft_consensus.cc:2410] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:06.882006  3414 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:06.950253  1437 catalog_manager.cc:5697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:06.914110  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34880
I20260709 12:59:06.960945  1534 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:06.961310  1534 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.967566  1611 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.977391  1541 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:06.985149  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:06.952569  3576 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:06.956382  3422 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.980878  3585 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:59:06.989997  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.990485  3415 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.019886  1690 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:06.991202  3323 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:06.992403  1537 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.993011  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:06.989246  3558 raft_consensus.cc:1027] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: attempt to promote peer c445b7b7d94f48f99a3599ddfc92f462: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:59:06.991848  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:06.990490  2925 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:59:06.998310  3414 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:06.997974  1437 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 3 to 4, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:07.000514  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 53704.2us
I20260709 12:59:07.028100  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:07.028294  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:07.001237  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.002858  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:07.003188  3237 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.007331  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.009608  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:07.009961  3528 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.029119  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:07.055846  1536 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:07.029708  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55581.5us
I20260709 12:59:07.060765  1507 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:07.067365  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64603us
I20260709 12:59:07.023872  3028 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.023247  3425 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:07.050323  3323 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:07.051554  3388 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.079872  1534 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.011245  3422 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:07.084278  1507 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:07.055169  3525 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:07.085985  1533 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:07.088617  1540 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:07.020859  3602 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:07.071384  3414 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:07.103504  1437 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 2, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
W20260709 12:59:07.105563  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 113908us
I20260709 12:59:07.107154  1534 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.061600  3528 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.065100  3237 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.081786  3552 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:07.098862  3422 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.137487  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:07.138815  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:07.141772  1540 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:07.129282  3576 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:07.139999  1437 catalog_manager.cc:5697] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:07.110678  3520 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:07.133091  3414 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:07.148327  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.150700  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:07.155184  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:07.158401  3461 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:07.158951  3461 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.160262  3292 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:07.160663  3292 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.160908  3461 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.160986  3292 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.160948  2310 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:07.161522  1612 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:07.162408  3179 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.162571  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.163260  1612 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:07.161355  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:07.165966  3613 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:07.166572  3613 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.167805  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.169023  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.169592  1615 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:07.170380  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.172506  1541 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:07.174855  3415 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:07.175443  3415 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.177721  3415 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.178498  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:07.179335  3388 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:07.179563  3323 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:07.162878  3179 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.163977  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.118965  3425 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.197058  1613 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:07.186452  1612 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:07.221616  1536 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:07.155670  3401 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.234992  3615 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:07.235473  3414 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:07.241578  3179 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.240084  1538 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:07.244977  1437 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 4, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:07.252106  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:07.252718  1612 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:07.265223  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:07.265276  3613 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.266906  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.268893  3414 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.253017  1612 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:07.239972  3292 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.285045  1612 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.286304  1612 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.180831  3297 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:59:07.287701  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.142165  3602 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.292160  1541 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:07.291499  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:07.320302  1437 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
W20260709 12:59:07.327385  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 192789us
W20260709 12:59:07.323945  1532 consensus_meta.cc:287] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.001s
W20260709 12:59:07.336128  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 204332us
I20260709 12:59:07.339412  1610 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:07.325369  1437 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193), VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194), VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195), VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:07.343817  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.339524  3298 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:07.346225  3608 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:59:07.346021  3298 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.341413  3550 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:07.347159  3550 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.348162  3525 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.349169  3550 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.349936  3525 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:07.351578  3525 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:07.334260  3615 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:07.352659  3525 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.353397  3602 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.353991  3455 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.355384  3525 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.331744  3576 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:07.370887  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.374651  3237 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:07.348104  3298 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.377197  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.376487  1437 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:07.376487  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.380247  1437 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 2, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.419368  1536 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:07.420941  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 84643us
I20260709 12:59:07.377728  3528 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:07.352180  3615 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.427829  1437 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 5, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 5 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:07.438854  3618 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:07.441206  3482 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:07.441875  3482 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.444327  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:07.444970  3425 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.448494  3292 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.439276  1437 catalog_manager.cc:5697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 2, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:07.443966  3482 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.457482  1612 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:07.465881  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:07.470920  2308 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:07.472322  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:07.473008  2310 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.475083  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:07.475788  2302 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:07.475835  3621 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:07.476533  3621 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.478708  3621 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.480677  2310 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
W20260709 12:59:07.486567  3626 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:59:07.513121  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 76781.8us
I20260709 12:59:07.492686  3576 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:07.584084  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:07.586977  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67295.2us
I20260709 12:59:07.596264  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:07.596843  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:07.597231  1684 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:07.597517  1688 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:59:07.598558  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:07.596347  3022 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.600492  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:07.599355  1686 raft_consensus.cc:2393] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:07.590474  3555 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:59:07.603550  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 150437us
I20260709 12:59:07.600046  3022 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.588202  3415 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.590173  3443 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.615701  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:07.617671  1506 leader_election.cc:400] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6.
I20260709 12:59:07.609373  3482 raft_consensus.cc:2764] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:59:07.632335  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:07.631150  1614 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:07.632905  1689 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.634227  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:07.635033  1688 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:07.634426  3632 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:59:07.637715  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.642164  1535 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:07.645658  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.646585  1616 raft_consensus.cc:2368] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
W20260709 12:59:07.648751  3633 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:59:07.653589  3428 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:07.654364  3428 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.676069  3620 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:07.737614  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 101071us
W20260709 12:59:07.738404  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.631012  3602 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:07.746863  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 109278us
I20260709 12:59:07.749897  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:07.630215  3415 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:07.745450  3422 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.011s
I20260709 12:59:07.745175  3528 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:07.822840  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.820035  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:07.785233  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:07.792114  2276 leader_election.cc:400] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3.
I20260709 12:59:07.761633  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:07.839504  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 47533us
I20260709 12:59:07.840483  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:07.841586  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:07.809525  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:07.842504  1686 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:07.844384  3558 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:07.844786  3558 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.845100  3558 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.794059  3428 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.850327  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.850630  1689 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
W20260709 12:59:07.756799  3624 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.251s	user 0.001s	sys 0.019s
I20260709 12:59:07.852454  1536 raft_consensus.cc:2393] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:07.785748  3461 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.767729  3401 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:59:07.794781  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:07.855414  3389 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:07.856432  3298 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.766839  3615 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:07.851065  2308 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:59:07.781183  3237 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:07.758661  3636 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
W20260709 12:59:07.855490  3634 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:59:07.850492  3520 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:07.853643  3461 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.791172  2303 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:07.859994  3554 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:59:07.871796  1533 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:07.872514  3525 consensus_meta.cc:287] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.002s
I20260709 12:59:07.791988  3471 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:59:07.857724  3637 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.839082  3422 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:07.874439  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 54481.7us
I20260709 12:59:07.859899  3237 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:07.860054  3528 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:07.762868  3602 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.893625  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:07.876987  3520 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:07.897965  3520 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:07.901518  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1317) took 1011 ms. Trace:
I20260709 12:59:07.902067  1539 rpcz_store.cc:276] 0709 12:59:06.881048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.890831 (+  9783us) service_pool.cc:224] Handling call
0709 12:59:06.892396 (+  1565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:06.920328 (+ 27932us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:06.920636 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 12:59:07.818300 (+897664us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18000be300. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287
0709 12:59:07.818426 (+   126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:07.819616 (+  1190us) log.cc:844] Serialized 564 byte log entry
0709 12:59:07.819889 (+   273us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:07.819923 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:07.819984 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:07.884859 (+ 64875us) raft_consensus.cc:1685] finished
0709 12:59:07.892354 (+  7495us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:07.892487 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44542,"prepare.queue_time_us":525,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":72978,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4636,"spinlock_wait_cycles":11378944,"thread_start_us":146951,"threads_started":2,"wal-append.queue_time_us":182603}
I20260709 12:59:07.885303  3237 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.906526  3637 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:07.909991  1533 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:07.911069  1539 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:07.915069  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.916540  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:07.917188  1537 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:07.919324  3642 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.920604  3552 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:07.921156  3552 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.882745  3428 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:59:07.926469  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 322259us
I20260709 12:59:07.928377  3319 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:07.928937  3319 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.931113  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.931764  1612 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
W20260709 12:59:07.934451  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.892884  3639 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:59:07.919862  3642 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:07.948663  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.923354  3552 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.946779  1539 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:07.948612  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.951905  3637 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:07.944401  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 81509.1us
I20260709 12:59:07.952878  3615 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.954011  1608 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:07.905503  3636 consensus_queue.cc:1059] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:59:07.966147  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:07.971891  1616 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:07.978155  3620 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:59:07.987910  3602 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:08.003568  3640 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:59:07.997641  3415 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:07.975710  3528 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.004742  3636 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.024132  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:08.015651  3637 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.036424  3461 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.037027  3461 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.037488  3461 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.039812  3461 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:08.044661  3643 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:08.023715  3422 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.021576  3636 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:08.070670  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.053128  3414 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.027632  3415 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:59:08.102070  3414 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:08.111524  3642 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.112475  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.117256  3422 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.121217  3415 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.108105  3645 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:08.124913  3645 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.125283  1506 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:08.127312  3414 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:08.127663  3645 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.128180  3636 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:08.129904  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.136332  3443 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.136891  3443 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.138813  3443 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.139686  3443 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:08.139876  1608 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:59:08.140304  3443 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.141088  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.141399  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.142060  1683 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:59:08.142287  3022 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.142493  3443 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.143035  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.143275  3443 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:08.143676  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1942) took 1062 ms. Trace:
I20260709 12:59:08.144250  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.143935  3443 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.145777  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:08.146587  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.146613  3443 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.147835  3623 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:08.144114  1610 rpcz_store.cc:276] 0709 12:59:07.081614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.082524 (+   910us) service_pool.cc:224] Handling call
0709 12:59:07.098642 (+ 16118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:07.339863 (+241221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:08.143480 (+803617us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540009a6d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:08.143620 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553223936}
I20260709 12:59:08.147863  3636 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.160398  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 12:59:08.160983  1540 raft_consensus.cc:606] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:08.161331  1540 raft_consensus.cc:614] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:08.162767  2275 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:08.164103  3452 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.154776  3461 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.155751  3415 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.116737  3558 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.176615  3292 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.159540  3645 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.175101  3452 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.159266  3651 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.198040  1613 raft_consensus.cc:2368] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
W20260709 12:59:08.206270  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 103234us
I20260709 12:59:08.198410  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.204906  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.217077  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.196089  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.211098  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:08.216728  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60500us
I20260709 12:59:08.207377  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:08.221151  1682 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:08.220484  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.231704  1535 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:08.197052   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:08.232906  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.233776  1681 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:08.234680  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.234915  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.235667  1690 raft_consensus.cc:2410] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:08.235530  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.218536  1614 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:08.236677  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.222519  1607 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:59:08.237219  1689 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.236158  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.234686  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.239050  1685 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:08.236122  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.233610  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.183856  3623 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:08.242054  3617 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:08.199653  3558 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.242750  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.243367  1681 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.244830  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.236289  1687 raft_consensus.cc:2376] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6. Re-sending same reply.
I20260709 12:59:08.198298  3651 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.189699  3471 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.251199  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.259388  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.247493  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:08.249804  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.269712  1682 raft_consensus.cc:2393] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:08.251889  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.271507  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.271780  1610 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:08.272434  1614 raft_consensus.cc:2410] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:08.198063  3452 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.216012  3642 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.274997  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.187458  3401 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.277485  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.278087  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.279600  3650 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:08.185138  3613 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:59:08.197358  3292 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.281462  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.242689  3617 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:08.192752  3461 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.279968  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.290683  1689 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
W20260709 12:59:08.290998  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.281090  1615 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.284943  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.295286   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:08.299780  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 52401.8us
I20260709 12:59:08.215829  3415 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.280211  3650 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:08.277194  3471 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.304360  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.304450  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.306104  3651 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.198035  3645 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.278887  3401 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:08.315996  1681 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:08.324373  1579 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:08.319075  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.234134  3237 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:08.325757  1690 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:08.329190  1684 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.335397  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:08.333906  1684 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:08.352660  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 50400.3us
I20260709 12:59:08.353124  1684 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:08.354147  1684 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.355417  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:08.328007  3658 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:08.364611  3648 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:08.331272  3461 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.370716  1684 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:08.371356  1684 pending_rounds.cc:85] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 2
I20260709 12:59:08.371726  1684 pending_rounds.cc:107] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:08.372092  1684 raft_consensus.cc:2889] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:08.373835  1615 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:08.327606  3651 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:08.382979  3577 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.365450  3621 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:59:08.383361  3654 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.329993  3292 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.384334  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:08.398887  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 148398us
I20260709 12:59:08.388121  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.399457  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.381779  3637 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:08.389623  3237 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.390316  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.402776  1688 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:08.390918  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.381793  3558 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.405942  3558 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.393005  1683 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:59:08.410699  3642 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.412868  3642 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.397935  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.403546  3654 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.383000  3650 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.418097  3401 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.419351  3401 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.420550  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.365832  3028 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.365996  3554 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.376837  3573 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.404035  1689 raft_consensus.cc:2410] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:08.366055  3623 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.365842  3617 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.428212  1685 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:08.427367  3028 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:08.447985  3028 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.408128  3558 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.455827  3471 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.402556  3577 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.457016  3455 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:08.457489  3455 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:08.458048  3577 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.458319  3455 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.427129  3630 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.428783  3637 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:08.433189  3415 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.475888  3028 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.482851  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.483887  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.506112  1683 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
W20260709 12:59:08.489071  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1259) took 1303 ms (client timeout 1584 ms). Trace:
W20260709 12:59:08.506873  1613 rpcz_store.cc:269] 0709 12:59:07.185983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.232636 (+ 46653us) service_pool.cc:224] Handling call
0709 12:59:07.850191 (+617555us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800013e98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 12:59:08.488752 (+638561us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400216e54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:08.488975 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825918976}
I20260709 12:59:08.513265  3645 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.461194  3653 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.433437  3554 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.518349  3554 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:08.492820  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 92418us
I20260709 12:59:08.523203  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:08.524035  1541 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.525600  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:08.427587  3654 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.522727  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:08.502830  3525 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:59:08.502665  3637 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.431178  3648 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:59:08.459893  3455 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.460047  3452 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.528779  3650 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.504529  3577 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.532286  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:08.567498  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 145889us
I20260709 12:59:08.573426  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.573939  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.576887  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.577729  1534 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
W20260709 12:59:08.579305  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 56696.7us
I20260709 12:59:08.575692  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.576895  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:08.583281  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.584100  1534 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:08.549613  3028 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.585256  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.587203  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.625909  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.626798  1608 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:08.557407  3645 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.636593  2308 raft_consensus.cc:2368] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:59:08.597097  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.637724  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.637969  1615 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 1.
W20260709 12:59:08.714990  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 127900us
I20260709 12:59:08.715600  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.741484  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:08.628521  3648 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:08.753407  1616 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:08.639550  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.759133  1533 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:08.578958  3443 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:08.579021  3658 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.754251  1534 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
W20260709 12:59:08.763140  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 246933us
I20260709 12:59:08.570116  3298 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.624941  3654 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.773963  1534 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:08.776146  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.630247  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.778365  1540 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:59:08.764631  1506 leader_election.cc:336] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.597s (SENT)
I20260709 12:59:08.781898  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.740768  3617 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.780434  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:08.783951  1534 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.773156  2302 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:08.792354  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:08.740768  3680 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.755506  3554 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.623613  3620 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 12:59:08.762279  3648 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:08.756745  3662 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:08.761178  3651 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:08.571745  3650 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.579406  3577 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.800052  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:08.800482  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:08.800730  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.800997  3415 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.780563  3528 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:08.801580  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:08.802023  3671 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:08.802416  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:08.767033  3645 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:08.804437  3682 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:59:08.761226  3443 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.868808  3443 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.869779  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:08.870548  2301 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:08.796828  3677 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:59:08.871910  3415 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.862162  3665 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.873874  3650 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.874383  3415 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.873821  3665 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:08.844030  3651 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.862993  1609 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:59:08.783301  3649 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:59:08.840196  3648 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.771687  3663 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:08.798399  3658 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:08.854387  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:08.854913  3678 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:08.856640  1534 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:08.779438  3298 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.858385  1688 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:08.858911  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:08.860545  2309 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:08.911232  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52425.3us
I20260709 12:59:08.912110  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:08.912994  3482 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:08.864784  3319 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.866704  3671 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.913375  3482 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.913785  3482 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.915123  3671 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.885870  3651 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.779250  3654 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:08.831359  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66761.4us
W20260709 12:59:08.919876  1506 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.610s (SENT)
W20260709 12:59:08.888981  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 107227us
I20260709 12:59:08.900962  1541 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:08.795159  3617 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.913375  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:08.886559  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.844612  3554 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.928471  2307 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:08.901629  3615 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:08.934469  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:08.886972  2305 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:08.918632  3665 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:08.857142  3662 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:08.937005  1506 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.644s (SENT)
I20260709 12:59:08.942459  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:08.933183  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:08.925025  3654 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.949685  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:08.944621  2306 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:08.974413  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:08.976343  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:08.976902  1688 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.980552  3425 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:08.981182  3425 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.983229  3425 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.945397  3508 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.935740  3671 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.940773  3670 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:08.984185  1688 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:08.908506  3663 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.985745  3670 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.989012  3670 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.989622  3663 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.920789  3649 consensus_queue.cc:1243] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:08.992648  3554 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.917408  3658 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:08.997277  3658 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:08.934449  3615 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:08.998565  3615 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:08.999542  3615 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.997562  3577 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.005784  3528 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:09.006368  3528 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:09.013015  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.013679  3662 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:09.014497  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.016054  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:09.017014  3401 consensus_meta.cc:287] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.004s
I20260709 12:59:09.017794  1686 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:59:09.018113  1686 pending_rounds.cc:85] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:59:09.018323  1686 pending_rounds.cc:107] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:59:09.018553  1686 raft_consensus.cc:2889] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.018425  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.021991  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.022790  2306 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:09.023262  3617 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:08.929231  3452 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.032608  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.003942  3508 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:09.061299  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.007429  3528 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.024152  3630 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.032588  3649 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:09.069907  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:09.082327  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:09.085659  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:09.086236  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.086625  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.087668  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:09.088629  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.091833  1504 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.091231  3623 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:09.097399  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.091178  3662 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:09.101848  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 158358us
W20260709 12:59:09.099620  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 162640us
I20260709 12:59:09.087469  3554 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:09.103545  1506 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.676s (SENT)
I20260709 12:59:09.025224  3678 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:59:09.148102  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.093822  3425 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.096650  3482 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.150624  3425 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.151139  3425 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.152089  3482 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.153191  3554 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:09.087625  3602 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:09.154176  3554 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.130977  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.155818  1533 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:09.085724  3648 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.097129  3617 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:59:09.158010  3648 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.131816  1653 leader_election.cc:400] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:59:09.159073  1653 leader_election.cc:403] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:09.094522  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.095839  3528 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:09.132565  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.134313  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:09.134912  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.097007  3298 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.095916  3663 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:09.060802  3670 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:09.170469  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66953.8us
I20260709 12:59:09.171250  3670 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.078866  3630 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.098481  3623 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:09.092005  3520 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.102562  3649 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:09.101703  3662 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:09.091707  3665 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:09.150162  3678 consensus_queue.cc:1243] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:09.154502  3602 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.085729  3415 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:09.160661  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 68650.6us
I20260709 12:59:09.162274  1534 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:09.176383  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:09.180434  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:09.143767  3620 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:09.178241  3696 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:09.184758  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.137009  3237 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:09.164012  3648 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4.
I20260709 12:59:09.142270  3443 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.234123  2275 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:09.183326  3520 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:09.239485  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54865.6us
W20260709 12:59:09.240278  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 63978.7us
I20260709 12:59:09.241086  3422 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:09.242050  3694 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:59:09.244729  3684 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 12:59:09.280937  1506 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.248603  3298 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:09.187577  3663 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:09.192427  3662 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.275341  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:09.286012  1534 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:09.278235  1539 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:09.244765  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.279879  2275 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:09.250078  3685 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.383s	user 0.001s	sys 0.001s
I20260709 12:59:09.282119  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:09.279619  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.289875  1533 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:09.279166  3520 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.248116  2304 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:09.303696  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1136) took 1059 ms. Trace:
I20260709 12:59:09.288422  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.278829  3639 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.292197  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:09.296362  3558 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.297648  3508 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.329864  3508 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:09.330765  3508 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.298949  3552 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:09.279023  3670 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.291639  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:09.299831  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1137) took 1055 ms. Trace:
I20260709 12:59:09.283205  3665 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.304090  1684 rpcz_store.cc:276] 0709 12:59:08.243875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.386073 (+142198us) service_pool.cc:224] Handling call
0709 12:59:08.392255 (+  6182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:08.403990 (+ 11735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:08.404019 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:08.404582 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:59:08.630936 (+226354us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:08.630994 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:08.631087 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:09.244190 (+613103us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:09.300251 (+ 56061us) raft_consensus.cc:1685] finished
0709 12:59:09.300272 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:09.303638 (+  3366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19558,"raft.queue_time_us":9619,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8776,"spinlock_wait_cycles":64544640,"thread_start_us":160547,"threads_started":1,"wal-append.queue_time_us":432862}
I20260709 12:59:09.309187  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.313496  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.290673  3621 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:09.323696  1534 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:59:09.324496  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1135) took 1080 ms. Trace:
I20260709 12:59:09.325626  1532 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:09.326538  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.302553  3422 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:09.328843  1686 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:09.305516  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:09.363332  1686 pending_rounds.cc:85] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:59:09.363636  1686 pending_rounds.cc:107] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:09.363879  1686 raft_consensus.cc:2889] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.282141  3620 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.286547  3623 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.357161  1687 rpcz_store.cc:276] 0709 12:59:08.244142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.402475 (+158333us) service_pool.cc:224] Handling call
0709 12:59:08.402774 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:08.434232 (+ 31458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:08.434278 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:08.446858 (+ 12580us) log.cc:844] Serialized 26 byte log entry
0709 12:59:08.475874 (+ 29016us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b4800190158. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5db6bb37 00007f8d5db6b9ca 00007f8d5dc6326f 00007f8d5dc62f37 00007f8d5dc7755c 00007f8d5dc77508 00007f8d5dc77488 00007f8d5dc77443 00007f8d5dc766ec 00007f8d5cba0a96
0709 12:59:08.767358 (+291484us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:08.767405 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:08.767473 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:09.249513 (+482040us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:09.299602 (+ 50089us) raft_consensus.cc:1685] finished
0709 12:59:09.299628 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:09.299775 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11654,"raft.queue_time_us":12404,"raft.run_cpu_time_us":2554,"raft.run_wall_time_us":29723,"spinlock_wait_cycles":68138624,"thread_start_us":266750,"threads_started":1,"wal-append.queue_time_us":396950}
W20260709 12:59:09.355558  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.332934  3702 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:09.314568  3639 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.355278  1681 rpcz_store.cc:276] 0709 12:59:08.243602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.378205 (+134603us) service_pool.cc:224] Handling call
0709 12:59:08.401011 (+ 22806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:08.452961 (+ 51950us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:08.774795 (+321834us) log.cc:844] Serialized 14 byte log entry
0709 12:59:09.056799 (+282004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:09.061529 (+  4730us) log.cc:844] Serialized 26 byte log entry
0709 12:59:09.061739 (+   210us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:09.068358 (+  6619us) log.cc:844] Serialized 14 byte log entry
0709 12:59:09.104433 (+ 36075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.104509 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:09.324289 (+219780us) raft_consensus.cc:1685] finished
0709 12:59:09.324308 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:09.324438 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50293,"prepare.queue_time_us":407950,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":8642,"raft.queue_time_us":55954,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4832,"spinlock_wait_cycles":7428992,"thread_start_us":563142,"threads_started":3,"wal-append.queue_time_us":306454}
I20260709 12:59:09.327262  1685 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:59:09.360019  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 50881.8us
I20260709 12:59:09.385406  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.275516  3415 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:09.369073  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 63647.7us
I20260709 12:59:09.333268  3696 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:09.375141  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.368713  3697 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:09.356395  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64839.4us
I20260709 12:59:09.391418  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.359387  3670 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.327963  3654 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.413178  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.345288  3552 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:09.372740  3674 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:09.359879  3630 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.369442  3585 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:09.434187  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.436826  3508 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.416011  3670 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.438462  3602 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.241114  3649 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:09.466213  2306 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:09.338564  3554 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.385151  3323 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.305725  3663 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.442341  1539 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:09.439210  3552 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.445109  3415 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.385326  3573 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:09.445991  3697 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.348502  3558 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.389508  3639 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.416779  3022 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:59:09.388242  2303 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:59:09.452605  3422 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:09.373075  3650 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:09.456126  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64779.6us
I20260709 12:59:09.480139  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:09.460393  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88010.4us
I20260709 12:59:09.469286  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.386026  3298 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:09.491910  1534 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:09.464846  3585 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.511451  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.512607  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.513859  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.516180  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.479353  3630 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:09.504614  3552 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.502614  3697 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.465978  3508 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.521054  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.521414  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.386912  3702 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.523252  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.523524  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.523821  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.520470  1681 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:09.525691  1682 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:09.526919  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.477979  3554 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.478390  3323 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.498018  3422 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:09.477126  3573 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.533560  1684 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:09.537428  1687 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:09.537832  1687 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:09.541141  3654 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.513221  3415 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:59:09.501330  3298 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.571978  3706 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:09.572584  3706 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.575824  3706 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.578141  1687 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.585412  3554 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.591244  3298 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:09.562779  3615 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.006s
W20260709 12:59:09.592108  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 70787.5us
I20260709 12:59:09.552524  3422 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:09.591528  3558 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.586115  3554 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:09.599714  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:09.591650  3663 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.581633  3662 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.618145  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:09.602619  3709 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.598505  3620 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:09.615322  3712 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:59:09.601225  3716 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.603678  3554 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:09.638929  3651 consensus_meta.cc:287] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.000s
I20260709 12:59:09.622730  3663 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:09.613230  3558 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:59:09.603047  3520 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.649374  3663 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.661249  3585 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.621116  3422 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:09.620541  3697 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:09.667124  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.682104  3697 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.698513  3508 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.700592  3649 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:09.701201  3649 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.703356  3649 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.648118  3425 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.704803  1541 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:59:09.705663  3425 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:09.707386  3709 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.678980  3663 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.710119  3670 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.717617  3520 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:09.631743  3716 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.732154  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.738435  3554 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:09.738947  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:09.680846  3705 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 12:59:09.756562  3649 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.757117  3649 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.757799  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.757937  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:09.758659  2307 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:09.759141  3649 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.744879  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:09.760164  1690 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:09.761070  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:09.741595  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:09.762573  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:09.763510  3654 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.663302  3651 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.750836  3670 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.730079  3455 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.752584  3716 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:09.343910   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:09.758514  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:09.777318  2308 raft_consensus.cc:2368] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:09.761547  1690 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.749114  3662 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:09.769975  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.770871  2309 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:09.763926  3654 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.771749  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 235) took 1531 ms. Trace:
I20260709 12:59:09.791868  3654 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.791940  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:09.771095  3651 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:09.794188  3690 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.928s	user 0.000s	sys 0.004s
I20260709 12:59:09.778561  3455 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.790282  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:09.755155  3639 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.796932  1611 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:09.797995  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1342) took 1278 ms. Trace:
I20260709 12:59:09.801568  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:09.806876  1690 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:09.808446  2275 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:09.805596  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 186915us
I20260709 12:59:09.798418  1535 rpcz_store.cc:276] 0709 12:59:08.519699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.548641 (+ 28942us) service_pool.cc:224] Handling call
0709 12:59:08.549062 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:08.569885 (+ 20823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:08.569913 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:08.578907 (+  8994us) log.cc:844] Serialized 26 byte log entry
0709 12:59:08.838726 (+259819us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:08.901844 (+ 63118us) log.cc:844] Serialized 14 byte log entry
0709 12:59:09.037392 (+135548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.037462 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:09.793628 (+756166us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:09.797738 (+  4110us) raft_consensus.cc:1685] finished
0709 12:59:09.797830 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:09.797943 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83191,"prepare.queue_time_us":44839,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2854,"raft.queue_time_us":51184,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":79544,"spinlock_wait_cycles":47081344,"thread_start_us":226118,"threads_started":2,"wal-append.queue_time_us":232850}
I20260709 12:59:09.815003  2276 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:09.791937  1607 rpcz_store.cc:276] 0709 12:59:08.240691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.241032 (+   341us) service_pool.cc:224] Handling call
0709 12:59:08.274654 (+ 33622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:08.318027 (+ 43373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:08.318071 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:08.462014 (+143943us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c00005fb8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 12:59:08.462448 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:59:08.636885 (+174437us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:08.636923 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.771454 (+1134531us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b54002b5054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:09.771502 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:09.771545 (+    43us) raft_consensus.cc:1685] finished
0709 12:59:09.771558 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:09.771681 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":997,"raft.queue_time_us":465,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9529,"spinlock_wait_cycles":101635712,"thread_start_us":174007,"threads_started":1,"wal-append.queue_time_us":337567}
W20260709 12:59:09.824877  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49741.2us
I20260709 12:59:09.825165  1615 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:09.824052  1579 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:09.825419  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.828116  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:09.828685  1535 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.829283  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:09.829833  1536 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.830387  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:09.810766  3716 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.833642  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:09.820770  3508 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.838117  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:09.838649  3508 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:09.839521  1609 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:59:09.839483  3508 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:09.840418  3455 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:09.841058  3707 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.841512  3707 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:09.841892  3707 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.811975  3639 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:09.812107  3552 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:09.832024  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:09.844794  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:09.846843  1609 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:09.820148  3482 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:09.847189  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:09.825493  3666 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:09.850603  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:09.825774  3713 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:09.857789  1609 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:09.854699  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:09.865509  1616 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:09.868742  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:09.847801  3649 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:09.854395  3666 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:09.869379  1608 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:09.832947  3237 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:09.871469  1535 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:09.873291  1539 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:09.886508  1608 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:09.851289  3482 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:09.890585  1536 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:09.890483  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:09.848248  3716 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.904170  1608 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:09.852133  3552 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.870390  3520 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:59:09.870584  3713 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:09.889428  3237 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:09.993516  3729 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:59:10.010026  3716 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.011942  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.012868  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:09.949226  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.055405  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 209916us
I20260709 12:59:09.878477  3706 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.881703  3666 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.914183  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:09.884159  3649 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.443840  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:10.335839  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 503883us
I20260709 12:59:09.924731  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.452147  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:10.345973  2308 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:10.479339  1615 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
W20260709 12:59:10.479568  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 565484us
I20260709 12:59:10.480342  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:10.284317  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.000s	sys 0.013s
W20260709 12:59:10.481326  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.015s
I20260709 12:59:10.311400  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.485482  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:10.208806  1612 raft_consensus.cc:2410] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:10.499871  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:10.495669  1607 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:10.502936  1615 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.504001  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:09.907703  3482 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.509922  1504 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:10.510713  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 58680.9us
I20260709 12:59:10.513290  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:10.514128  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:10.348619  3707 consensus_meta.cc:287] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:59:10.510823  1610 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
W20260709 12:59:10.519394  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.440958  3663 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.000s
I20260709 12:59:10.151748  3461 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.912992  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:10.557922  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.294294  3425 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:10.562278  3425 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.560117  3461 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.566514  3461 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.567102  2302 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:10.532954  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.568817  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.569368  1610 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:10.571790  3661 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:10.571998  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.572376  3713 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.573333  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:09.958840  3727 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:10.529706  1615 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:10.555878  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:09.948694  3731 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.644s
I20260709 12:59:10.577394  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.534181  3663 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:10.579416  1609 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:10.556447  1536 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:10.579772  3663 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:10.318195  3718 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:10.580974  3552 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.580727  3718 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.524365  3636 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:10.256146  3422 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:10.579798  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1971) took 1785 ms. Trace:
I20260709 12:59:10.216117  3637 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.507915  3646 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:10.498375  3577 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.569564  3649 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:10.255908  3709 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:10.533706  3707 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.522598  3662 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.215487  3654 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.570900  3691 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.194522  3585 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:10.574407  3425 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:10.583683  1540 rpcz_store.cc:276] 0709 12:59:08.794403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.795678 (+  1275us) service_pool.cc:224] Handling call
0709 12:59:08.800217 (+  4539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:08.988513 (+188296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:08.988541 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:08.988578 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:08.988612 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.579609 (+1590997us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540030a054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:10.579650 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.579748 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432638208}
I20260709 12:59:10.584563  1615 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:10.691454  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1153) took 1093 ms. Trace:
I20260709 12:59:10.584712  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:10.667557  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.007s	sys 0.018s
I20260709 12:59:10.693915  1607 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:59:10.694141  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.009s	sys 0.018s
I20260709 12:59:10.692370  1681 rpcz_store.cc:276] 0709 12:59:09.598046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.762410 (+164364us) service_pool.cc:224] Handling call
0709 12:59:09.762671 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:09.763040 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.763080 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:09.763542 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:59:10.481756 (+718214us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:10.481812 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.482003 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:10.691253 (+209250us) raft_consensus.cc:1685] finished
0709 12:59:10.691272 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.691389 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10479,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2729,"thread_start_us":717793,"threads_started":1,"wal-append.queue_time_us":915365}
W20260709 12:59:10.679020  1653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.026s
W20260709 12:59:10.695420  1653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.027s
I20260709 12:59:10.692561  1610 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:10.695616  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.006s	sys 0.015s
W20260709 12:59:10.696208  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.006s	sys 0.015s
I20260709 12:59:10.720628  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.706101  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:10.696841  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.009s	sys 0.013s
W20260709 12:59:10.758987  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.011s	sys 0.014s
I20260709 12:59:10.759056  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.759644  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.678987  3697 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.577327  3237 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:10.782227  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.760673  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.691577  3718 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:10.613736  3731 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:10.651038  3653 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.731179  3646 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:10.757728  3319 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:10.782800  3617 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:10.614030  3636 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:10.789254  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 276037us
W20260709 12:59:10.696640  3508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.017s	sys 0.021s
I20260709 12:59:10.593775  3663 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.188s
I20260709 12:59:10.650563  3680 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.758369  3649 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:10.793756  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 269993us
I20260709 12:59:10.609180  3637 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.787343  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.717913  3422 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.609427  3401 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.786437  3577 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.718339  3691 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:10.803939  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 294143us
I20260709 12:59:10.862592  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.863085  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:10.863381  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.863633  3718 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.864391  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:10.864283  3718 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.864656  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.864717  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:10.865412  2305 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:10.831513  1507 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:10.785797  3697 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.835618  3422 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:10.836354  3461 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:10.851789  3654 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:10.801697  3508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.018s	sys 0.026s
I20260709 12:59:10.718113  3662 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.877028  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.877628  1538 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:10.878572  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.855473  3649 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.864972  1613 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.831080  1686 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:10.862329  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:10.866117  3573 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.886188  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.867504  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:10.887538  1682 raft_consensus.cc:2393] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:10.887717  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:10.786931  3731 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:10.717741  3709 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.874245  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:10.874580  1614 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.873685  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.872076  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.875717  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:10.876456  1611 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:10.879215  1533 raft_consensus.cc:2368] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7.
I20260709 12:59:10.873464  1507 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:10.863094  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.866402  3735 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.871676  3747 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:10.885223  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.881330  3422 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:59:10.801131  3653 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.899847  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.876906  3718 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:10.874046  3749 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:10.901212  1507 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:10.904356  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.905134  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:10.901739  1613 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:10.855458  3680 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.903249  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.903507  3663 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.903784  2305 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:10.905368  1507 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:10.909008  3237 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.851789  3666 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.869656  3401 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.904969  1540 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:10.874711  3461 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.868721  3577 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.898453  3735 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.910321  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:10.934648  1689 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:10.910665  1507 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:10.936714  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:10.911204  1533 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:10.915174  1607 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:10.913185  1540 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:10.935184  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:10.909080  3756 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:11.014139  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 77532us
I20260709 12:59:11.020495  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:11.020717  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:11.021361  1533 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.910671  1538 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:10.925769  3461 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.929535  3691 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:10.937770  3425 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:10.932664  3577 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.038231  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.934553  3709 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.049511  1507 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:10.910782  3718 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.912065  3666 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.048256  3766 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.048520  3735 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.911598  3653 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:10.884315  3636 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:10.924077  3662 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:10.930330  3637 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:10.916818  3697 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.058971  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:10.910650  3237 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.039014  3422 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:10.949218  3754 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:10.904248  3747 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.922969  3482 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:10.889469  3646 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.061168  3401 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.074551  2309 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:11.054617  3758 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.055204  3709 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.081444  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:10.909674  3749 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.071655  3718 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:11.094681  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:11.094583  1504 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:11.096612  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:11.075703  3422 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:11.100898  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:11.101532  3754 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:11.101972  1504 leader_election.cc:400] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:11.102257  1504 leader_election.cc:403] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.103272  1504 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:11.106788  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:11.108574  1582 leader_election.cc:400] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7.
I20260709 12:59:11.108830  1582 leader_election.cc:403] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.039834  3756 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.111531  3756 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.088119  2305 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.114416  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:11.103848  3766 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:11.095350  3691 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.117872  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:11.119408  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 70011.3us
I20260709 12:59:11.125264  3707 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.105574  3422 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.126525  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:11.099557  3649 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.105458  3697 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.088351  3709 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.086907  3758 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:11.131976  3683 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 2.288s	user 0.004s	sys 0.022s
I20260709 12:59:11.114284  3573 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.115842  3718 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.115260  3753 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7.
I20260709 12:59:11.137687  3707 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.138823  3482 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.140293  3237 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.142060  3754 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.128595  3756 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:11.142949  3760 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:59:11.142546  3754 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.149606  3769 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.150961  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.151593  1688 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:59:11.152004  1688 pending_rounds.cc:85] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 12:59:11.152244  1688 pending_rounds.cc:107] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:59:11.152529  1688 raft_consensus.cc:2889] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.130353  3751 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:11.116583  3761 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:59:11.154934  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1336) took 2127 ms (client timeout 1876 ms). Trace:
I20260709 12:59:11.135739  3573 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.155540  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:11.134924  3718 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:11.157754  1685 rpcz_store.cc:269] 0709 12:59:09.023879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.024080 (+   201us) service_pool.cc:224] Handling call
0709 12:59:11.150811 (+2126731us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540032dcd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:11.150946 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675611392}
I20260709 12:59:11.148453  3482 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.127220  3770 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:59:11.130525  3691 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.154336  3554 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.168489  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.157644  3661 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.153967  3649 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.143340  3028 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:59:11.156107  3751 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.184391  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:11.185184  1685 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.150163  3769 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.159957  3573 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.166625  3718 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.167172  3663 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.168723  3680 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.168990  3754 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.197422  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:11.201151  3749 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:11.201661  3759 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:59:11.202651  3767 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.169991  3482 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.186849  3751 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:11.206343  3763 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:11.208364  3482 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.191769  3697 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.229369  3756 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:11.186185  3554 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.229970  3621 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.203876  3636 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.184211  3649 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.231945  3237 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:59:11.243831  1533 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:11.203186  3767 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.252877  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.254812  1685 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:11.256009  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.256625  1685 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:11.257601  3663 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:11.262694  3764 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:11.247540  3747 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.232833  3697 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.243484  3749 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:11.262949  3663 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.490939  1533 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:11.500308  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.345201  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:11.406358  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1973) took 2214 ms. Trace:
I20260709 12:59:11.502681  1541 rpcz_store.cc:276] 0709 12:59:09.131788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.132375 (+   587us) service_pool.cc:224] Handling call
0709 12:59:09.132810 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:09.705151 (+572341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.345665 (+1640514us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001b7954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:11.345921 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315007360}
I20260709 12:59:11.260972  3696 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:11.505842  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:11.514686  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 101990us
W20260709 12:59:11.403093  1653 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.726s (SENT) [suppressed 8 similar messages]
I20260709 12:59:11.513939  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:11.425172  3765 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.271s	user 0.000s	sys 0.007s
W20260709 12:59:11.447319  3773 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:59:11.525758  1541 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:59:11.517261  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.486730  3576 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.524164  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:11.274621  3709 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.405162  3646 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:11.444546  3775 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:11.526391  1685 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:11.610814  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.610320  3775 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.611802  1685 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:11.379020  3482 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:11.523370  2305 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:59:11.615483  2305 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 4
I20260709 12:59:11.615768  2305 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:59:11.616067  2305 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:59:11.616518  2305 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:11.547274  3772 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
W20260709 12:59:11.546497  3776 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:59:11.612545  3482 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.612877  3718 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.621474  3482 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.523394  3680 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:59:11.624938  1685 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.626865  1685 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:11.546028  3774 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:11.507870  3769 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.521409  3577 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:11.531718  3576 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.522137  3716 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:11.507699  3691 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.565166  3787 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.569942  3422 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.570719  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 324) took 2511 ms. Trace:
I20260709 12:59:11.571221  3443 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.541324  3646 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.664970  3646 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.505373  3756 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.571494  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1999) took 1016 ms. Trace:
I20260709 12:59:11.570735  2301 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.575356  3649 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.541718  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:11.579496  3573 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.581147  3661 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:11.582129  3663 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.584880  3707 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:11.524621  3696 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.542121  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:11.587805  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.590065  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.691924  1681 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:59:11.590744  3751 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.576581  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1955) took 1658 ms. Trace:
I20260709 12:59:11.577508  3697 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.572088  3767 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.605157  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:11.605051  3699 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:11.609012  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.613651  3775 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.619913  3554 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.657203  3650 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.656948  3787 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:11.628648  3774 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.661840  3576 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.667564  1539 rpcz_store.cc:276] 0709 12:59:10.554791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.556807 (+  2016us) service_pool.cc:224] Handling call
0709 12:59:10.557085 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.570537 (+ 13452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.570571 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:10.570613 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:10.570645 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.571295 (+1000650us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54000c1554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:11.571338 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.571443 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29359360}
I20260709 12:59:11.655946  2306 rpcz_store.cc:276] 0709 12:59:09.059399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.059592 (+   193us) service_pool.cc:224] Handling call
0709 12:59:09.060043 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:09.468534 (+408491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.570438 (+2101904us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540027f454. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:11.570640 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930854784}
I20260709 12:59:11.678645  1535 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:11.694617  3696 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.650719  3716 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:11.714267  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:11.714895  3573 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.715448  3716 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.716401  3758 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:11.716917  3422 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.714936  1539 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:11.692965  1608 rpcz_store.cc:276] 0709 12:59:09.918490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.957544 (+ 39054us) service_pool.cc:224] Handling call
0709 12:59:10.057016 (+ 99472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.576306 (+519290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.576334 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:10.576370 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:10.576398 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.576275 (+999877us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54002887d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:11.576341 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.576495 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193894656}
I20260709 12:59:11.680730  3661 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.696970  1686 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:11.680449  3707 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:11.671092  3718 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.709331  3650 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:11.724022  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 320974us
I20260709 12:59:11.713532  3751 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.725907  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:11.726518  1538 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
W20260709 12:59:11.732533  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 133255us
I20260709 12:59:11.732601  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:11.733529  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:11.734740  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.736670  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.740108  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.737485  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:11.725332  3323 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.746927  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.750499  1689 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:11.744170  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:11.747874  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:11.749152  3645 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.751788  3718 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.752115  3787 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:11.744244  3751 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:11.752197  2306 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:59:11.822933  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 78840.1us
I20260709 12:59:11.823191  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.824872  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.765492  1653 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:11.829165  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 63749.4us
I20260709 12:59:11.826311  3795 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.826184  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:11.830433  1616 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:11.749351  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:11.831312  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.832705  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.754755  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:11.850167  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.851082  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.851343  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.819936  3649 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:59:11.890264  1653 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:11.888785  1608 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:11.892506  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.887316  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.893652  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1344) took 1191 ms. Trace:
W20260709 12:59:11.894632  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 139974us
I20260709 12:59:11.895162  1685 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:11.892835  1687 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.826833  3774 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:11.893994  1682 rpcz_store.cc:276] 0709 12:59:10.703480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.703625 (+   145us) service_pool.cc:224] Handling call
0709 12:59:11.893483 (+1189858us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400363654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:11.893597 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242231552}
I20260709 12:59:11.905153  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.830036  3645 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.852974  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.901997  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:11.892765  1609 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:11.902729  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:11.903775  1532 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.755788  3718 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.838084  3756 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.911724  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.913636  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:11.879496  3577 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:11.755884  3651 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 12:59:11.915002  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.898309  3680 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:11.918350  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:11.920109  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.906397  3699 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.827930  3323 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:59:11.925362  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.923313  1612 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:11.821157  3707 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:11.901814  3787 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.912824  3718 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.933214  3787 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.933621  3787 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.895401  3621 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:11.936915  3621 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:11.937111  3707 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.937263  3621 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:11.938159  3621 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.932672  3665 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.939800  3665 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.940250  3665 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.932077  1687 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 12:59:11.932392  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.886665  3796 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:11.918141  3774 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:11.947569  1687 pending_rounds.cc:85] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 1
I20260709 12:59:11.948189  1687 pending_rounds.cc:107] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:59:11.916324  3756 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.949150  1687 raft_consensus.cc:2889] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.954747  3774 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:11.975833  3774 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:11.977015  3401 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.977563  3401 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:11.978688  3525 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:59:11.984579  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.985405  1612 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:11.987557  3617 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:11.988091  3617 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:11.898042  3691 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:11.887809  3795 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.907526  3696 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:59:11.922487  3789 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:11.991602  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.998600  1608 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:11.998692  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.993577  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1143) took 2459 ms. Trace:
I20260709 12:59:11.995244  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:11.926031  3699 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.000944  1614 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:12.000001  1687 rpcz_store.cc:276] 0709 12:59:09.510411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.510522 (+   111us) service_pool.cc:224] Handling call
0709 12:59:09.510817 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.892444 (+2381627us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b58001d42d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58ba70aa 00007f8d58c29447 00007f8d58c41fe7 00007f8d58c437de 00007f8d58c4db49 00007f8d58c4e416 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4
0709 12:59:11.969128 (+ 76684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.969383 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454845184}
I20260709 12:59:11.947768  3651 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:11.991578  3756 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.011220  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:12.014346  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:12.012606  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:11.998410  3789 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:12.024238  3789 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:12.024499  3482 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:12.025031  3482 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:12.025833  3482 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:11.995047  3621 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.028546  3422 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:12.029080  3422 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.031280  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:12.003160  3699 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.063580  3617 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.066344  3617 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:12.067413  3650 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.076737  1690 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:12.009577  3651 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:12.107244  1539 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:12.076009  1532 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
W20260709 12:59:12.785633  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.822458  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1384) took 1103 ms. Trace:
I20260709 12:59:12.689415  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 209) took 1749 ms. Trace:
I20260709 12:59:12.337805  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:12.824460  1535 rpcz_store.cc:276] 0709 12:59:10.939990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.040960 (+100970us) service_pool.cc:224] Handling call
0709 12:59:11.041261 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.710474 (+669213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.689197 (+978723us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54002c6d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:12.689358 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465499008}
W20260709 12:59:12.685537  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.825099  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1383) took 1111 ms. Trace:
I20260709 12:59:12.532366  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 213) took 1438 ms. Trace:
I20260709 12:59:12.726315  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:12.822954  1532 rpcz_store.cc:276] 0709 12:59:11.719428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.723597 (+  4169us) service_pool.cc:224] Handling call
0709 12:59:12.822371 (+1098774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:12.706521  1686 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:12.710554  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:12.826474  1539 rpcz_store.cc:276] 0709 12:59:11.713878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.714028 (+   150us) service_pool.cc:224] Handling call
0709 12:59:12.825040 (+1111012us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:12.436975  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 422712us
I20260709 12:59:12.635747  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:12.830719  1614 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:12.827839  2307 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:12.031985  3702 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:12.729719  2306 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:12.354549  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:12.690582  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1140) took 3561 ms. Trace:
I20260709 12:59:12.635200  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:12.660954  1610 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 4. Ops: []
I20260709 12:59:12.757483  1690 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:12.266069  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:12.698961  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:12.032123  3792 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:12.645905  3756 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.004s
I20260709 12:59:12.826946  1540 rpcz_store.cc:276] 0709 12:59:11.094267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.094383 (+   116us) service_pool.cc:224] Handling call
0709 12:59:11.104708 (+ 10325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.133940 (+ 29232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.133976 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:11.134023 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:11.134053 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.532016 (+1397963us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b5400073854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:12.532079 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.532253 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66757504}
I20260709 12:59:12.729692  2275 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:12.841714  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:12.814638  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.891619  1608 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:12.128551  3795 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:12.893092  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:12.513193  3771 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:12.892411  1688 rpcz_store.cc:276] 0709 12:59:09.128803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.129574 (+   771us) service_pool.cc:224] Handling call
0709 12:59:11.151283 (+2021709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.153025 (+  1742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.690346 (+1537321us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b540032dcd0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:12.690509 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4626066816}
I20260709 12:59:12.894228  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:12.892457  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 162870us
I20260709 12:59:12.892191  1685 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:12.076469  3576 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:12.436929  3696 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:12.515698  3716 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:12.893862  1687 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:12.126250  3800 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:12.531615  3764 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.380s
W20260709 12:59:12.912698  3665 consensus_meta.cc:287] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.967s	user 0.009s	sys 0.001s
I20260709 12:59:12.238109  3422 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:12.905799  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:12.908411  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:12.902186  3771 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:12.234026  3699 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.114962  3650 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:12.667093  3425 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:12.082156  3767 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:12.208736  3797 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.910147  1608 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:12.355917  3645 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.912083  1653 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:12.967868  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 55898.9us
I20260709 12:59:12.111846  3787 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.842586  3678 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:12.904732  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:12.906229  3482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.015s	sys 0.043s
I20260709 12:59:12.892781  1436 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 4, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.131865  3661 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.115959  3774 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:12.915217  3719 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.591s	user 0.000s	sys 0.001s
I20260709 12:59:12.930857  1690 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:12.976130  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:12.115329  3806 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:12.900839  3795 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:12.113615  3718 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.531361  3401 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:12.106510  3789 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.913571  3716 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:12.914161  3576 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.948951  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:12.950479  1613 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:59:12.984582  1613 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 4
I20260709 12:59:12.984700  1534 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:12.984889  1613 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:59:12.985226  1613 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:59:12.985711  1613 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:12.238569  3651 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.951516  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:12.952412  1611 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:12.989660  1616 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:12.951577  1615 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:12.956522  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:12.991062  1538 raft_consensus.cc:1240] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:12.991794  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:12.972105  3645 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.896670  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:12.952431  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1983) took 1034 ms. Trace:
I20260709 12:59:12.081416  3577 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.905731  3792 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.901827  3756 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:12.971719  3482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.015s	sys 0.044s
I20260709 12:59:12.934878  3422 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:12.962201  3425 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:12.931139  3665 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.925499  3696 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.970026  3805 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:12.964604  3767 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.998178  3401 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:12.960387  1610 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:13.027505  1689 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:12.974082  3678 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 12:59:12.995208  1612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.021s	sys 0.092s
W20260709 12:59:13.030695  1612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.021s	sys 0.092s
I20260709 12:59:12.984017  3795 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:12.993592  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:12.977329  3650 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:13.031824  3650 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:13.032254  3650 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.032536  3699 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.032876  3795 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:13.033207  3319 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.016765  3422 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.033761  3319 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.002817  3764 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:13.035696  3422 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:12.997071  1609 rpcz_store.cc:276] 0709 12:59:11.918405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.918925 (+   520us) service_pool.cc:224] Handling call
0709 12:59:11.919133 (+   208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.919409 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.919434 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.922602 (+  3168us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.171045 (+248443us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:12.269529 (+ 98484us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.297417 (+ 27888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.297532 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.952164 (+654632us) raft_consensus.cc:1685] finished
0709 12:59:12.952192 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.952375 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27536,"prepare.queue_time_us":98519,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":28063,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13422,"thread_start_us":218794,"threads_started":1,"wal-append.queue_time_us":1015764}
I20260709 12:59:13.036159  3764 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.038730  3792 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.038894  3764 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:13.039763  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46278.4us
I20260709 12:59:13.041445  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:13.045488  3528 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:13.045814  3621 consensus_meta.cc:287] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.017s	user 0.004s	sys 0.005s
I20260709 12:59:13.045974  3528 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.046505  3621 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.046556  3528 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.051648  3774 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.053149  3661 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.053747  3767 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.055297  3756 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.056205  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:13.015841  3771 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:12.995005  3749 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:12.996112  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:12.972327  3797 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.058678  3749 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:13.059350  3749 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.029091  3716 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.059813  3749 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:13.059871  3797 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.060318  3716 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.001428  3630 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:13.053826  1541 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:12.994720  3718 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.062520  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 1981) took 3667 ms. Trace:
I20260709 12:59:13.058713  3665 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.068486  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:13.057335  3771 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.065323  1656 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:13.056046  3731 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.009066  3706 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.043990  3650 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.062983  1537 rpcz_store.cc:276] 0709 12:59:09.394863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.503283 (+108420us) service_pool.cc:224] Handling call
0709 12:59:09.515294 (+ 12011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:09.540208 (+ 24914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.540258 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:09.544188 (+  3930us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.153485 (+1609297us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800329440. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1
0709 12:59:11.153622 (+   137us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:11.153656 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.153718 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.236881 (+1083163us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b1800329440. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:13.062318 (+825437us) raft_consensus.cc:1685] finished
0709 12:59:13.062337 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.062468 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145,"raft.queue_time_us":19139,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7683,"spinlock_wait_cycles":13542144,"thread_start_us":42548,"threads_started":2,"wal-append.queue_time_us":31367}
I20260709 12:59:13.075616  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:13.078414  2308 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.078477  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:13.083019  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:13.087210  1541 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:13.084486  3706 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.098735  3706 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.030648  3401 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:13.104261  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 439739us
I20260709 12:59:13.085917  3658 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:13.101881  3401 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.116463  3661 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.117333  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:13.084951  3756 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:13.105429  3718 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.114799  3745 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:13.140659  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.144635  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.141077  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.142553  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.149645  1539 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 12:59:13.143322  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.144332  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.109925  3767 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:13.150655  1532 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:13.113946  3658 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:13.156927  3756 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:13.137408  3731 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.136919  3680 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:13.138047  3691 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:13.117811  3639 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:59:13.157883  3745 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:13.165478  3658 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:13.180989  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.180208  2308 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:13.137552  3653 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:13.142428  3576 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.139389  3780 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:13.164196  3789 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.171955  3787 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.233649  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.141271  3699 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:59:13.170069  3756 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:13.137293  3661 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.179867  3767 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.203122  3745 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.199319  3774 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:59:13.234360  3792 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:59:13.258481  1537 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:13.258966  3696 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.259469  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.182140  3691 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.260424  3691 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.260579  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.261662  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.262322  1540 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:13.263020  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.263538  1540 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:13.266505  3661 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.268780  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.269953  1540 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:13.272630  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.274108  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.274919  1537 raft_consensus.cc:2410] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:13.276006  1535 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:13.240175  3621 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:13.274294  1532 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:13.282752  3650 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.285211  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.285919  1539 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:13.286948  3756 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.288149  3756 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.290061  3528 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.157624  3718 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.295692  3718 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.296561  1436 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 4, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:13.297693  3749 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.298338  1436 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 5, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:13.300158  3749 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:13.198088  3680 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.300801  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:13.301563  2303 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:13.302310  3680 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:13.197621  3637 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 12:59:13.304850  3637 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:13.294929  3645 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.305177  3637 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:13.306069  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1388) took 1309 ms. Trace:
I20260709 12:59:13.306435  1534 rpcz_store.cc:276] 0709 12:59:11.996632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.996770 (+   138us) service_pool.cc:224] Handling call
0709 12:59:11.997041 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.985110 (+988069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.305851 (+320741us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54001b6f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:13.306014 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2271231232}
I20260709 12:59:13.306208  3637 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.307933  3637 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.310019  3678 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:13.292078  3528 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:13.313674  3528 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.314103  3528 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.314430  3651 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:13.314604  3645 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:13.316449  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.318538  3319 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.319213  3767 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.319981  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:13.320148  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1181) took 1186 ms. Trace:
I20260709 12:59:13.320544  1689 rpcz_store.cc:276] 0709 12:59:12.133317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.133518 (+   201us) service_pool.cc:224] Handling call
0709 12:59:12.636348 (+502830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.031430 (+395082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.319901 (+288471us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54002a58d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:13.320069 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899054848}
I20260709 12:59:13.321213  2305 raft_consensus.cc:2368] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
W20260709 12:59:13.322188  3804 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.340s	user 0.003s	sys 0.000s
I20260709 12:59:13.324797  1579 leader_election.cc:400] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
I20260709 12:59:13.325121  1579 leader_election.cc:403] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:13.326334  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:13.311915  3621 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.327764  3621 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.327610  3401 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.329538  3319 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.357982  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:13.358582  1535 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.332819  1681 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
W20260709 12:59:13.361164  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1170) took 1629 ms (client timeout 2007 ms). Trace:
I20260709 12:59:13.361308  1538 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:13.361526  1681 rpcz_store.cc:269] 0709 12:59:11.732263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.732369 (+   106us) service_pool.cc:224] Handling call
0709 12:59:13.361023 (+1628654us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400393354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:13.361116 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3656901376}
I20260709 12:59:13.362421  3649 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.363178  1538 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:13.362891  3649 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.364112  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:13.366248  3649 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.367069  1534 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 2. Current term is 4. Ops: []
I20260709 12:59:13.371061  3319 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
W20260709 12:59:13.337133  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 242) took 12688 ms (client timeout 15000 ms). Trace:
W20260709 12:59:13.372076  1437 rpcz_store.cc:269] 0709 12:59:00.648759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.649064 (+   305us) service_pool.cc:224] Handling call
0709 12:59:00.723222 (+ 74158us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb5090 00007f8d58c53f3a 00007f8d5ea0a1cc 00007f8d5eb0837e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc 00007f8d5cfc8392 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:13.337048 (+12613826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:07.862012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:07.873411 (+ 11399us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:07.873462 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:59:07.873481 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:08.045289 (+171808us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:08.045377 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:08.045405 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:59:08.046594 (+  1189us) tablet.cc:701] Row locks acquired
0709 12:59:08.046644 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:59:08.046804 (+   160us) write_op.cc:270] Start()
0709 12:59:08.046957 (+   153us) write_op.cc:276] Timestamp: P: 1783601948046745 usec, L: 0
0709 12:59:08.047006 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:59:08.047645 (+   639us) log.cc:844] Serialized 5629 byte log entry
0709 12:59:08.432924 (+385279us) op_driver.cc:464] REPLICATION: finished
0709 12:59:08.783044 (+350120us) write_op.cc:301] APPLY: starting
0709 12:59:08.805366 (+ 22322us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:08.886428 (+ 81062us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:08.907698 (+ 21270us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:09.298692 (+390994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:09.299038 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:59:09.299084 (+    46us) write_op.cc:312] APPLY: finished
0709 12:59:09.299450 (+   366us) log.cc:844] Serialized 101 byte log entry
0709 12:59:09.305815 (+  6365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.328334 (+ 22519us) write_op.cc:454] Released schema lock
0709 12:59:09.328399 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:09.328824 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.328857 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3216,"reported_tablets":31,"spinlock_wait_cycles":15759360,"child_traces":[["op",{"apply.queue_time_us":319757,"apply.run_cpu_time_us":6790,"apply.run_wall_time_us":557278,"num_ops":14,"prepare.queue_time_us":237512,"prepare.run_cpu_time_us":19216,"prepare.run_wall_time_us":395370,"raft.queue_time_us":231838,"raft.run_cpu_time_us":14110,"raft.run_wall_time_us":119309,"replication_time_us":385757,"thread_start_us":642980,"threads_started":4,"wal-append.queue_time_us":148490,"wal-append.run_cpu_time_us":35327,"wal-append.run_wall_time_us":2122125}]]}
I20260709 12:59:13.340540  3425 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:13.238808  1581 connection.cc:256] RPC call timeout handler was delayed by -1.6220783680000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:59:13.377568  3425 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.316062  3528 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.299866  1436 catalog_manager.cc:5697] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 4, term changed from 1 to 3, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:13.378974  3706 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:13.379493  3706 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.380055  1436 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 4, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 12:59:13.381426  3706 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.382184  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:13.382616  1436 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 4, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.383257  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:13.384163  1436 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:13.386276  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:13.387043  2308 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:13.387189  3401 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:13.355144  3745 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.390641  3716 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.391073  3745 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:13.394598  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.002s
W20260709 12:59:13.394629  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.015s	sys 0.043s
W20260709 12:59:13.395009  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.002s
W20260709 12:59:13.395184  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.015s	sys 0.043s
I20260709 12:59:13.396037  3707 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.396531  3707 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.398595  3707 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:13.399227  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:13.399526  3707 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.400096  3707 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:13.401484  3829 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.402103  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1987) took 1408 ms. Trace:
I20260709 12:59:13.401999  3829 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.402505  3707 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:13.403156  3707 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.402477  1612 rpcz_store.cc:276] 0709 12:59:11.993827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.993953 (+   126us) service_pool.cc:224] Handling call
0709 12:59:12.008654 (+ 14701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.013330 (+  4676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.013374 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.019500 (+  6126us) log.cc:844] Serialized 26 byte log entry
0709 12:59:13.031098 (+1011598us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:13.401012 (+369914us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.401811 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.401880 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.401916 (+    36us) raft_consensus.cc:1685] finished
0709 12:59:13.401931 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.402050 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":365999,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":1115,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7319,"thread_start_us":1274759,"threads_started":2,"wal-append.queue_time_us":1098935}
I20260709 12:59:13.405031  1609 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:13.406454  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 239389us
W20260709 12:59:13.407052  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 271563us
I20260709 12:59:13.411698  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:13.412418  3822 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:13.412976  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:13.413483  3822 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:13.413728  3422 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:13.413923  3822 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:13.413664  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 235993us
I20260709 12:59:13.414311  3422 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:13.414927  3822 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:13.415589  3835 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:13.415601  3422 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:13.419041  2276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.004s
W20260709 12:59:13.419402  2276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.004s	sys 0.004s
W20260709 12:59:13.419955  2275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.005s
W20260709 12:59:13.420295  2275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.001s	sys 0.005s
I20260709 12:59:13.420405  1653 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:13.421782  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.005s	sys 0.001s
W20260709 12:59:13.422173  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.006s	sys 0.001s
W20260709 12:59:13.424420  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.287s	user 0.000s	sys 0.007s
W20260709 12:59:13.424790  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.000s	sys 0.007s
I20260709 12:59:13.425170  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:13.416203  3822 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.418673  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:13.426182  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:13.426697  1607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.006s
I20260709 12:59:13.427929  1537 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:13.428725  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1156) took 3808 ms. Trace:
W20260709 12:59:13.419698  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 588493us
W20260709 12:59:13.420637  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 514491us
I20260709 12:59:13.431110  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:13.432097  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:13.435266  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:13.436705  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:13.437261  1609 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:13.279673  3658 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.403805  3707 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:13.442170  1541 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:14.049209  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.041s	sys 0.024s
W20260709 12:59:14.049600  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.041s	sys 0.024s
W20260709 12:59:13.740705  1536 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.010s
W20260709 12:59:14.050241  1607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.020s	sys 0.034s
W20260709 12:59:14.050366  1536 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.018s	sys 0.013s
I20260709 12:59:14.051589  3755 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:14.052824  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 617647us
I20260709 12:59:14.053664  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.054553  3658 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:14.054953  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:13.634428  3691 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.056665  2308 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
W20260709 12:59:14.056799  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.049885  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 638268us
I20260709 12:59:14.057686  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:13.465397  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:14.058526  1535 consensus_meta.cc:287] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.029s
I20260709 12:59:14.058661  1614 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:14.058892  1535 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
W20260709 12:59:13.573621  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.465096  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:13.596738  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.060863  1613 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:13.465921  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:13.626071  2307 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:59:13.635572  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 220486us
I20260709 12:59:14.064312  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:13.610914  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.065636  1539 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:14.066039  1610 raft_consensus.cc:2410] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:14.064155  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.051563  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1367) took 3183 ms. Trace:
W20260709 12:59:13.622977  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 168637us
I20260709 12:59:13.464406  1534 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:14.059948  1615 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:14.075251  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.083997  1538 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:14.074308  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.088706  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.089751  1541 raft_consensus.cc:2393] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:14.062788  1683 rpcz_store.cc:276] 0709 12:59:09.620206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.847632 (+227426us) service_pool.cc:224] Handling call
0709 12:59:09.847883 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:09.848063 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:12.137440 (+2289377us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800410380. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d5c6433c7 00007f8d58c559a7 00007f8d58c650bf
0709 12:59:12.137593 (+   153us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.428444 (+1290851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.428488 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:13.428527 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.428588 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.428678 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12741,"prepare.queue_time_us":41187,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3194,"raft.queue_time_us":651,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":146529,"spinlock_wait_cycles":4268800,"thread_start_us":1360623,"threads_started":2,"wal-append.queue_time_us":1333056}
I20260709 12:59:13.682883  3756 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:59:13.404042  3829 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:14.093462  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 317) took 1074 ms. Trace:
I20260709 12:59:14.101161  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:14.080384  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:14.076922  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.077229  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.074632  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.110756  1613 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
W20260709 12:59:14.093479  1436 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.013s	sys 0.020s
W20260709 12:59:14.111361  1436 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.014s	sys 0.020s
I20260709 12:59:14.097141  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:14.098191  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:14.111721  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:13.426934  3558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.010s
I20260709 12:59:14.100162  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:14.106541  2307 rpcz_store.cc:276] 0709 12:59:13.001366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.001689 (+   323us) service_pool.cc:224] Handling call
0709 12:59:13.008439 (+  6750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.063527 (+1055088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.075054 (+ 11527us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54002e5254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:14.075226 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419666688}
I20260709 12:59:14.112295  1613 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:14.103001  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:14.023052  3650 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:13.467744  3818 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.104043  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:14.066097  3832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.036s
I20260709 12:59:14.104840  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:14.110762  1616 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.081262  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:14.096626  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.112206  1681 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:14.092489  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:14.113566  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.082398  3422 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:13.469630  3836 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:13.428649  3770 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:13.674139  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:14.120301  3829 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.691202  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:14.116366  1538 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:13.668215  3817 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:13.640514  3319 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.150168  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.144522  1653 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:14.122529  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.145705  1533 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:14.146908  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.076722  1536 rpcz_store.cc:276] 0709 12:59:10.868104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.893903 (+ 25799us) service_pool.cc:224] Handling call
0709 12:59:10.894248 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.894486 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:10.905356 (+ 10870us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.686024 (+1780668us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18000f6ee0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a 00007f8d58c55a2a
0709 12:59:14.050793 (+1364769us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.051214 (+   421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.051264 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:14.051307 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.051399 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.051510 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10711,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":159,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":8528,"spinlock_wait_cycles":5738880,"thread_start_us":1345863,"threads_started":2,"wal-append.queue_time_us":2375380}
I20260709 12:59:14.105165  3401 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.099335  3699 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.156572  1609 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 1.
I20260709 12:59:14.149118  1537 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:13.723783  3621 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.122805  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.081951  2305 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:14.161779  1532 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:13.469487  3816 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:14.163942  1614 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
W20260709 12:59:14.143869  3832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.007s	sys 0.037s
I20260709 12:59:14.176755  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.176767  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.177399  1610 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.177942  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:14.118547  3756 raft_consensus.cc:1068] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Unable to promote non-voter c445b7b7d94f48f99a3599ddfc92f462: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:14.115423  3650 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:14.173956  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.153183  3319 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.194749  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.195221   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:14.117697  3706 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:14.151314  3691 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:14.199083  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 144274us
I20260709 12:59:14.164846  3702 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:14.154282  3837 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:14.199896  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.168206  3573 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:14.204886  1615 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:14.210743  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 148619us
I20260709 12:59:14.211828  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.206739  1581 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.166900  3651 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:14.213836  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.177969  3829 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:14.178784  3816 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:14.225324  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.215799  3837 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.218042  1610 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:14.166051  3422 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.206485  3702 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:14.232726  1615 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:14.174394  3699 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.220026  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:14.152954  3817 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.169989  3401 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.231374  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.238899  1613 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:14.218976  3651 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:14.227901  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 170299us
I20260709 12:59:14.241858  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:14.242856  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:14.224689  3828 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:14.169775  3836 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:14.233623  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.168798  3770 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.233490  3702 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.235334  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.228498  3816 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.244695  1609 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:14.237155  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.229738  3829 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:14.247232  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.248076  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.248747  3846 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:14.242264  3651 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.255705  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.256943  1614 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.242033  3706 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.260179  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.262115  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.265050  1535 raft_consensus.cc:2410] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:14.255391  3707 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:14.268070  1614 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 2.
I20260709 12:59:14.269745  3319 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:14.271754  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 1995) took 1612 ms. Trace:
I20260709 12:59:14.272112  1607 rpcz_store.cc:276] 0709 12:59:12.659724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.661950 (+  2226us) service_pool.cc:224] Handling call
0709 12:59:12.662472 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.050614 (+1388142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.050644 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.051090 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.165469 (+114379us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:14.165518 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.165608 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.271565 (+105957us) raft_consensus.cc:1685] finished
0709 12:59:14.271588 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.271702 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":227619,"raft.queue_time_us":279162,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":1274068,"threads_started":2,"wal-append.queue_time_us":180195}
I20260709 12:59:14.273819  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.274931  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.275738  3837 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:14.275921  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.258802  3849 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:14.238188  3650 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.296123  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.297451  1613 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:14.311282  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2019) took 1060 ms. Trace:
I20260709 12:59:14.311718  1540 rpcz_store.cc:276] 0709 12:59:13.251124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.271978 (+ 20854us) service_pool.cc:224] Handling call
0709 12:59:13.272211 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.432585 (+160374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.432627 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.117379 (+684752us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.240251 (+122872us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:14.240291 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.240363 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.311054 (+ 70691us) raft_consensus.cc:1685] finished
0709 12:59:14.311074 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.311224 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":18250,"thread_start_us":75484,"threads_started":1,"wal-append.queue_time_us":138356}
I20260709 12:59:14.276827  1607 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:14.277617  1616 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:14.280308  3770 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:14.335273  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.268612  3822 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:14.341456  3840 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:14.356731  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.312446  3849 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:14.344367  3650 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.365118  1616 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:14.367089  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:14.372577  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.372943  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.374567  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:14.373214  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 279231us
W20260709 12:59:14.377038  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 203807us
I20260709 12:59:14.378587  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:14.388188  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.372112  3706 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:14.355536  3822 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.402635  1653 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:14.383507  3716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.008s	sys 0.007s
I20260709 12:59:14.410602  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.411578  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:14.414352  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.416162  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:14.395849  3838 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:59:14.418988  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.423966  1541 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:14.420903  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.341552  3836 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.420950  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.426779  1613 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:14.355316  3829 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.434707  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:14.435732  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:14.431063  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.431612  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:14.436615  2307 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
W20260709 12:59:14.436780  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 55904.9us
I20260709 12:59:14.437935  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:14.439337  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:14.407142  3716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.008s	sys 0.007s
I20260709 12:59:14.394907  3817 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:14.430418  2276 connection.cc:256] RPC call timeout handler was delayed by -2.2806785409999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 12:59:14.449008  2276 connection.cc:256] RPC call timeout handler was delayed by -1.9998785409999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:59:14.449424  2276 connection.cc:256] RPC call timeout handler was delayed by -1.719978540999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:59:14.450083  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.434124  1534 raft_consensus.cc:2393] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:14.398674  3846 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:14.445844  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:14.451756  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 208083us
I20260709 12:59:14.452723  1610 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.453394  3707 consensus_queue.cc:1059] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:14.454838  3707 raft_consensus.cc:3055] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:14.455248  3707 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:14.456192  3707 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.457681  3707 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.451835  3846 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:14.490525  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.536021  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:14.407392  3401 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:14.423723  3770 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:14.538172  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 280140us
I20260709 12:59:14.530382  1610 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:14.431589  3699 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:14.545114  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 107220us
I20260709 12:59:14.428917  3837 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:14.569716  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.571743  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 134080us
I20260709 12:59:14.432140  3422 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:14.581275  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 131297us
W20260709 12:59:14.583971  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.596665  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 129286us
I20260709 12:59:14.539774  3770 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.543669  3835 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:14.544265  3853 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.597673  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:14.602506  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.599471  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 160197us
I20260709 12:59:14.618876  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:14.596956  3401 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:14.594292  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:14.596791  3422 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.598734  3832 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.604111  3770 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.596695  3658 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:14.663252  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.583370  3860 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.539846  3817 consensus_queue.cc:1059] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:59:14.594980  3837 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.620273  3818 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:14.646739  3401 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.677551  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:14.678617  3883 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.678735  3658 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:14.679239  3658 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:14.679188  3883 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.680476  3818 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.681188  3818 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.681489  3883 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:14.682180  3818 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.683138  3818 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:14.679291  3864 log.cc:927] Time spent T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:59:14.679883  3862 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:14.687527  3837 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:14.688274  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1297) took 1256 ms. Trace:
I20260709 12:59:14.671103  3856 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:14.663246  3422 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.684794  3846 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:14.688658  1611 rpcz_store.cc:276] 0709 12:59:13.432071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.436036 (+  3965us) service_pool.cc:224] Handling call
0709 12:59:14.056803 (+620767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.216098 (+159295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.216133 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.216598 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.352826 (+136228us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:14.352910 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.353003 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.688006 (+335003us) raft_consensus.cc:1685] finished
0709 12:59:14.688024 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.688195 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110924,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":28196,"thread_start_us":294785,"threads_started":2,"wal-append.queue_time_us":201248}
W20260709 12:59:14.743167  3857 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:59:14.679859  3658 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.544931  3849 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:14.762645  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 396056us
I20260709 12:59:14.709954  3401 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:14.675882  3859 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:14.620507  3853 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:14.776711  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 136354us
I20260709 12:59:14.758787  3846 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:14.768541  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 226718us
W20260709 12:59:14.771976  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 350232us
I20260709 12:59:14.663537  3832 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.792295  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:14.793148  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 115689us
I20260709 12:59:14.788347  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1306) took 1193 ms. Trace:
I20260709 12:59:14.790841  1581 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.794386  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:14.794220  1611 rpcz_store.cc:276] 0709 12:59:13.595292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.772772 (+1177480us) service_pool.cc:224] Handling call
0709 12:59:14.787859 (+ 15087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.788022 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.788048 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.788083 (+    35us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:14.788116 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.788178 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.788294 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:14.797389  1681 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:14.785804  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 203600us
I20260709 12:59:14.805007  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.776998  3870 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:14.811723  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.814281  1533 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:14.807011  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.815857  1534 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:14.808478  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.816707  1540 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:14.817329  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:14.810563  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.811566  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.818238  1538 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:14.801434  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:14.812924  3716 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:14.752233  3856 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.818295  1539 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:14.812161  3870 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:14.790457  3822 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:14.825604  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:14.828034  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:14.828866  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 53733.4us
I20260709 12:59:14.830945  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.824977  3854 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.815712  3835 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:14.842875  3869 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:59:14.839613  3860 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.844375  3894 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:14.845227  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1300) took 1407 ms. Trace:
I20260709 12:59:14.808414  3868 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.838480  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1308) took 1069 ms. Trace:
I20260709 12:59:14.845656  1616 rpcz_store.cc:276] 0709 12:59:13.438202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.343803 (+905601us) service_pool.cc:224] Handling call
0709 12:59:14.344128 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.365651 (+ 21523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.844963 (+479312us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5400178ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:14.845169 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47571840}
I20260709 12:59:14.824544  3716 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:14.852672  1611 rpcz_store.cc:276] 0709 12:59:13.768935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.821187 (+1052252us) service_pool.cc:224] Handling call
0709 12:59:14.837873 (+ 16686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.838079 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.838115 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.838178 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:14.838230 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.838298 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.838417 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:14.855641  1616 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:14.830893  3874 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.862457  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:14.866678  1611 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:14.832517  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.869216  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:14.873095  1688 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:14.873301  3770 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:14.875412  3770 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:14.876763  3835 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.877009  3877 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.878298  3835 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:14.878789  3835 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:14.837951  3699 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:59:14.879583  3835 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.845747  3889 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:14.856295  3716 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.833393  3819 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:59:14.881942  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49503.9us
I20260709 12:59:14.915858  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.855154  3882 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.920729  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:14.921321  2308 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.889412  1614 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:59:14.893952  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:14.906303  3852 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:59:14.907316  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:14.921808  1614 pending_rounds.cc:85] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 4
I20260709 12:59:14.925894  1614 pending_rounds.cc:107] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:59:14.926267  1614 raft_consensus.cc:2889] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:14.893020  3651 consensus_meta.cc:287] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.003s
I20260709 12:59:14.863525  3893 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:14.840049  3846 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.961282  3855 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:14.962659  3816 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.001s
I20260709 12:59:14.885288  3319 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:59:14.924883  3868 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:14.887042  3820 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:14.965445  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49684.1us
W20260709 12:59:14.958580  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 76776.6us
W20260709 12:59:14.972811  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 47055.5us
W20260709 12:59:14.994128  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.863961  3873 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:59:14.912949  3870 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:14.880752  3872 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 12:59:14.925053  3882 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:15.001963  3816 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:14.998004  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 135614us
I20260709 12:59:14.963817  3874 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:15.002426  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:15.027216  1608 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:15.028550  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:14.854398  3854 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:15.003643  1504 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.531s (SENT)
I20260709 12:59:15.006260  3819 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:15.004971  3422 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:15.017978  3707 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
I20260709 12:59:15.009186  3832 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:15.011695  3853 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:15.081983  3756 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.007709  3856 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:15.081429  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52928.2us
W20260709 12:59:15.002988  3702 consensus_meta.cc:287] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.002s
I20260709 12:59:15.027565  3863 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.024181  3883 raft_consensus.cc:3055] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:15.064327  2308 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:15.001963  3868 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:15.022393  3650 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.000s
I20260709 12:59:15.047798  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2008) took 1589 ms. Trace:
I20260709 12:59:15.045939  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:14.996505  3651 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:15.564457  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.023s	sys 0.022s
W20260709 12:59:15.708267  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.023s	sys 0.035s
I20260709 12:59:15.175491  3836 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:15.608067  3818 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.925s	user 0.012s	sys 0.000s
I20260709 12:59:15.709874  3836 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:15.710714  3818 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.712401  3882 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:15.190644  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1302) took 1751 ms. Trace:
I20260709 12:59:15.713368  3702 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.719540  3868 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.714145  3883 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:15.720554  3883 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:15.178781  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2031) took 1117 ms. Trace:
I20260709 12:59:15.713560  1607 rpcz_store.cc:276] 0709 12:59:13.438780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.343525 (+904745us) service_pool.cc:224] Handling call
0709 12:59:14.343898 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.344143 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:14.789660 (+445517us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.190110 (+400450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:15.190183 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:15.190330 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.190420 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.190579 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":432371,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":101,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":827443,"threads_started":2,"wal-append.queue_time_us":918245}
I20260709 12:59:15.715204  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.726200  1683 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:15.575570  3716 consensus_meta.cc:287] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.003s
I20260709 12:59:15.726774  3716 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.727325  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.715865  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.728749  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.729097  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.729455  1683 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:15.729708  1682 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:15.730244  3716 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:15.730517  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:15.730811  1681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.017s	sys 0.039s
I20260709 12:59:15.716301  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:15.731478  1681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.018s	sys 0.039s
I20260709 12:59:15.731406  1686 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:15.731693  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.716436  3875 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:15.732503  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.716301  1689 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:59:15.732316  1683 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:15.733067  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 687225us
I20260709 12:59:15.717782  1690 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:15.734105  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:15.734076  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.718443  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.734982  3577 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:15.188360  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 358896us
I20260709 12:59:15.719247  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.736068  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.736346  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:15.733146  1686 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:59:15.714700  3819 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:15.722143  1616 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.391367  3658 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:15.737357  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.737602  3819 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:15.716998  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 826765us
I20260709 12:59:15.738382  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.738948  1690 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.739158  1686 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.741417  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:15.732373  1613 rpcz_store.cc:276] 0709 12:59:13.458791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.580812 (+1122021us) service_pool.cc:224] Handling call
0709 12:59:14.605028 (+ 24216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.777938 (+172910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.777990 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.788932 (+ 10942us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.865168 (+ 76236us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:14.865220 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.865306 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.047596 (+182290us) raft_consensus.cc:1685] finished
0709 12:59:15.047621 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.047742 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74678,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":213645,"threads_started":2,"wal-append.queue_time_us":217924}
I20260709 12:59:15.047986  3855 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:15.743255  3855 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:15.744124  3855 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.744951  3913 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.738387  3819 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.745334  3855 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.086620  3820 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:15.746526  3820 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:15.746749  1686 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:15.746996  3820 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.747763  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.142489  3860 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:15.723680  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 720088us
W20260709 12:59:15.748588  3894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.004s	sys 0.011s
I20260709 12:59:15.721918  3877 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:15.729652  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:15.749962  1686 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:15.730707  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.716977  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.733063  3875 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:15.751748  3875 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:15.752364  1682 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:15.296279  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:15.735149  1685 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:15.753450  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 457315us
I20260709 12:59:15.753820  3877 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:15.754099  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:15.736488  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.142946  3816 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:15.137683  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1292) took 1708 ms. Trace:
I20260709 12:59:15.198606  3904 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.755002  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2007) took 2296 ms. Trace:
I20260709 12:59:15.755296  3904 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.755403  1610 rpcz_store.cc:276] 0709 12:59:13.458512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.570723 (+1112211us) service_pool.cc:224] Handling call
0709 12:59:14.615834 (+ 45111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.861826 (+245992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.861874 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.862483 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.882677 (+ 20194us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:14.882722 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.882806 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.754820 (+872014us) raft_consensus.cc:1685] finished
0709 12:59:15.754838 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.754952 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64081,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":60,"thread_start_us":265194,"threads_started":2,"wal-append.queue_time_us":854052}
I20260709 12:59:15.758152  3904 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:15.759001  1685 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:15.736128  3577 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.755044  1612 rpcz_store.cc:276] 0709 12:59:13.429648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.429765 (+   117us) service_pool.cc:224] Handling call
0709 12:59:13.469042 (+ 39277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.469315 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.469342 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.074373 (+605031us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.368186 (+293813us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:14.368248 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.368472 (+   224us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.137384 (+768912us) raft_consensus.cc:1685] finished
0709 12:59:15.137414 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.137594 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2634,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":286019,"threads_started":1,"wal-append.queue_time_us":919854}
I20260709 12:59:15.760423  1687 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:15.752606  3875 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:15.734158  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.754199  3877 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:15.724695  3883 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:15.724714  1535 rpcz_store.cc:276] 0709 12:59:14.061430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.064063 (+  2633us) service_pool.cc:224] Handling call
0709 12:59:15.178558 (+1114495us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400422f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:15.178719 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459605888}
I20260709 12:59:15.751233  1686 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:15.738587  1689 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:15.769898  1683 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:15.724581  3651 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:15.765619  1690 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:15.765893  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:15.772444  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:15.766429  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:15.705252  3909 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:59:15.774952  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.804862  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.123474  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:15.119338  3621 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:15.808331  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:15.806665  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:15.806667  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.810600  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.811173  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.768483  3836 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:15.812903  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.814795  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.771459  3816 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:15.768682  3900 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.739166  3658 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:15.816937  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.745375  3913 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:15.818179  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:15.807318  3863 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:15.819595  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:15.820622  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.835282  1684 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:59:15.809597  3818 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.839670  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.817174  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.816218  3911 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.816062  3849 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.830504  3900 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:15.916465  3849 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:15.916738  3900 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.916951  3849 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.919765  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:15.838505  3818 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:15.920554  3818 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.922322  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.922888  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.923514  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.923928  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.924093  2306 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:15.924499  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:15.836318  3401 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.046s	user 0.000s	sys 0.011s
I20260709 12:59:15.832544  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.812987  3875 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.833472  1685 raft_consensus.cc:2368] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
I20260709 12:59:15.816614  1681 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:15.835791  1684 pending_rounds.cc:85] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 2
I20260709 12:59:15.943562  1684 pending_rounds.cc:107] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:59:15.837047  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:15.819720  1653 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:15.819919  3816 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:15.828579  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.897897  2305 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:15.898188  3702 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:15.904994  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:15.946079  3401 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.905678  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:15.970223  3401 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:15.906262  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:15.908962  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:15.909680  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:15.971675  1534 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:15.915717  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:15.946372  3816 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.836460  3913 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.975862  3868 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:15.977524  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.978581  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.979524  3818 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.830761  3877 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:15.836350  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.925731  3911 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.984637  3911 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.943956  1684 raft_consensus.cc:2889] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:15.945645  3707 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:15.945740  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 126103us
I20260709 12:59:15.987300  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:15.987627  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.987076  3820 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.987929  1684 raft_consensus.cc:2376] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4. Re-sending same reply.
W20260709 12:59:15.988673  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 151687us
I20260709 12:59:15.945878  3915 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:15.989822  3915 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:15.990799  3915 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:15.946395  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:15.979138  1682 raft_consensus.cc:2376] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5. Re-sending same reply.
I20260709 12:59:15.994474  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.947146  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.996025  1687 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:15.996207  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:15.988951  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:15.997665  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:15.999547  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.010727  1535 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:16.011758  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.012387  1535 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:16.002257  1537 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.999807  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:15.996979  1687 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:16.043108  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.044059  1682 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:16.025883  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.053375  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.054188  1535 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:16.054608  2307 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:16.065349  1686 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.087077  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.088901  2308 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:15.978487  3868 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:16.090134  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.028s
W20260709 12:59:16.092299  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.008s	sys 0.028s
I20260709 12:59:16.094278  3818 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:16.096727  3918 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 12:59:16.058171  3877 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.100708  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.098932  3854 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.104554  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:16.058446  3829 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.116935  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:16.116761  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.117678  1537 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:16.118618  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.119102  1534 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.098403  3900 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.126160  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 269) took 1908 ms. Trace:
I20260709 12:59:16.126577  1616 rpcz_store.cc:276] 0709 12:59:14.218059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.857336 (+639277us) service_pool.cc:224] Handling call
0709 12:59:14.857569 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.737215 (+879646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.125945 (+388730us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540009abd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:16.126098 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988161408}
I20260709 12:59:16.127569  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:16.128055  1616 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:16.131978  1656 connection.cc:256] RPC call timeout handler was delayed by -1.1395332999999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:59:16.132997  1656 connection.cc:256] RPC call timeout handler was delayed by -1.0657333000000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 12:59:16.134246  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.137563  1534 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:16.139220  1616 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:16.141976  3820 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:16.142482  2303 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:16.145151  3816 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.118314  3893 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:16.149405  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.158751  3863 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.158645  2301 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:16.148201  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.161060  3770 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.162628  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.162364  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:16.163235  1506 connection.cc:256] RPC call timeout handler was delayed by -1.0554441119999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 12:59:16.167431  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:16.164711  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.168176  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1403) took 1359 ms. Trace:
I20260709 12:59:16.168557  1541 rpcz_store.cc:276] 0709 12:59:14.809115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.809229 (+   114us) service_pool.cc:224] Handling call
0709 12:59:14.809469 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.809653 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:14.918370 (+108717us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.070939 (+152569us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.159386 (+1088447us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b18000dba60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 12:59:16.159719 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.159871 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.159913 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.159962 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.160030 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.160213 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":994881,"prepare.queue_time_us":1423648,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":268,"raft.queue_time_us":1104380,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":63643,"spinlock_wait_cycles":84319488,"thread_start_us":245024,"threads_started":2,"wal-append.queue_time_us":589832}
I20260709 12:59:16.169615  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.167025  3915 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.174181  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.177249  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.177093  3915 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:16.177620  3916 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:16.177983  1616 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:16.179126  3915 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.179852  3900 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.170300  3401 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.180959  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:16.185688  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 449449us
I20260709 12:59:16.186414  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.181957  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.171368  3891 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.187763  3891 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.189846  3891 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.163882  3919 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:16.171574  3770 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:16.191008  3919 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.191275  3913 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.193434  3919 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.191640  3911 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.184319  3832 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:16.192354  3910 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.202266  1682 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.178294  3870 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.196827  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.150524  3849 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.204749  1607 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:16.205282  1616 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:16.208652  1612 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:59:16.210131  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:16.211295  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.212090  1612 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:16.213610  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.214334  1541 raft_consensus.cc:2368] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
I20260709 12:59:16.214898  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:16.214541  1534 raft_consensus.cc:1240] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:16.167438  3893 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.217971  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.191401  3896 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.225680  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.223696  1541 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.231498  1690 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:16.232555  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:16.233752  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:16.234268  1612 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.236311  3853 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.237530  3911 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.226293  3832 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:16.239064  3832 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.195765  3916 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:16.243019  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.200042  3401 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:16.247020  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:16.247125  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:16.247519  1616 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:16.249675  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:16.248385  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 62055.5us
I20260709 12:59:16.251339  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:16.254056  1612 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:16.204578  3910 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:16.214193  3648 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.261729  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.266790  1537 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.222353  3856 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:16.250763  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.278148  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:16.279031  1616 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:16.285564  3849 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.242826  3891 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:16.293753  1535 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:16.305495  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.255398  3854 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:16.313138  3854 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:16.263543  3875 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:16.313623  3854 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.243193  3894 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:59:16.280912  3872 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.265677  3910 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.276703  3856 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:16.269188  3905 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.309700  3882 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.355072  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:16.351926  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 100695us
I20260709 12:59:16.318156  3859 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:16.360188  1507 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:16.361670  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 112071us
I20260709 12:59:16.362941  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.374680  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:16.376173  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.376951  1541 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.349542  3872 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:16.381616  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.247502  3896 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.360294  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.352432  3856 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:16.383315  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.384584  1536 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.381300  1535 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:16.319660  3891 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.385977  3816 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:16.391861  3923 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:59:16.380517  3422 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.393937  3422 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.394615  1537 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:16.394791  3422 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.395653  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 630) took 1272 ms. Trace:
I20260709 12:59:16.396067  3422 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.396672  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2006) took 2938 ms. Trace:
I20260709 12:59:16.398070  1536 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
W20260709 12:59:16.399518  1504 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 2.137s (SENT)
I20260709 12:59:16.397065  1615 rpcz_store.cc:276] 0709 12:59:13.458097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.381584 (+923487us) service_pool.cc:224] Handling call
0709 12:59:14.381942 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.393959 (+ 12017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.394004 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.394516 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.062984 (+1668468us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180036acc0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 12:59:16.118145 (+ 55161us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.118179 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.118241 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:16.396403 (+278162us) raft_consensus.cc:1685] finished
0709 12:59:16.396422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.396617 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11674,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4387,"spinlock_wait_cycles":2697984,"thread_start_us":54994,"threads_started":1,"wal-append.queue_time_us":1786686}
I20260709 12:59:16.404508  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:16.405874  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:16.403559  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.406665  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.411602  1541 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:16.384131  3658 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:16.372969  3882 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.382205  3860 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.388037  3872 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.400413  3836 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:16.476398  3836 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.476874  3836 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:16.418251  1582 leader_election.cc:400] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
W20260709 12:59:16.481999  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 234951us
I20260709 12:59:16.482116  1582 leader_election.cc:403] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:59:16.482416  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 75804.9us
I20260709 12:59:16.386299  3894 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.416968  1682 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:16.500874  3882 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.503163  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.503901  2309 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:16.397238  3837 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:59:16.504859  3891 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.505776  3868 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.507244  1536 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:16.364809  3916 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.417259  3905 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.512874  3846 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.430792  3930 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.416115  3816 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:16.418803  3853 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.396026  2301 rpcz_store.cc:276] 0709 12:59:15.122956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.123163 (+   207us) service_pool.cc:224] Handling call
0709 12:59:16.395445 (+1272282us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400650254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:16.395573 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728444800}
I20260709 12:59:16.421691  3935 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.381675  3859 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.528780  3853 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.529775  3853 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.530570  3859 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.358294  3401 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.490634  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.494524  3915 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:16.495499  3893 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.496254  3913 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.422334  3860 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:16.499163  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:16.499814  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.524832  3422 consensus_queue.cc:1059] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:16.517519  3930 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:16.534444  2304 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.538440  3860 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.526474  3854 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.524981  3816 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.560700  3836 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.483045  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:16.559185  3856 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:16.618567  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 135474us
I20260709 12:59:16.618764  3816 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.619274  3836 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:16.597604  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 191670us
I20260709 12:59:16.560498  3849 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.621272  3849 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.622401  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:16.622753  3866 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:16.482862  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64768.4us
I20260709 12:59:16.623015  3702 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.623641  3866 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.612686  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:16.619392  3856 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.597769  1683 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:16.556962  3860 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.516922  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.560467  3868 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
W20260709 12:59:16.590209  1504 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.584s (SENT)
I20260709 12:59:16.558943  3872 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.634227  3875 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:16.635224  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 45456.6us
W20260709 12:59:16.636287  1504 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.712s (SENT)
I20260709 12:59:16.636620  3872 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.550572  3896 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.599159  1581 leader_election.cc:400] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4.
I20260709 12:59:16.554813  3910 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.639477  3913 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:16.640969  3868 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.641525  3868 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:16.551199  3915 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:16.646795  3854 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.540037  3930 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.626612  1611 raft_consensus.cc:606] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.647993  1611 raft_consensus.cc:614] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:16.630440  3940 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:59:16.641741  3910 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.645984  1534 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:16.645668  3816 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:16.623955  3702 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:16.644411  3875 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:16.658692  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:16.658955  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 142024us
I20260709 12:59:16.660143  3868 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.661290  3854 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:16.667430  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:16.669205  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:16.670804  3911 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:16.671681  3911 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:16.673220  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1299) took 3236 ms (client timeout 1513 ms). Trace:
I20260709 12:59:16.673556  3911 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:16.673731  1608 rpcz_store.cc:269] 0709 12:59:13.436667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.465694 (+ 29027us) service_pool.cc:224] Handling call
0709 12:59:16.672725 (+3207031us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540009b0d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:16.672958 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218317184}
W20260709 12:59:16.676478  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1318) took 2419 ms (client timeout 1642 ms). Trace:
W20260709 12:59:16.677048  1609 rpcz_store.cc:269] 0709 12:59:14.256631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.259973 (+  3342us) service_pool.cc:224] Handling call
0709 12:59:16.676022 (+2416049us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002b5a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:16.676264 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888623360}
I20260709 12:59:16.678918  3913 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:16.679663  3913 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:16.680179  1612 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.662818  1507 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:16.681895  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61675.5us
I20260709 12:59:16.681941  3913 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.683787  3910 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.686332  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:16.687151  1611 raft_consensus.cc:606] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:16.677815  2304 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:16.687633  1611 raft_consensus.cc:614] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.685479  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:16.691785  3702 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.691551  3875 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.693526  3866 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.699021  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.712049  3910 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:16.715058  1532 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:16.715529  3910 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:16.715768  3822 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.716187  3822 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.716853  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.717625  2305 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.717545  3822 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.719038  3822 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.716023  3910 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.701377  1687 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:16.720955  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.721431  3910 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.722380  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.722862  3910 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.720995  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.723201  2303 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:16.724470  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.724814  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.726019  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.726768  2306 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:16.726912  2307 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:16.706434  3860 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:16.705304  2310 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.728098  3691 raft_consensus.cc:3055] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.707842  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.728528  3691 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:16.729205  2301 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:16.729722  3691 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.730229  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:16.731465  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.731673  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.732583  2304 raft_consensus.cc:2376] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4. Re-sending same reply.
I20260709 12:59:16.732961  3868 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.733799  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.734478  2310 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:16.734957  3699 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
W20260709 12:59:16.732177  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.737908  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f65122cec34901839f22a448343dca"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
W20260709 12:59:16.738607  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.738668  1611 raft_consensus.cc:606] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.739295  1611 raft_consensus.cc:614] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.745869  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:16.708305  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 72266.3us
I20260709 12:59:16.708674  1684 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.747350  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.712059  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.709092  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.710666  2302 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.712098  1507 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:16.712337  3854 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:16.712953  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.714640  3872 raft_consensus.cc:2764] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:59:16.707257  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 108770us
I20260709 12:59:16.752851  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:16.749931  1504 leader_election.cc:336] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.760s (SENT)
W20260709 12:59:16.761273  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49359.5us
I20260709 12:59:16.732152  1532 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:16.763199  2306 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:16.754007  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.730989  3691 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.761209  2309 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:16.748179  3849 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.783917  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.782094  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.784965  1504 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:16.788573  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.753165  3896 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.774665  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.762421  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.754556  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:16.774914  3866 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.800374  3887 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:16.800532  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.801330  1612 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.802069  3849 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:16.802438  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:16.803124  1614 raft_consensus.cc:606] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.803274  3849 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:16.803548  1614 raft_consensus.cc:614] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.803858  3849 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:16.800439  3866 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.805123  3883 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:59:16.805059  1540 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:16.805064  2310 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.814796  1612 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.818922  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.820524  3896 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.813305  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.793161  3702 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:16.826517  3882 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:16.827143  3882 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.827414  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:16.827891  3755 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:16.828470  3755 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.828349  3882 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.829967  3755 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.828104  1607 raft_consensus.cc:606] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:16.831303  1607 raft_consensus.cc:614] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.830632  3699 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.831761  3755 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:16.833616  3866 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.833950  3905 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:16.815028  3937 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:59:16.827263  3854 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.838250  3854 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.839253  2305 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:16.842226  3816 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.853519  3930 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.835100  3905 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.856794   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:16.857430  3905 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.859211  3905 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.859591  1534 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.860468  3702 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:16.861075  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:16.861826  1540 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:16.815197  3887 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.862835  3702 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:16.864108  3849 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.865733  3849 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:16.867650  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 54741.4us
I20260709 12:59:16.839386  3854 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.874624  2310 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:16.876925  3896 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:16.877149  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89804.8us
W20260709 12:59:16.880187  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45518.6us
I20260709 12:59:16.863493  3887 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.856001  3930 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.886660  2306 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:16.887756  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:16.896260  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.891935  3702 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.898294  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:16.898864  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:16.910259  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 160421us
W20260709 12:59:16.908963  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67937us
I20260709 12:59:16.900542  3853 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:16.911047  3707 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.912269  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:16.913034  1540 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:16.914269  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:16.915531  3870 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.916522  3702 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.917755  3856 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:16.918249  3856 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:16.919158  3702 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:16.923796  1507 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:16.924809  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:16.940958  1690 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:16.927834  1534 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:16.929822  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:16.915915  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:16.931118  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.919194  3856 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.944360  1688 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:16.944718  3856 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:16.945787  3707 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.947561  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:16.948619  3707 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.950193  3707 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.952472  3707 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:16.952781  3911 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.954149  3706 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.954515  3706 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:16.954427  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.938325   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:16.956723  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.957755  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.958110  1684 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:16.958461  1683 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:16.959556  1689 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.960742  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.960850  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:16.961442  1686 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:16.962297  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:16.963907  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 72295.1us
I20260709 12:59:16.970561  3706 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:16.971887  3706 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.999101  3882 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.004822  1607 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.967723  3870 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:17.007015  3896 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:17.004935  1540 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:16.997166  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.009725  3853 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:17.012969  3853 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.013012  3870 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:17.013649  3870 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.014843  3870 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.017372  1435 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:17.023984  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 100312us
I20260709 12:59:17.030460  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:16.996141  3911 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.032562  3422 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:17.032691  3911 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.033509  3854 raft_consensus.cc:2764] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:17.033571  3422 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:17.034040  3422 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:17.035066  3911 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.017345  3870 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.018502  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:17.042428  3860 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.042996  3860 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:17.043404  3882 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.043640  1653 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:17.019210  1435 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 2 to 3, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:17.044967  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.046399  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.046880  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 134) took 8668 ms. Trace:
I20260709 12:59:17.047432  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.044016  3860 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.048643  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.049856  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.051012  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:17.052248  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:17.055184  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.066628  1609 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:17.067917  3919 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:17.068097  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.068459  3919 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.068910  3919 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.069332  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.069639  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.070544  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.070652  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.071400  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.071835  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.072140  1608 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:17.072499  1613 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:17.073262  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.073755  1613 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:17.074646  3876 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.074753  1608 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:17.076294  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.070647  1435 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 3, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.079962  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.079829  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.087014  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.090564  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46804
I20260709 12:59:17.092607  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.093333  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.095057  1607 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:17.079802  3911 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:17.100723  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 144970us
I20260709 12:59:17.103497  1615 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:17.091203  1609 raft_consensus.cc:606] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Received request to transfer leadership
I20260709 12:59:17.096391  3707 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.105290  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:17.111310  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.108037  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:17.105033  1653 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:17.110543  3707 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.124465  3707 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.128446  3846 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.129210  3846 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.130065  1435 catalog_manager.cc:5697] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 2, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:17.131430  3846 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.115887  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.117672  1688 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:59:17.047307  1436 rpcz_store.cc:276] 0709 12:59:08.384995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.408417 (+ 23422us) service_pool.cc:224] Handling call
0709 12:59:17.046604 (+8638187us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:14.218722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:14.269194 (+ 50472us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:14.269232 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:14.269251 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:14.270066 (+   815us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:14.270140 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:14.270166 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:14.270724 (+   558us) tablet.cc:701] Row locks acquired
0709 12:59:14.270745 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:59:14.270894 (+   149us) write_op.cc:270] Start()
0709 12:59:14.271004 (+   110us) write_op.cc:276] Timestamp: P: 1783601954270849 usec, L: 0
0709 12:59:14.271026 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:14.274010 (+  2984us) log.cc:844] Serialized 3087 byte log entry
0709 12:59:15.711877 (+1437867us) op_driver.cc:464] REPLICATION: finished
0709 12:59:15.807653 (+ 95776us) write_op.cc:301] APPLY: starting
0709 12:59:15.812459 (+  4806us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:15.900311 (+ 87852us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:15.900451 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:15.915735 (+ 15284us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:15.915931 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:59:15.915975 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:15.916258 (+   283us) log.cc:844] Serialized 59 byte log entry
0709 12:59:15.972345 (+ 56087us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.972498 (+   153us) write_op.cc:454] Released schema lock
0709 12:59:15.972557 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:15.973015 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.973053 (+    38us) write_op.cc:454] Released schema lock
0709 12:59:16.803334 (+830281us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b1800049fc0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
Metrics: {"mutex_wait_us":766898,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":64614,"apply.run_cpu_time_us":14468,"apply.run_wall_time_us":196188,"mutex_wait_us":10251,"num_ops":7,"prepare.queue_time_us":706866,"prepare.run_cpu_time_us":16834,"prepare.run_wall_time_us":222667,"raft.queue_time_us":747874,"raft.run_cpu_time_us":5860,"raft.run_wall_time_us":166294,"replication_time_us":1440697,"spinlock_wait_cycles":9102592,"thread_start_us":880255,"threads_started":4,"wal-append.queue_time_us":1331793,"wal-append.run_cpu_time_us":14714,"wal-append.run_wall_time_us":1181480}]]}
I20260709 12:59:17.119385  1686 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:17.094256  3913 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:17.108860  3849 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:17.139477  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.142004  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:17.141490  3868 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:17.146658  3859 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.146966  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.147215  3859 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.148818  3913 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.151049  3913 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.143884  3818 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:17.151743  3818 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.152117  3818 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.153910  1532 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:17.155781  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.112983  3911 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.158210  3707 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.158824  3911 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.159370  3706 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:17.159441  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 51518.7us
I20260709 12:59:17.161476  1582 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.161640  3702 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.162379  3702 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.162801  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:17.163714  3707 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.163867  1607 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:17.164453  3707 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.160009  3706 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.165082  3707 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.165611  1540 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:17.166393  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.166862  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.167563  1534 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:17.166950  3706 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.165076  3883 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:17.168622  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.169409  1541 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:17.170285  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.166131  3707 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.171977  3893 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:59:17.179631  3893 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:17.180050  3893 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.180786  1507 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:17.182747  1506 leader_election.cc:336] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.503s (SENT)
W20260709 12:59:17.162865  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.175252  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:17.175745  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:17.176760  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:17.173095  3953 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:59:17.172260  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.172389  3816 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.222489  1685 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:17.170639  3822 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:17.176692  3849 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:17.225167  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.222465  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:17.229861  1688 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:17.228169  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45464.1us
I20260709 12:59:17.223960  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:17.234807  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54106.5us
I20260709 12:59:17.187491  3876 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:17.209802  3911 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:17.237118  1681 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:17.225595  3816 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.232129  3849 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.229118  3905 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:17.243044  2276 connection.cc:256] RPC call timeout handler was delayed by -1.1461162400000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:59:17.248387  2276 connection.cc:256] RPC call timeout handler was delayed by -1.0048162400000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:59:17.174145  3422 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.251526  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.251947  3422 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.252363  1537 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:17.256367  3847 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:17.256779  3847 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.257700  3847 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.259327  3847 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.243383  3691 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.243683  3702 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.246915  3816 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.266834  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:17.268393  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 183567us
W20260709 12:59:17.271006  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89090.6us
I20260709 12:59:17.267264  3860 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.276641  1686 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:17.278558  1533 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:59:17.266214  3691 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:17.277283  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:17.280123  3860 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.279443  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:17.276119  3875 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:59:17.286804  1581 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.271785  3876 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:17.287803  3876 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.288331  3883 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:17.288724  3883 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.289052  3883 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.289891  3876 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:17.265560  3893 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.293641  3915 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:17.294209  3893 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.294411  3915 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:17.299139  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57974
I20260709 12:59:17.295701  3915 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.282966  3691 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.310221  1533 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:17.302593  3887 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:17.315133  3887 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:17.315562  3887 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.316808  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.317672  1538 raft_consensus.cc:2410] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:17.320640  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:17.308156  3699 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:59:17.321481  3699 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:17.321851  3699 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:17.322830  3699 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.323995  3699 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:17.332456  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59757.2us
W20260709 12:59:17.332533  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:17.333246  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.332407  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:17.334090  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.335191  1688 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
W20260709 12:59:17.342862  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.342962  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:17.349678  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 80566.8us
I20260709 12:59:17.351343  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.338567  3875 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.360337  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.360841  1616 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:17.361219  3905 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.362412  2310 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:17.365257  1533 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:59:17.366277  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59739.9us
I20260709 12:59:17.367594  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:17.369297  3959 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:17.370051  3959 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.370913  3905 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:17.379273  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.384204  2305 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:17.383992  3919 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.384768  3835 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.385192  3835 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:17.385535  3835 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:17.386848  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.386684  3818 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.388628  1689 raft_consensus.cc:606] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:17.388916  1532 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:17.389031  1689 raft_consensus.cc:614] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:17.391994  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.386816  3919 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.355257  3859 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:17.407131  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.409221  2310 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:59:17.425004  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.400777  2301 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:17.404592  3913 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.435125  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:17.445652  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.436888  2301 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:17.448372  2301 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.449651  2301 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.450762  3911 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:17.451349  3911 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.452858  3876 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:17.453358  3911 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.453758  3818 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.454154  3911 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:17.454388  3876 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.395936  3905 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:59:17.454741  3911 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.437386  3959 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.472448  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:17.438320  3860 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.457219  3913 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.456128  3846 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.479297  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.461092  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:17.476090  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:17.480625  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.482775  1689 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.481292  2310 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:17.484377  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 45731.6us
I20260709 12:59:17.486156  1532 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:17.483192  2310 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:17.475061  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:17.492965  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.493702  1536 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:17.494033  3967 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.471107  3847 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:17.494714  3847 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:17.495245  3958 log.cc:927] Time spent T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:59:17.498553  3691 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.499630  1682 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.501485  3691 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.490012  2304 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.503455  3853 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:17.508724  2310 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.510409  3887 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:17.493980  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 156926us
I20260709 12:59:17.477993  3913 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.533041  1689 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:17.540776  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:17.494627  3967 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.544108  2310 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.548451  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:17.555053  3963 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:59:17.541800  3915 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.546638  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:17.566366  2276 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.556818  3818 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.519165  3846 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.569929  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.570185  3959 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.577294  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.578060  3818 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.560809  3876 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.581950  3876 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:17.584833  1532 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:17.588160  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:17.590776  3911 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.584021  3702 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:17.580538  3847 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.585332  3876 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.595719  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:17.597317  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 90962.1us
I20260709 12:59:17.599910  1532 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:17.602181  1616 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:17.602804  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.604946  3887 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:17.605160  1487 auto_rebalancer.cc:893] Removing replace marker failed: Replica 631fb66c0070402b8f78fd74633dae6f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:17.605680  1487 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:59:17.605975  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:17.606866  3846 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.566062  3915 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.609870  3915 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:17.611222  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 63025.6us
I20260709 12:59:17.616349  3702 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.617409  3702 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.619591  2276 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.621536  3859 raft_consensus.cc:2764] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:59:17.621665  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.622315  1614 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.624439  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46804
I20260709 12:59:17.624631  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:17.625027  1612 raft_consensus.cc:606] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:17.625365  2303 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:17.625384  1612 raft_consensus.cc:614] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:17.626919  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.615173  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:17.627235  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.627671  2305 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:17.627611  1533 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:17.628826  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.629722  1536 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:17.628989  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.630328  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.630443  1541 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:17.631026  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:17.631887  3422 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.628067  1538 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:17.632541  3919 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.632902  3853 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.633499  1541 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:17.632953  3919 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.634790  3919 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.636919  1533 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:17.637321  3818 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.638285  1579 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.639189  3818 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.639545  3818 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.640101  3818 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.642410  3919 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.643195  3883 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.643934  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:17.579260  3967 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.648388  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.649619  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:17.650381  2301 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:59:17.612164  2304 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
W20260709 12:59:17.666329  1487 auto_rebalancer.cc:893] Removing replace marker failed: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:17.656498  1611 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.661437  2310 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:17.662672  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.598140  3875 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.659035  3896 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:59:17.677181  1582 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.678426  1536 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:17.680881  1533 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.665135  2305 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:17.665604  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:17.666750  1487 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:59:17.682967  3976 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.666435  3959 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:59:17.671458  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:17.661250  2301 pending_rounds.cc:85] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 5
I20260709 12:59:17.683863  2301 pending_rounds.cc:107] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:17.684191  2301 raft_consensus.cc:2889] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:17.658751  3835 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.685703  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.686223  3835 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:17.686522  3846 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:17.687367  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:17.687562  3846 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:17.683389  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:17.691181  1582 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.692601  3875 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:17.692729  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 80417us
I20260709 12:59:17.693800  3853 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:17.694334  3853 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.694644  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.695626  3915 consensus_queue.cc:1059] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.696604  3651 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.696465  3978 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.697154  3651 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:17.697891  3978 raft_consensus.cc:3055] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:17.698323  3978 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:17.698035  3651 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:17.698076  3853 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.699213  3978 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.700172  3847 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:17.700438  3976 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.701982  3978 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.702543  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.702111  3853 consensus_queue.cc:1059] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.703423  1611 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:17.703897  3853 raft_consensus.cc:3055] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:17.704358  3853 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:17.704586  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:17.705466  2301 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:17.711141  3847 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.712112  1537 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:17.712510  1537 pending_rounds.cc:85] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 5
I20260709 12:59:17.712499  3977 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:17.713006  1537 pending_rounds.cc:107] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:17.713053  3977 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:17.713384  1537 raft_consensus.cc:2889] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:17.714162  3977 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.705238  3853 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.708315  3959 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:17.712836  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.702818  3976 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.675246  3422 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.734076  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:17.734282  1609 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:17.734702  1610 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:17.747349  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.752487  1536 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:17.757517  1537 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.754922  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.758594  1613 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:17.760464  1532 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.757579  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.761518  1608 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:17.682891  3919 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:17.764540  1534 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:59:17.765586  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.768541  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:17.774628  1610 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:17.780422  1582 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.781922  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.783600  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:17.785822  2310 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.788138  1533 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:17.748153  3959 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:17.795255  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:17.780035  3849 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.007s
I20260709 12:59:17.804807  1610 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:17.796484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.759652  3707 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.810132  1608 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.815114  1533 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:17.816504  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.816746  1688 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:17.822113  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.815498  1533 pending_rounds.cc:85] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 2
I20260709 12:59:17.828354  1533 pending_rounds.cc:107] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:17.828612  1533 raft_consensus.cc:2889] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:17.819813  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:17.832645  3987 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:17.833148  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.833796  3890 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.834307  3890 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.836397  3890 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:17.836445  3691 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:17.801168  3976 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:17.850114  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 102884us
I20260709 12:59:17.850310  1613 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.807631  3853 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:17.852305  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 70496.3us
I20260709 12:59:17.784857  3755 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.854012  1535 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:17.854204  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.778827  3868 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:59:17.788964  3706 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:59:17.859113  3967 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.833142  3987 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:17.853328  3816 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.002s
I20260709 12:59:17.872782  1615 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:17.873739  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 51720.1us
I20260709 12:59:17.851848  3976 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:17.812103  3849 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:17.879524  2310 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:17.830220  3882 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:59:17.875644  1504 leader_election.cc:336] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.505s (SENT)
I20260709 12:59:17.883733  1504 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.888540  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.893218  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.893952  1535 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:17.865357  3967 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:17.876878  3896 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.853237  3707 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.876358  3987 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:17.912463  1504 leader_election.cc:336] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.536s (SENT)
I20260709 12:59:17.880827  3976 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.904953  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:17.906582  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51497.4us
I20260709 12:59:17.931564  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:17.932366  1682 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.940850  1535 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:17.942304  1504 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:17.943756  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.950117  1615 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.950786  1682 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:17.876300  3876 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.916618  3930 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:17.918481  3967 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.953545  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:17.957278  1581 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:17.882757  3816 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.958177  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:17.916405  3910 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:17.959998  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 82599.6us
I20260709 12:59:17.918289  3896 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:17.962597  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:17.924697  3883 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.964108  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:17.979204  1538 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.890832  3913 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:17.966125  3847 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.966094  1614 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:17.972607  3707 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:17.972863  3975 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 12:59:17.973255  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 60832.6us
I20260709 12:59:17.977492  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:18.015075  1537 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:17.966055  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:17.972630  1608 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:17.998458  1612 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:17.947526  3919 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:17.883693  3959 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:18.016757  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 80593.2us
I20260709 12:59:17.965054  3887 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:18.032656  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:18.028919  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 51580.7us
I20260709 12:59:18.020151  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:18.028636  1616 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:17.961042  3930 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:18.046765  1682 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:18.047048  3930 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:18.045044  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.048421  1504 leader_election.cc:336] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.601s (SENT)
I20260709 12:59:18.019059  3919 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:18.049345  3919 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.996060  3847 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:18.050767  3847 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:17.985363  3896 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:18.053967  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.056836  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 199946us
I20260709 12:59:18.048475  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:18.058409  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.961710  3706 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:59:17.991544  3890 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:17.961422  3860 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:59:18.095535  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.096021  1538 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
W20260709 12:59:18.096465  1504 leader_election.cc:336] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.624s (SENT)
W20260709 12:59:18.099663  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.099911  1504 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:18.015396  3846 raft_consensus.cc:2764] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:59:18.098047  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49717.2us
I20260709 12:59:18.099025  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:17.964614  3989 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:59:18.014636  3699 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:59:17.997256  3691 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:59:18.062243  3893 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:18.129146  3893 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.129698  3893 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.063736  3702 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:18.134196  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.136382  3998 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:59:18.141939  2302 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:18.100208  3847 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:18.152619  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 132536us
I20260709 12:59:18.028486  3988 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:59:18.153348  2310 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:18.130977  3999 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:59:18.158749  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 109967us
I20260709 12:59:18.062343  3991 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 12:59:18.127786  3422 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:18.105067  3868 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:59:18.141872  3910 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.178638  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:18.160068  3993 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:18.158772  3882 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.153254  3702 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:18.259781  1611 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:59:18.241658  3887 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.260500  1611 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:18.244743  2301 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.243980  3993 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:18.244676  3755 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.252441  3849 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:18.297629  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 119393us
I20260709 12:59:18.275197  3993 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.301764  4010 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:18.253769  3910 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.271577  2301 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:18.258757  3882 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.303439  1613 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:18.292968  3876 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:18.276479  3966 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.251s
W20260709 12:59:18.320864  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 166733us
I20260709 12:59:18.275007  3887 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.328413  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.323244  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:18.296909  3755 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.313906  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:18.316442  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 217505us
I20260709 12:59:18.322016  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:18.304725  3816 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.302901  3707 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:18.305346  3913 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:18.336069  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.324038  3978 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:59:18.342962  2301 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.344622  3997 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:18.345139  3997 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.300140  4008 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:59:18.347031  4013 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:18.313988  3992 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:18.349779  1504 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.942s (SENT) [suppressed 34 similar messages]
I20260709 12:59:18.352520  3999 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.360853  3999 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:18.361696  3999 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.364476  3755 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.332927  3651 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.304072  3702 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.366947  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.369488  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.374719  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.365846  3755 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.369496  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:18.376513  3866 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.382364  3755 consensus_queue.cc:1243] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:18.382844  1613 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.383769  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.384069  3997 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.385013  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.384748  3651 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.387341  3651 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:18.368323  3999 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.397655  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:18.398001  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.388329  4007 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:18.408689  4004 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:59:18.409224   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:18.409649  4025 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.410130  4025 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:18.411101  4025 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:18.414130  4006 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:59:18.350942  3992 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.412264  3993 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.337566  3707 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.388650  4003 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.431897  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.436661  1681 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:18.435034  4025 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.426141  3992 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.449043  4018 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:18.449716  4011 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.412690  3994 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.476898  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 154961us
W20260709 12:59:18.436789  4016 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:59:18.447700  3967 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.407212  3755 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:18.435988  3866 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:18.443152  3910 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.442415  3887 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:18.501569  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.519876  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 229201us
I20260709 12:59:18.513653  1681 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:18.486650  4018 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:18.491015  3816 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:18.526412  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:18.528090  1611 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:18.529865  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 180119us
I20260709 12:59:18.500911  3755 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:18.533247  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.534067  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.534652  1614 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:18.535691  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.536276  1615 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:18.538090  1681 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:18.522219  3853 consensus_meta.cc:287] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
W20260709 12:59:18.527933  3818 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.001s
I20260709 12:59:18.544402  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.548182  1688 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:18.551273  1533 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:18.552827  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.563884  3978 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:18.565979  3835 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.566466  3835 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.484999  4011 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.568542  3882 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.530620  3866 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:18.568974  4015 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:59:18.569314  3866 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:18.570199  4011 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.570825  4011 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:18.571488  3866 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.492919  3994 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.572172  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.572834  1682 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:18.573364  3976 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.007s
I20260709 12:59:18.573297  3896 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.574069  3994 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.573837  3976 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:18.589560  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.576692  1504 leader_election.cc:336] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 2.007s (SENT)
I20260709 12:59:18.576263  1690 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:18.593899  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.594678  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.581290  3853 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:59:18.602874  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 118189us
I20260709 12:59:18.603245  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:18.607841  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.608078  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:18.608501  1686 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:18.608747  1689 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.612543  3755 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.613433  4017 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:59:18.615583  4031 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:18.616873  4031 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.617314  4031 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:18.552695  3818 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.531168  3816 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.591123  3896 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.624049  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:18.627707  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:18.588390  4021 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:18.629825  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.630432  1686 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:18.546221  3887 consensus_queue.cc:1059] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:59:18.629568  2307 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:18.604537  3835 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:18.642290  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.551980  3919 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.644634  1616 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:18.641748  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:18.651343  1689 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
W20260709 12:59:18.655459  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 101885us
W20260709 12:59:18.661304  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.633396  4023 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:18.663040  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:18.666172  4035 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:18.668437  4027 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.668790  4001 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.674243  1688 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:18.678171  1614 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:18.667948  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.680541  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:18.679041  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.679473  1613 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:18.680521  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:18.681624  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.683648  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.645860  4021 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:18.698824  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 155676us
I20260709 12:59:18.707764  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:18.708123  1535 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:18.710534  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:18.656816  3896 raft_consensus.cc:3055] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.698531  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.698613  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:18.698566  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:18.664234  3859 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:18.699359  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:18.733166  2309 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:18.741582  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:18.742239  2303 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.744602  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.745250  1610 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:18.745607  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:18.746627  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:18.747093  1537 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.747767  3977 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:18.717870  3896 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:18.748983  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.684283  3993 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.690670  3967 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.738520  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:18.682878  3887 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.661023  4017 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:59:18.736559  1615 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:18.734763  3859 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.731639  1613 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:18.752766  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.716661  3910 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:18.754662  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81111.7us
I20260709 12:59:18.734556  1534 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:18.772186  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:18.772642  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:18.774858  1504 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:18.774156  3859 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.750501  3882 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:18.782815  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:18.787279  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 109351us
I20260709 12:59:18.789312  1507 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:18.789029  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.643770  4018 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.789162  4026 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.795643  4021 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.712656  4001 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.793064  3882 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.682037  4023 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.690269  4035 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:18.682668  4031 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:18.803243  3987 consensus_meta.cc:287] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.002s
I20260709 12:59:18.801172  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:18.754305  3896 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.689498  4027 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.800875  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:18.835518  3755 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:18.836995  3882 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.837564  3816 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.837653  2303 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:18.838042  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:18.838649  4040 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:18.840852  4035 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.841468  3993 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.844358  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 71799.4us
I20260709 12:59:18.875640  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:18.845644  1537 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:18.778306  3910 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:18.847276  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46189.4us
I20260709 12:59:18.848989  1534 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:18.782635  3887 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.805163  3976 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:18.822889  3967 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.871430  4003 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.002112  3822 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.912801  3896 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.909447  2304 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:59:19.017377  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 222566us
I20260709 12:59:19.062065  1608 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:19.083839  2308 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:18.845554  3966 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:59:18.873793  3994 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.909677  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 104937us
I20260709 12:59:19.063655  3755 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:19.065838  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 149182us
W20260709 12:59:19.067041  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 191499us
I20260709 12:59:19.093756  1506 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:18.851068  3999 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.872192  3818 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:18.851119  3987 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.069052  4044 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.081797  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:18.821801  4026 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.061048  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:18.959501  3993 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:18.876202  3882 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:19.094326  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.074873  3866 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.065651  3915 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:19.084395  3893 consensus_meta.cc:287] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.951s	user 0.019s	sys 0.000s
I20260709 12:59:19.078609  3822 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:19.106537  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.111284  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.083482  3967 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.118414  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.138831  1614 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:59:19.139942  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.145192  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:19.157817  1534 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:19.124456  4003 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.146101  1609 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:19.176188  1504 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:19.166002  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 59564.1us
I20260709 12:59:19.098819  3994 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.123821  3882 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.182377  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.185738  1537 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:19.112519  3999 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.172835  3911 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:19.189038  4043 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 12:59:19.191576  4048 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.191967  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:19.192312  4055 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:19.192862  4055 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.194276  4001 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.194864  4055 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.195389  3910 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.205999  3967 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.189091  3911 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.146392  3915 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.210132  3915 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:19.121592  4044 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.212519  4044 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:19.164053  3975 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.267421  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.269194  1537 raft_consensus.cc:2410] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:19.147054  3893 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.214414  3882 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.294747  4008 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:19.295485  3691 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:19.296059  4040 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:19.298539  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.240794  3911 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.300774  3860 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:19.314054  1535 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:19.315860  3887 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.213423  4003 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:19.341308  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.382939  1616 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:19.383232  1611 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.341468  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:19.342442  3919 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.343958  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:19.384081  2309 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.234400  4048 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.361011  1537 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:19.368414  4040 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:19.326225  3977 consensus_meta.cc:287] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.002s
I20260709 12:59:19.173743  3866 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.279779  4051 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:19.385082  3859 consensus_meta.cc:287] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.005s
I20260709 12:59:19.279799  4049 raft_consensus.cc:2764] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:19.285990  3822 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:19.370036  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 82638.8us
I20260709 12:59:19.397743  1537 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:19.389020  4040 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.340427  4055 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:59:19.348342  4008 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:19.360379  3691 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:19.433684  1615 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.370012  3860 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:19.478549  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.454476  2309 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:19.396579  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:19.433951  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.435300  4057 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 12:59:19.435101  3992 consensus_meta.cc:287] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.944s	user 0.007s	sys 0.003s
I20260709 12:59:19.431686  4056 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.406994  4048 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.450698  3822 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.503067  4056 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.495761  3691 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.496325  4023 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.497071  3860 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.440382  3859 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.280710  3975 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.502041  3992 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.419371  4026 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:19.506783  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.509271  3866 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.509416  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:19.510749  4017 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.530798  3859 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:19.515372  4005 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.271s	user 0.002s	sys 0.000s
I20260709 12:59:19.518170  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.517640  3707 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.413717  3974 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.532593  4048 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.533298  3974 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.534821  3975 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.535488  4026 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:19.535900  4026 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.536258  4026 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.536671  3893 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:19.521020  4025 consensus_meta.cc:287] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.036s	user 0.006s	sys 0.007s
I20260709 12:59:19.536396  3966 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.521916  1579 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.526768  1534 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:19.506162  3987 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.537407  4008 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.541090  4008 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.529963  4056 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.521130  4051 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.544884  1537 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:19.550473  1537 pending_rounds.cc:85] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 3
I20260709 12:59:19.550791  1537 pending_rounds.cc:107] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:19.551012  1537 raft_consensus.cc:2889] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:19.551067  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.547521  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.536398  3999 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.551556  1609 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:19.550186  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 374085us
I20260709 12:59:19.552430  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.525740  3977 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.564425  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.564435  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:19.549649  4025 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:59:19.567876  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.539705  3966 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.568475  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.544943  3860 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.568109  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:19.571722  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:19.579315  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.553838  3987 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.539158  3974 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.586555  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.565413  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:19.588613  4061 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.589921  1504 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.549683  3994 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.591162  1541 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:19.592187  1609 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:19.579417  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:19.595755  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.567337  4048 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:19.600670  4048 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.602916  4048 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.570909  4055 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.578483  3966 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.599392  3987 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:19.603524  4055 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.599586  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.604398  1616 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:19.516831  4003 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.607813  4048 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:19.594020  3896 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.006s
I20260709 12:59:19.566704  3915 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:59:19.568150  3910 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:59:19.566035  3977 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.566876  4017 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:59:19.593602  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:19.604745  3887 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:19.606370  4055 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.609710  3987 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.611392  4048 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.612123  4025 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:19.580291  4051 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.615932  3919 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.626717  3919 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:19.627626  3919 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.624351  1610 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:19.620507  4023 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.621385  3910 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:19.668632  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 83893.5us
I20260709 12:59:19.671233  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.625051  4048 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.684593  4021 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.621589  3887 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:19.709892  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2093) took 1037 ms. Trace:
I20260709 12:59:19.710417  1538 rpcz_store.cc:276] 0709 12:59:18.672779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.673606 (+   827us) service_pool.cc:224] Handling call
0709 12:59:18.673873 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.867335 (+193462us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:18.950647 (+ 83312us) log.cc:844] Serialized 14 byte log entry
0709 12:59:19.515689 (+565042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:19.515766 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:19.515828 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.709569 (+193741us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003b4a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:19.709632 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.709815 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12411,"prepare.queue_time_us":42446,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":107956,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":21462,"spinlock_wait_cycles":444371712,"thread_start_us":440143,"threads_started":2,"wal-append.queue_time_us":445161}
I20260709 12:59:19.713393  3882 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.715687  3882 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.716375  4025 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:19.716830  4025 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.716912  4064 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.717238  4025 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:19.544314  3991 consensus_queue.cc:1175] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" responder_term: 5 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)" } } last_received_current_leader { term: 5 index: 5 } }
I20260709 12:59:19.605890  4061 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.721163  1541 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:19.624540  2305 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:19.730605  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1457) took 1015 ms. Trace:
I20260709 12:59:19.640883  3974 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.739706  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1355) took 2082 ms. Trace:
I20260709 12:59:19.670133  3910 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:19.743487  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 164422us
I20260709 12:59:19.740692  1612 rpcz_store.cc:276] 0709 12:59:17.657714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.657849 (+   135us) service_pool.cc:224] Handling call
0709 12:59:17.665266 (+  7417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.019100 (+353834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.739437 (+1720337us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54001b6554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:19.739639 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765694848}
I20260709 12:59:19.720328  4061 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.732031  1535 rpcz_store.cc:276] 0709 12:59:18.714943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.369095 (+654152us) service_pool.cc:224] Handling call
0709 12:59:19.369408 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:19.388365 (+ 18957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.388402 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:19.521591 (+133189us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.673559 (+151968us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:19.674010 (+   451us) log.cc:844] Serialized 14 byte log entry
0709 12:59:19.730282 (+ 56272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.730358 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:19.730398 (+    40us) raft_consensus.cc:1685] finished
0709 12:59:19.730410 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.730545 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68339,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":15009,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":11800,"thread_start_us":126591,"threads_started":1,"wal-append.queue_time_us":143974}
I20260709 12:59:19.750922  3910 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:19.753100  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.753728  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:19.756840  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.729861  4023 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:19.773962  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.753315  3992 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.786824  1535 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:19.775367  4062 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:59:19.788906  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2104) took 1038 ms. Trace:
I20260709 12:59:19.792771  1535 rpcz_store.cc:276] 0709 12:59:18.750900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.759402 (+1008502us) service_pool.cc:224] Handling call
0709 12:59:19.783815 (+ 24413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.788629 (+  4814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.788845 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:19.770835  4021 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:19.775478  3987 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:19.797966  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 202302us
I20260709 12:59:19.753953  3974 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.821349  3974 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.775391  4076 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:19.800284  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 210448us
I20260709 12:59:19.831487  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.730895  3887 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.834311  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:19.804997  3875 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:19.810292  4031 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.811893  4009 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:19.813449  3991 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.818037  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.819063  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.824672  1610 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:19.843658  1613 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:19.802488  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2105) took 1050 ms. Trace:
I20260709 12:59:19.826228  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.799746  4047 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.834233  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:19.804265  4073 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:19.835383  1504 connection.cc:256] RPC call timeout handler was delayed by -1.1831105480000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:59:19.836508  3911 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:19.800276  3987 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.833142  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:19.844560  1535 rpcz_store.cc:276] 0709 12:59:18.751919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.793845 (+1041926us) service_pool.cc:224] Handling call
0709 12:59:19.801869 (+  8024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.802101 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.802139 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:19.802187 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:19.802231 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.802309 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.802436 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:19.848384  1612 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.834641  4076 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:19.866391  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.866714  4076 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.868395  3974 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:19.868798  3974 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.869156  3974 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:19.872381  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.872637  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.873533  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 282) took 1250 ms. Trace:
I20260709 12:59:19.874040  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.875285  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.861539  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.881079  4049 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:19.881597  4049 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:19.882678  4049 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:19.883569  4060 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:59:19.842918  4009 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:19.858290  4040 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.884893  4009 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.843194  3991 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.885988  3991 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.886519  4021 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.878023  4033 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.878485  3999 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.889173  3999 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.858832  4065 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:19.891573  3999 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.854887  4078 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.892391  4078 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:19.892772  4078 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.840217  3910 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.885666  4040 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.874063  1688 rpcz_store.cc:276] 0709 12:59:18.622668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.622815 (+   147us) service_pool.cc:224] Handling call
0709 12:59:18.623087 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.693753 (+ 70666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.873141 (+1179388us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b5400392954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:19.873405 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117254912}
I20260709 12:59:19.827747  3992 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.895557  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:19.914254  1613 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:19.911288  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.846496  3887 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.843931  3994 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.846346  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:19.914746  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 140826us
I20260709 12:59:19.894919  3987 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.864400  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:19.927942  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.831938  4026 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:19.834848  3853 consensus_queue.cc:1175] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:19.924890  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:19.925824  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.930281  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.933076  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:19.938659  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.938565  1535 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:19.941902  1504 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:19.943449  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 106588us
I20260709 12:59:19.916584  3977 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.944979  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2095) took 1262 ms. Trace:
I20260709 12:59:19.945349  1540 rpcz_store.cc:276] 0709 12:59:18.673325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.674098 (+   773us) service_pool.cc:224] Handling call
0709 12:59:18.698333 (+ 24235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:19.062951 (+364618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.062981 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:19.078769 (+ 15788us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.566634 (+487865us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:19.597632 (+ 30998us) log.cc:844] Serialized 14 byte log entry
0709 12:59:19.703813 (+106181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.703901 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:19.882991 (+179090us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:19.926157 (+ 43166us) raft_consensus.cc:1685] finished
0709 12:59:19.935644 (+  9487us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.935795 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22325,"prepare.queue_time_us":38176,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":91807,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":18042,"spinlock_wait_cycles":12742400,"thread_start_us":858035,"threads_started":3,"wal-append.queue_time_us":488607}
I20260709 12:59:19.947758  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:19.948030  4026 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.950938  1612 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:19.951992  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:19.952760  1535 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:19.953310  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2099) took 1269 ms. Trace:
I20260709 12:59:19.953557  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:19.954200  1535 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.953675  1532 rpcz_store.cc:276] 0709 12:59:18.683973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.733181 (+ 49208us) service_pool.cc:224] Handling call
0709 12:59:18.746170 (+ 12989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:19.061118 (+314948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.061157 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:19.072564 (+ 11407us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.952756 (+880192us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b180037d080. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1
0709 12:59:19.952913 (+   157us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:19.952951 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.953019 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:19.953059 (+    40us) raft_consensus.cc:1685] finished
0709 12:59:19.953070 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.953251 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8851,"raft.queue_time_us":88849,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"spinlock_wait_cycles":6932736,"thread_start_us":632946,"threads_started":2,"wal-append.queue_time_us":430007}
I20260709 12:59:19.955838  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:19.935938  3994 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:19.957129  3994 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:19.957561  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1463) took 1220 ms. Trace:
I20260709 12:59:19.958271  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2098) took 1280 ms. Trace:
I20260709 12:59:19.923964  4007 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.925948  4049 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.963546  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:19.957926  1537 rpcz_store.cc:276] 0709 12:59:18.737001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.508316 (+771315us) service_pool.cc:224] Handling call
0709 12:59:19.508639 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.551458 (+ 42819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.957335 (+405877us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54002d6ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:19.957510 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82598144}
I20260709 12:59:19.965377  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:19.967187  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:19.918366  3890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.762s	user 0.029s	sys 0.007s
I20260709 12:59:19.930229  4065 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.982745  4065 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.861442  4023 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:19.985015  4065 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.985523  4065 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.985939  4065 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.958133  4080 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:19.930637  4051 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:19.986830  1532 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.940657  2301 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.930272  3896 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.989358  2307 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:19.945432  3882 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.993472  4083 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:19.996105  4065 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:19.958719  1539 rpcz_store.cc:276] 0709 12:59:18.677795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.744326 (+ 66531us) service_pool.cc:224] Handling call
0709 12:59:18.744712 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:19.063087 (+318375us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:19.370252 (+307165us) log.cc:844] Serialized 14 byte log entry
0709 12:59:19.773215 (+402963us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:19.795378 (+ 22163us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.795539 (+   161us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:19.795582 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.795658 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:19.957923 (+162265us) raft_consensus.cc:1685] finished
0709 12:59:19.957945 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.958094 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15022,"prepare.queue_time_us":36290,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":97758,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8285,"thread_start_us":834148,"threads_started":3,"wal-append.queue_time_us":346910}
I20260709 12:59:19.945349  4017 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.000144  1535 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:19.927666  3875 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:59:19.924794  3992 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.009932  3992 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:20.010896  1612 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:20.011693  4017 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.012135  4017 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.001852  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:19.979592  3890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.841s	user 0.029s	sys 0.007s
I20260709 12:59:19.929548  4055 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:19.980820  3915 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:20.005069  3882 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.005280  3896 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.018682  1532 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:20.004582  4051 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:20.043430  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.003520  2305 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:19.998564  3919 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:20.017766  3890 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:19.990592  4026 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.039754  4082 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:20.045876  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:20.013253  1537 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:20.048452  1607 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:20.100666  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 158846us
W20260709 12:59:20.135628  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 172215us
I20260709 12:59:20.136729  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:20.137885  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:20.138648  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:20.050335  4089 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.119334  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 105440us
I20260709 12:59:20.002056  4080 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:20.146966  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2101) took 1431 ms (client timeout 1667 ms). Trace:
W20260709 12:59:20.148957  1533 rpcz_store.cc:269] 0709 12:59:18.709796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.711210 (+  1414us) service_pool.cc:224] Handling call
0709 12:59:20.045715 (+1334505us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800002a98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26e9c 00007f8d55b26a5b 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 12:59:20.141261 (+ 95546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5794688}
I20260709 12:59:20.131120  4026 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:20.145408  4031 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:20.179497  3915 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:20.180706  4040 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:20.184973  4084 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:59:20.190024  3896 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.190181  4008 raft_consensus.cc:3055] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:20.195744  4071 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:59:20.195182  3974 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.196585  3890 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.200030  4083 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:20.200762  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 368) took 1544 ms. Trace:
I20260709 12:59:20.201633  3882 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.169574  4026 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.146751  4088 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:20.203171  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:20.206696  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 285) took 1095 ms. Trace:
I20260709 12:59:20.207334  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2056) took 1532 ms. Trace:
I20260709 12:59:20.210065  4025 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:20.211673  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.213558  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:20.259554  1611 rpcz_store.cc:276] 0709 12:59:18.674898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.675001 (+   103us) service_pool.cc:224] Handling call
0709 12:59:18.717599 (+ 42598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.383879 (+666280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.207126 (+823247us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54002887d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:20.207279 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530283264}
I20260709 12:59:20.262034  1609 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:20.215051  4055 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.216543  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:20.217484  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:20.218070  4087 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:59:20.219609  3822 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.004s
I20260709 12:59:20.220098  2306 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:20.226935  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.140982  4003 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:59:20.255445  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:20.274197  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 367) took 1641 ms. Trace:
I20260709 12:59:20.147773  4007 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:20.144570  3992 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.274680  2306 rpcz_store.cc:276] 0709 12:59:18.629200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.634409 (+  5209us) service_pool.cc:224] Handling call
0709 12:59:19.590711 (+956302us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b5800075f98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:20.219590 (+628879us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800075f98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26e9c 00007f8d55b26a5b 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:20.219835 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.268866 (+ 49031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.269050 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17916032}
I20260709 12:59:20.235286  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:20.240962  1540 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:20.277204  1616 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:20.246690  2308 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:20.247254  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:20.247422  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 72997.1us
I20260709 12:59:20.251987  2307 rpcz_store.cc:276] 0709 12:59:18.656506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.663569 (+  7063us) service_pool.cc:224] Handling call
0709 12:59:20.200529 (+1536960us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000ee2d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:20.200663 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940064640}
I20260709 12:59:20.243083  4031 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:20.258844  1615 rpcz_store.cc:276] 0709 12:59:19.110915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.145708 (+ 34793us) service_pool.cc:224] Handling call
0709 12:59:19.162684 (+ 16976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.474392 (+311708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.206456 (+732064us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540009abd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:20.206640 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622727040}
I20260709 12:59:20.213806  4009 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.263758  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:20.264467  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:20.265671  1613 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:20.249750  4008 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:20.244149  4035 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:59:20.254679  3875 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.178889  4089 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.229444  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 353) took 1650 ms. Trace:
W20260709 12:59:20.273561  1506 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.605s (SENT)
W20260709 12:59:20.231355  4048 consensus_meta.cc:287] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.003s
I20260709 12:59:20.246364  3991 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.147480  3999 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:20.244611  4078 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.261353  4083 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.329885  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1471) took 1578 ms. Trace:
I20260709 12:59:20.330538  1539 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:20.330549  4081 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:59:20.265650  4088 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:20.271731  3966 consensus_meta.cc:287] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.004s
I20260709 12:59:20.275902  4020 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:20.376601  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.400257  4038 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.320292  4039 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:20.400847  1609 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:20.380393  4085 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.225s	user 0.003s	sys 0.000s
W20260709 12:59:20.376767  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 113088us
W20260709 12:59:20.449509  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 313701us
I20260709 12:59:20.450441  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:20.344125  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.297462  4007 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:20.423930  3993 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.444820  4100 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:20.413182  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:20.299485  3992 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:20.416260  4091 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:59:20.416620  4094 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:20.416679  4048 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.423846  1538 rpcz_store.cc:276] 0709 12:59:18.751894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.758462 (+1006568us) service_pool.cc:224] Handling call
0709 12:59:19.780578 (+ 22116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:19.795682 (+ 15104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.795720 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:19.798851 (+  3131us) log.cc:844] Serialized 26 byte log entry
0709 12:59:19.914880 (+116029us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:19.914935 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.915022 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:20.329620 (+414598us) raft_consensus.cc:1685] finished
0709 12:59:20.329643 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:20.329806 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8627,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":5607,"thread_start_us":71421,"threads_started":1,"wal-append.queue_time_us":141391}
I20260709 12:59:20.410094  4055 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.414528  2304 rpcz_store.cc:276] 0709 12:59:18.578705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.589327 (+ 10622us) service_pool.cc:224] Handling call
0709 12:59:20.229215 (+1639888us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400650254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:20.229380 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595709184}
I20260709 12:59:20.434250  4097 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:20.434592  3915 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:20.435194  4088 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.436056  4082 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:20.438014  4083 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:20.438666  4008 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.439508  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.440299  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.441464  4078 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.442638  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:20.495667  1681 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.443358  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.444048  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.431753  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:20.418721  3999 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.300714  4031 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.451817  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:20.453773  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.453924  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:20.397193  4025 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.456317  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:20.402194  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 72929.7us
I20260709 12:59:20.456339  2307 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:20.458546  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.418725  3875 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:20.472553  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 199026us
W20260709 12:59:20.456446  3987 consensus_meta.cc:287] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.002s
I20260709 12:59:20.451319  3882 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.444929  3966 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.455955  3822 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:20.481329  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:20.592739  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 141026us
I20260709 12:59:20.492468  1687 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:20.503532  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49678.7us
I20260709 12:59:20.505610  1683 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
W20260709 12:59:20.527165  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.530948  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.448132  4020 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.476296  4055 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.475883  4023 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:20.496431  1686 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:20.484596  4080 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:20.595675  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.566165  3999 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.468886  4017 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.596722  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:20.459864  4039 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.494565  4035 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:20.585765  4078 raft_consensus.cc:2764] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:20.584789  4049 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:20.606200  2310 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:20.469764  4038 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.490784  3915 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.616585  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:20.630774  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:20.587594  3974 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.597653  4008 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.625519  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:20.600654  4055 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.599174  4064 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.629822  4104 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.493803  4094 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:20.634207  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 144136us
I20260709 12:59:20.601292  4046 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:20.621490  4049 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.501642  4082 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.608719  4108 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.626592  4023 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.643945  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:20.596367  3987 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.472519  4100 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.598341  3882 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:20.643337  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 156077us
I20260709 12:59:20.653015  1533 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.494024  4097 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.642954  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:20.648818  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:20.623884  4035 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.648630  4049 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:20.655289  3991 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:20.661916  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:20.713390  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 75151.7us
I20260709 12:59:20.698977  4040 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.720604  1538 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:20.700371  2303 raft_consensus.cc:2376] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4. Re-sending same reply.
I20260709 12:59:20.729077  2307 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:20.732769  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:20.732892  4106 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.656894  4064 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.663029  4023 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.630261  4007 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.725683  4089 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.657258  4108 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.730856  4048 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:20.738899  2304 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.758785  1538 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:20.655143  4104 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.725888  4040 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.731858  4076 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.741233  4078 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:20.759938  3875 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:20.767709  3992 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.765039  4095 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:20.801193  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 320228us
I20260709 12:59:20.802225  4118 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.803010  4118 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.804610  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:20.805593  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:20.806280  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.804672  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:20.802125  4021 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.755721  4106 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.783504  4076 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:20.929242  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1367) took 1833 ms. Trace:
I20260709 12:59:21.044399  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1473) took 1192 ms. Trace:
I20260709 12:59:20.928170  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1467) took 2188 ms. Trace:
W20260709 12:59:20.802831  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.968690  1533 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
W20260709 12:59:21.012787  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1458) took 2293 ms (client timeout 2090 ms). Trace:
I20260709 12:59:20.808089  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.809015  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.807557  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.048205  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 228) took 2296 ms. Trace:
I20260709 12:59:21.101151  1539 rpcz_store.cc:276] 0709 12:59:18.752148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.007637 (+1255489us) service_pool.cc:224] Handling call
0709 12:59:20.330314 (+322677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.423536 (+ 93222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.048005 (+624469us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540040d8d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:21.048144 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741302656}
I20260709 12:59:20.807081  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.806692  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.808619  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.789047  3966 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:20.846571  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:20.997866  1681 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:21.100034  1534 rpcz_store.cc:269] 0709 12:59:18.715173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.354681 (+639508us) service_pool.cc:224] Handling call
0709 12:59:21.008020 (+1653339us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b54003b3654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:21.008163 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90779904}
I20260709 12:59:21.222766  1533 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:59:21.223483  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 99252.7us
I20260709 12:59:21.097079  1607 rpcz_store.cc:276] 0709 12:59:19.095514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.095653 (+   139us) service_pool.cc:224] Handling call
0709 12:59:19.120656 (+ 25003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.134169 (+1013513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.928967 (+794798us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54000dbbd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:20.929163 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133287168}
I20260709 12:59:21.097820  1541 rpcz_store.cc:276] 0709 12:59:18.739939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.606781 (+866842us) service_pool.cc:224] Handling call
0709 12:59:19.615287 (+  8506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.721567 (+106280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.927822 (+1206255us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400075654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:20.928064 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242731264}
W20260709 12:59:21.104517  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 249961us
W20260709 12:59:21.224504  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.228698  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.809242  3890 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.229605  3890 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.227955  2275 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:21.230383  2302 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:59:20.921940  4115 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:59:21.250015  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:20.885586  4026 consensus_meta.cc:287] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.007s
I20260709 12:59:20.798146  4017 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.250576  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:20.928539  3707 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:21.332361  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.339020  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.386152  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.388365  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:21.368599  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1362) took 2844 ms (client timeout 1953 ms). Trace:
I20260709 12:59:20.928952  4094 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:21.299721  1539 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:20.892351  3987 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:20.985338  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.392133  1683 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:20.916678  4104 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:20.929379  4082 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:21.222041  3999 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.003s
W20260709 12:59:21.007099  2301 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.002s	user 0.003s	sys 0.007s
I20260709 12:59:21.060847  4090 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:21.100682  1688 raft_consensus.cc:2410] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:21.047793  3992 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.366003  4051 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:21.429210  1613 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:21.419709  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:20.987716  4112 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:59:21.306753  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:21.488853  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.052954  4039 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.489043  4108 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.489477  1613 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:21.489128  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.489077  1609 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.490365  1681 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:21.490603  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:20.878544  4048 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:21.491420  4048 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.491462  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.493309  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.493921  4048 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:21.366377  4009 consensus_meta.cc:287] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.005s
I20260709 12:59:21.048089  4003 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:21.385942  4049 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.001s
W20260709 12:59:21.433353  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 205472us
I20260709 12:59:21.391700  4026 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.505813  2275 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:21.486617  4055 consensus_meta.cc:287] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.837s	user 0.012s	sys 0.000s
I20260709 12:59:20.855659  3915 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:21.428326  1608 rpcz_store.cc:269] 0709 12:59:18.524399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.525335 (+   936us) service_pool.cc:224] Handling call
0709 12:59:21.368408 (+2843073us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400320854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:21.368532 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791696256}
W20260709 12:59:21.511852  1581 connection.cc:256] RPC call timeout handler was delayed by -1.1210359930000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:59:21.399313  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 552819us
I20260709 12:59:21.047564  4022 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:20.920717  4035 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.528280  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:21.437788  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.438428  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.043849  4118 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.439379  1684 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:21.532742  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:21.530815  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.529171  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:21.358421  3989 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.358711  3883 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.338617  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:21.545926  1607 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.850103  3882 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.105578  2304 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:21.442261  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.442829  1616 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:20.921386  4100 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.383343  4083 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.891803  4089 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:21.382090  4076 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:21.538209  3706 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:20.811614  4095 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.251061  4111 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.230s
I20260709 12:59:21.444428  4097 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.324748  3974 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:21.399130  1682 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:21.428423  3707 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:21.485338  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.433887  4117 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:21.432873  4038 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.222486  4078 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.493953  1681 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:21.607131  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.225026  4021 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:20.845778  3875 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:21.439508  4046 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:21.625365  4123 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:59:21.626979  4111 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:21.627521  4111 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:21.628685  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.007252  4031 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.250118  4075 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.506960  2275 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:21.632629  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 125763us
I20260709 12:59:21.048435  4027 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.603511  4097 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:21.520670  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:21.635012  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 114490us
I20260709 12:59:21.637006  1609 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:21.097620  1532 rpcz_store.cc:276] 0709 12:59:19.851622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.955583 (+103961us) service_pool.cc:224] Handling call
0709 12:59:21.044165 (+1088582us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b54003b4554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:21.044333 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62257408}
I20260709 12:59:21.639250  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.537598  1610 raft_consensus.cc:2410] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:21.538424  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.539072  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.539848  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:21.544468  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:21.641019  1608 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:21.641283  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 96928.6us
W20260709 12:59:21.524441  4008 consensus_meta.cc:287] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.873s	user 0.012s	sys 0.000s
I20260709 12:59:21.512135  4039 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:21.661168  1690 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:21.480154  3999 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:21.665755  4134 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:21.667369  3999 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.549324  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.668090  1684 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.669046  2308 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [4.6-8.8]
I20260709 12:59:21.669159  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.512689  2301 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:21.499069  4090 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.502054  4051 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.549031  3883 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.497643  3992 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.461127  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.593628  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.547597  3987 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:21.509846  4049 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.528507  4094 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:59:21.677336  3987 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:21.675940  4011 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.678120  4011 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.678392  3987 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.595284  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:21.524663  4055 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.598584  1616 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:21.612376  4078 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.600905  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.510082  4003 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.604679  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.684113  4049 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.686529  4055 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:21.578388  4040 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.607885  1681 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:21.612757  1685 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 3.
I20260709 12:59:21.688437  4090 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.545327  4022 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.588333  4089 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.689236  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.549598  3989 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.689973  1681 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.647364  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.652558  3707 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:21.654956  4086 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.495s	user 0.006s	sys 0.008s
I20260709 12:59:21.657109  3890 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.692775  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 233) took 1840 ms. Trace:
I20260709 12:59:21.658011  4026 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.658349  4031 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.658730  2306 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.604076  3974 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.631353  3875 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.707319  3875 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.659230  4046 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:21.707952  4046 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:21.708420  4046 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.659595  1686 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:21.659814  4088 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:21.642655  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:21.646510  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:21.587729  4083 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.665441  2275 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:21.550071  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.712994  1611 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:21.713130  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67314.6us
I20260709 12:59:21.670449  1607 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:21.672935  1688 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:21.675738  1538 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:21.680490  1532 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:21.688263  1613 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:21.689147  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.647347  3706 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:21.692363  3707 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.714718  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.699851  4090 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.692951  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.668215  4097 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.696435  1682 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:21.697613  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 102416us
I20260709 12:59:21.643185  4075 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.717698  1689 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:21.718189  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.718377  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:21.690685  1539 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:21.699378  4118 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:21.709187  1684 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:21.711550  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65162.6us
I20260709 12:59:21.723791  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:21.723905  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.714092  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:21.715381  1538 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 2: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:21.715298  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:21.716107  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73578.4us
I20260709 12:59:21.724967  1615 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.692766  4089 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.702926  4117 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:21.694576  1541 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:21.697862  1537 rpcz_store.cc:276] 0709 12:59:19.852589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.140049 (+287460us) service_pool.cc:224] Handling call
0709 12:59:20.150307 (+ 10258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.234870 (+ 84563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:20.234926 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:20.234986 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:20.235030 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.692553 (+1457523us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400073854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:21.692601 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:21.692720 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193920896}
I20260709 12:59:21.703220  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 349) took 3555 ms. Trace:
I20260709 12:59:21.721472  4083 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.722533  1534 raft_consensus.cc:2410] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:21.730232  2306 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:21.725703  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:21.731465  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:21.733230  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.735805  1616 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.736016  1688 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:21.734457  1681 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:21.734200  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:21.696811  4111 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:21.737743  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:21.738580  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.738797  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.740123  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:21.741479  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.723019  3706 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.742983  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:21.743530  4075 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.744943  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:21.745477  1539 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.745870  2275 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:21.746170  2275 leader_election.cc:403] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:59:21.747236  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.731593  4088 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.723318  4118 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:21.727473  4017 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:21.750329  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:21.751339  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.731868  4040 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:21.732048  4033 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:21.755895  4140 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:21.727730  4026 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:21.790726  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:21.749446  4083 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:21.726737  4090 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:21.792383  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:21.793897  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.748951  3875 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:21.753985  3999 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:21.751888  4088 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.798612  1537 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:21.798707  4106 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.799279  4128 raft_consensus.cc:2764] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:21.799875  3974 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.804618  4026 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.806691  1615 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:21.807386  1581 leader_election.cc:400] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:21.739496  4073 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:59:21.754937  4017 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.732196  2301 rpcz_store.cc:276] 0709 12:59:18.136605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.137014 (+   409us) service_pool.cc:224] Handling call
0709 12:59:18.141493 (+  4479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.891823 (+1750330us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b58006d07d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58ba70aa 00007f8d58c29447 00007f8d58c41fe7 00007f8d58c437de 00007f8d58c4db49 00007f8d58c4e416 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4
0709 12:59:21.671621 (+1779798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.690902 (+ 19281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211554048}
I20260709 12:59:21.792929  4007 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.807119  4038 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:21.813643  3860 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:21.813763  1537 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:21.814178  4039 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.804661  4078 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:21.795637  4125 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:22.338505  1616 consensus_meta.cc:287] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.001s
I20260709 12:59:22.339263  1616 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:22.339285  3860 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:22.340916  4038 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.341624  3860 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:21.997414  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.321933  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.343266  1608 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:22.343917  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.344337  3890 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:22.339180  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.344785  3890 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:22.338603  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:22.345289  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:21.861368  4075 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.345743  3890 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.345670  1610 raft_consensus.cc:2376] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5. Re-sending same reply.
I20260709 12:59:22.346784  4075 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:22.347280  3890 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:21.963414  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.349285  4031 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.349895  4031 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.342770  3860 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:21.819891  4137 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:22.352936  4031 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:21.807585  4064 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:21.843726  4118 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.340402  1581 leader_election.cc:403] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:59:22.359432  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 561444us
I20260709 12:59:22.359505  3707 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:21.816486  4088 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.338593  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:21.809149  4027 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:22.343340  1537 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:22.373776  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.037704  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.382802  1538 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:59:22.339510  4039 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:22.391511  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1472) took 2540 ms (client timeout 2185 ms). Trace:
I20260709 12:59:21.834708  1539 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:22.353518  4017 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:21.807265  3875 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:22.090284  4141 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 12:59:22.391991  1540 rpcz_store.cc:269] 0709 12:59:19.851285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.947506 (+ 96221us) service_pool.cc:224] Handling call
0709 12:59:22.391326 (+2443820us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001b6cd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.391442 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397793536}
I20260709 12:59:22.339900  4007 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.394281  1688 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:22.399971  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:22.400555  1688 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.398068  1537 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.402349  1537 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.859324  4020 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.385739  4027 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.092782  3989 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.390851  4125 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.343271  4038 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.385634  4090 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:22.397135  3915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.009s
I20260709 12:59:22.396668  3875 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:22.413018  3706 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
I20260709 12:59:22.406306  4125 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:22.415436  4098 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 2.022s	user 0.008s	sys 0.015s
W20260709 12:59:22.417922  4046 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.002s
I20260709 12:59:22.418387  4046 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.413470  4039 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:22.401466  4127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.008s
W20260709 12:59:22.422350  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 328454us
I20260709 12:59:22.385555  4026 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:22.406944  3915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.003s	sys 0.009s
I20260709 12:59:22.405604  4027 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:22.405885  4020 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.413498  3706 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:22.432555  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.417933  3930 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.434728  1688 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:22.426502  3959 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.436987  1537 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:22.445262  1537 pending_rounds.cc:85] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 5
I20260709 12:59:22.445556  1537 pending_rounds.cc:107] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 12:59:22.429425  4127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.008s
I20260709 12:59:22.445879  1537 raft_consensus.cc:2889] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:22.487696  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.444094  4026 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.432974  4106 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:22.435179  4073 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.506557  1688 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:22.447072  3987 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:22.537683  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.444305  4075 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.551690  4149 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.552558  4149 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.555945  4149 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:22.556970  4143 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:22.534461  4106 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.579721  4106 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.436316  4020 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.540361  4073 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.581727  4020 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.589131  4007 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.611774  3998 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.611897  4046 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.583801  4073 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.616806  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.558772  4047 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:22.619902  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.620692  1607 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:22.546830  3987 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.628571  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:22.616067  4093 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.337s	user 0.002s	sys 0.048s
I20260709 12:59:22.629590  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.615710  3706 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.631595  1688 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:22.618075  4149 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.572737  4125 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.621417  4047 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:22.634884  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.636417  1607 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [5.4-6.5]
W20260709 12:59:22.631333  4093 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.357s	user 0.002s	sys 0.049s
I20260709 12:59:22.641805  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.642382  1688 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:22.613329  3998 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.643971  1611 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.645884  4125 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.646977  1536 raft_consensus.cc:2410] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:22.650259  4065 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.650902  4065 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.655967  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 662) took 4040 ms. Trace:
I20260709 12:59:22.638288  4149 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.632244  4017 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.656435  2310 rpcz_store.cc:276] 0709 12:59:18.615905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.616026 (+   121us) service_pool.cc:224] Handling call
0709 12:59:20.229819 (+1613793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:20.621232 (+391413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.653421 (+2032189us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400650254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:22.655750 (+  2329us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400650250. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.655902 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4576039168}
I20260709 12:59:22.661597  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.683728  3691 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.655725  3875 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.636335  3706 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.698333  3905 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.700544  4025 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.700963  3905 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.701092  4025 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.701587  3422 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.702066  3422 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.698014  3930 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.703001  3905 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.703253  4075 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:22.703097  3930 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.703542  3905 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:22.704072  3905 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.705128  3930 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.703109  4025 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.706473  3905 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.706604  2301 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.706748  2305 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:22.707836  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:22.693743  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 295) took 2234 ms (client timeout 1557 ms). Trace:
I20260709 12:59:22.718089  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:22.718815  2305 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
W20260709 12:59:22.709990  1690 rpcz_store.cc:269] 0709 12:59:20.459339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.459575 (+   236us) service_pool.cc:224] Handling call
0709 12:59:22.693530 (+2233955us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002a67d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.693634 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455850368}
I20260709 12:59:22.724155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.724788  1688 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:22.725230  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1453) took 1618 ms. Trace:
I20260709 12:59:22.725521  1688 rpcz_store.cc:276] 0709 12:59:21.106964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.685844 (+1578880us) service_pool.cc:224] Handling call
0709 12:59:22.725178 (+ 39334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:22.708511  2304 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:22.703797  4075 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.703989  3422 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.723664  4025 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:22.696214  4021 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.733126  1612 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.734187  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.734508  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:22.735101  1610 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.719707  3706 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.695621  4003 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.723412  3905 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.737969  3875 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.733845  4025 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:22.741077  3987 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.743148  3905 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:22.744426  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.744563  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:22.745144  3905 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.745412  1616 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:22.745499  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.746505  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.746800  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.747121  1616 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:22.748054  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.748646  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:22.748900  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1463) took 1076 ms. Trace:
I20260709 12:59:22.749311  1688 rpcz_store.cc:276] 0709 12:59:21.672506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.747854 (+1075348us) service_pool.cc:224] Handling call
0709 12:59:22.748841 (+   987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:22.750198  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.750439  1612 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:22.750855  4025 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.751483  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:22.752214  1612 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.747929  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.745167  1608 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:22.748004  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.757696  1616 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:22.755771  4027 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.760428  1610 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:22.760630  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.767488  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1394) took 1329 ms. Trace:
I20260709 12:59:22.763819  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.768312  1540 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:22.769274  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.769948  1540 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:22.770601  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:22.762480  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.772943  1537 raft_consensus.cc:2410] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:22.773885  1612 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:22.774590  1610 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:59:22.777921  1610 pending_rounds.cc:85] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 2
I20260709 12:59:22.778227  1610 pending_rounds.cc:107] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:59:22.778501  1610 raft_consensus.cc:2889] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:22.781004  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.782064  1690 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:22.781876  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.782922  1541 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:22.768070  1613 rpcz_store.cc:276] 0709 12:59:21.438299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.490393 (+ 52094us) service_pool.cc:224] Handling call
0709 12:59:22.767272 (+1276879us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003f3754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.767408 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452959616}
I20260709 12:59:22.785725  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1266) took 1039 ms. Trace:
I20260709 12:59:22.786283  1690 rpcz_store.cc:276] 0709 12:59:21.746256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.736581 (+990325us) service_pool.cc:224] Handling call
0709 12:59:22.785640 (+ 49059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:22.788516  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.788915  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.789557  1538 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:22.790961  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.791924  1616 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:22.789559  1613 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 2.
I20260709 12:59:22.800751  1608 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:22.801411  1609 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:22.803313  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:22.807597  1687 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:22.808121  4082 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.808668  4082 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:22.809984  1566 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:33233 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:33233 timed out after 15.000s (SENT)
I20260709 12:59:22.811465  4027 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.812345  4082 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.813462  4075 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.814464  4095 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.750890  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 301) took 1022 ms. Trace:
I20260709 12:59:22.816668  1688 rpcz_store.cc:276] 0709 12:59:21.728805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.749952 (+1021147us) service_pool.cc:224] Handling call
0709 12:59:22.750834 (+   882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:22.818737  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.822342  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2124) took 1284 ms. Trace:
I20260709 12:59:22.822865  1532 rpcz_store.cc:276] 0709 12:59:21.538241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.638910 (+100669us) service_pool.cc:224] Handling call
0709 12:59:22.822116 (+1183206us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b5400074c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.822266 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93137792}
I20260709 12:59:22.825400  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.834133  4149 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:22.835426  4017 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:22.840510  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.841189  1537 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:22.842041  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:22.842646  1537 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:22.860301  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.798058  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:22.922343  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1254) took 2115 ms (client timeout 1528 ms). Trace:
I20260709 12:59:22.935513  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1264) took 1189 ms. Trace:
I20260709 12:59:22.933754  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.793324  4088 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:22.937351  1538 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:22.936571  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1263) took 1191 ms. Trace:
I20260709 12:59:22.937949  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.935783  4111 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:22.860739  2306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 669) took 2413 ms (client timeout 2362 ms). Trace:
I20260709 12:59:22.872877  1535 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:22.938308  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:22.891639  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1452) took 1812 ms (client timeout 1658 ms). Trace:
I20260709 12:59:22.965945  1535 pending_rounds.cc:85] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 3
I20260709 12:59:22.966393  1535 pending_rounds.cc:107] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:22.938687  1616 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:22.894680  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:22.935426  1683 rpcz_store.cc:269] 0709 12:59:20.807351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.807845 (+   494us) service_pool.cc:224] Handling call
0709 12:59:22.922086 (+2114241us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400118354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.922255 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670991232}
W20260709 12:59:22.863773  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.937965  1682 rpcz_store.cc:276] 0709 12:59:21.745485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.932690 (+1187205us) service_pool.cc:224] Handling call
0709 12:59:22.936503 (+  3813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:22.966799  1535 raft_consensus.cc:2889] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:22.966158  1686 rpcz_store.cc:269] 0709 12:59:21.079085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.434257 (+355172us) service_pool.cc:224] Handling call
0709 12:59:22.891399 (+1457142us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b540032dcd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.891546 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220984192}
I20260709 12:59:23.360685  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.361948  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2119) took 1844 ms. Trace:
W20260709 12:59:22.871564  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1456) took 4157 ms (client timeout 2728 ms). Trace:
I20260709 12:59:23.430878  2305 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:23.415127  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 663) took 3081 ms. Trace:
I20260709 12:59:23.004544  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.890139  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.048462  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:22.888075  1437 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.512061  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1469) took 1147 ms. Trace:
I20260709 12:59:23.203734  4103 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:22.875890  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2115) took 2257 ms. Trace:
I20260709 12:59:22.933030  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:23.003743  4107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.279s	user 0.009s	sys 0.024s
W20260709 12:59:23.514978  4107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.804s	user 0.010s	sys 0.043s
I20260709 12:59:23.270267  4022 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:23.277573  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:23.215497  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.516304  1681 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.516706  1684 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 1.
I20260709 12:59:23.517333  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1467) took 1154 ms. Trace:
I20260709 12:59:23.517710  1684 rpcz_store.cc:276] 0709 12:59:22.362900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.215189 (+852289us) service_pool.cc:224] Handling call
0709 12:59:23.517279 (+302090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.519133  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1446) took 2441 ms. Trace:
I20260709 12:59:23.539036  1684 rpcz_store.cc:276] 0709 12:59:21.077389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.518404 (+2441015us) service_pool.cc:224] Handling call
0709 12:59:23.518681 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.518857 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.518880 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:23.518916 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:23.518942 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.518990 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.519083 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.541472  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1474) took 3689 ms. Trace:
I20260709 12:59:23.542105  1535 rpcz_store.cc:276] 0709 12:59:19.851934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.013957 (+162023us) service_pool.cc:224] Handling call
0709 12:59:22.872483 (+2858526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.429800 (+557317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.541210 (+111410us) spinlock_profiling.cc:243] Waited 2.86 s on lock 0x7b54003b4050. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:23.541387 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6573809408}
I20260709 12:59:23.273999  3992 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:23.206246  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1245) took 2401 ms (client timeout 1589 ms). Trace:
I20260709 12:59:23.476836  4118 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.205477  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.062448  2302 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:23.552981  1538 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:23.553438  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.276407  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.554883  2309 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:23.183030  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:22.969276  1609 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:23.557044  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.557826  1609 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:23.558885  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.940181  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:23.560863  1613 raft_consensus.cc:2368] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6.
I20260709 12:59:23.515116  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:23.493261  1656 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 2.001s (SENT) [suppressed 19 similar messages]
I20260709 12:59:23.514211  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.936123  1690 rpcz_store.cc:276] 0709 12:59:21.745751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.787090 (+1041339us) service_pool.cc:224] Handling call
0709 12:59:22.935448 (+148358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.522691  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.495209  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.524446  1537 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 2.
I20260709 12:59:22.786934  1540 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:23.482188  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1243) took 2678 ms (client timeout 1605 ms). Trace:
I20260709 12:59:22.870235  4097 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:23.525470  1681 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
W20260709 12:59:23.525842  2310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.005s	sys 0.024s
W20260709 12:59:23.566680  2310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.005s	sys 0.024s
W20260709 12:59:23.564302  1687 rpcz_store.cc:269] 0709 12:59:20.804274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.804387 (+   113us) service_pool.cc:224] Handling call
0709 12:59:23.481970 (+2677583us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540035af54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:23.482102 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3751752064}
W20260709 12:59:23.430893  1536 rpcz_store.cc:269] 0709 12:59:18.714661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.191621 (+476960us) service_pool.cc:224] Handling call
0709 12:59:22.871248 (+3679627us) spinlock_profiling.cc:243] Waited 3.45 s on lock 0x7b54003b4054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.871460 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7944007936}
I20260709 12:59:23.518721  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:22.934880  4047 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:23.514979  2306 rpcz_store.cc:269] 0709 12:59:20.448588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.448706 (+   118us) service_pool.cc:224] Handling call
0709 12:59:22.860437 (+2411731us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54005f50d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:22.860585 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507965824}
I20260709 12:59:23.430534  1534 rpcz_store.cc:276] 0709 12:59:21.517408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.518010 (+   602us) service_pool.cc:224] Handling call
0709 12:59:23.361623 (+1843613us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b540040d3d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:23.361853 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188150144}
I20260709 12:59:22.974478  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:23.004187  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 285701us
I20260709 12:59:22.882128  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.572649  1532 raft_consensus.cc:2393] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:23.366796  4051 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:23.513384  1533 rpcz_store.cc:276] 0709 12:59:20.618379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.224106 (+605727us) service_pool.cc:224] Handling call
0709 12:59:21.224389 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.494557 (+270168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.494589 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:21.494639 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:21.494676 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.875595 (+1380919us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002c7254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:22.875658 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:22.875813 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620939008}
W20260709 12:59:23.531695  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.573431  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.573902  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1459) took 2049 ms. Trace:
I20260709 12:59:23.574021  1536 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:23.574815  4081 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.574302  1690 rpcz_store.cc:276] 0709 12:59:21.524319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.567934 (+2043615us) service_pool.cc:224] Handling call
0709 12:59:23.573453 (+  5519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.573622 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.573648 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:23.573687 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:23.573717 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.573762 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.573853 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.575073  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.575508  4081 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:23.575845  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.576534  1690 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:23.576694  4107 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.512611  1689 rpcz_store.cc:276] 0709 12:59:22.364218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.889867 (+525649us) service_pool.cc:224] Handling call
0709 12:59:23.511989 (+622122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.577729  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.578145  4081 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:23.514673  2308 rpcz_store.cc:276] 0709 12:59:20.333762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.334065 (+   303us) service_pool.cc:224] Handling call
0709 12:59:20.334391 (+   326us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:21.669623 (+1335232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.355990 (+1686367us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001fb8d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:23.415020 (+ 59030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3068826368}
I20260709 12:59:23.578425  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:22.973111  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.578799  3998 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:22.976007  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.579123  1534 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:23.579923  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.570104  1610 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 2.
I20260709 12:59:23.580951  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:23.581120  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:23.581851  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.581995  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.582551  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:23.089700  4011 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:23.580031  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.535356  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.009s	sys 0.000s
I20260709 12:59:23.543761  4022 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:23.516765  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.534895  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:22.965047  3989 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:23.569577  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.549662  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.535506  3707 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:23.581143  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.586200  3707 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:23.586655  4094 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:23.587226  1608 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:23.583323  3887 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.587894  3992 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:23.583376  1684 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:23.588596  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.588862  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1449) took 2510 ms. Trace:
W20260709 12:59:23.583829  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.009s	sys 0.001s
I20260709 12:59:23.578447  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.589859  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.583702  1534 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:23.495752  1611 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:23.590510  2301 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:23.590835  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.591406  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:23.584826  3959 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.563122  1541 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:23.592097  3959 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:23.585395  2303 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:23.593077  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.523140  4103 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:23.592499  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.595935  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:22.872215  4023 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:23.170060  3883 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:23.567842  1687 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:23.568126  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1470) took 1011 ms. Trace:
I20260709 12:59:23.585136  3989 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:23.596925  1687 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:23.597054  1683 rpcz_store.cc:276] 0709 12:59:22.556668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.518191 (+961523us) service_pool.cc:224] Handling call
0709 12:59:23.568070 (+ 49879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260709 12:59:23.597756  1687 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:23.598093  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:23.598503  3989 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:23.598620  1687 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:23.574817  4047 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:23.497614  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.600592  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.529695  1614 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:23.601675  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.514714  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:23.602295  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.602435  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 303) took 1873 ms. Trace:
I20260709 12:59:23.602769  1686 rpcz_store.cc:276] 0709 12:59:21.729312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.514464 (+1785152us) service_pool.cc:224] Handling call
0709 12:59:23.602369 (+ 87905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.603312  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.604022  1614 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:23.584360  1616 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:23.590355  1681 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:23.584774  4022 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.525270  4079 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.529744  4046 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.565237  1688 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:23.585934  2304 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:23.584992  4051 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:23.577347  4107 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:23.584882  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50108.8us
I20260709 12:59:23.594959  1682 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:23.595665  4103 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:23.575948  1535 raft_consensus.cc:2410] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:23.591950  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.601675  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.612011  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:23.623950  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1450) took 2545 ms. Trace:
I20260709 12:59:23.108517  4065 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:23.624305  1688 rpcz_store.cc:276] 0709 12:59:21.078515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.513975 (+2435460us) service_pool.cc:224] Handling call
0709 12:59:23.623895 (+109920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.582988  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:23.563843  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.587939  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:23.565456  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.547951  1685 rpcz_store.cc:269] 0709 12:59:20.804878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.806860 (+  1982us) service_pool.cc:224] Handling call
0709 12:59:23.206020 (+2399160us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400255b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:23.206157 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173239680}
I20260709 12:59:23.605506  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:23.645539  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 59594.7us
I20260709 12:59:23.680663  1536 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:23.680882  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.589210  1684 rpcz_store.cc:276] 0709 12:59:21.078249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.540210 (+2461961us) service_pool.cc:224] Handling call
0709 12:59:23.540524 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.588630 (+ 48106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.588812 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.578445  1690 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:23.682240  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 94378.8us
I20260709 12:59:23.610216  1610 raft_consensus.cc:2410] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:23.684039  1539 raft_consensus.cc:2410] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:23.604125  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1466) took 1242 ms. Trace:
I20260709 12:59:23.623239  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1465) took 1261 ms. Trace:
I20260709 12:59:23.682932  1612 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:23.684583  1682 rpcz_store.cc:276] 0709 12:59:22.361524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.570606 (+1209082us) service_pool.cc:224] Handling call
0709 12:59:23.570857 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.623010 (+ 52153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.623188 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.684485  1686 rpcz_store.cc:276] 0709 12:59:22.362230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.603337 (+1241107us) service_pool.cc:224] Handling call
0709 12:59:23.603645 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.603816 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.603841 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:23.603885 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:23.603916 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.603965 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.604073 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:23.583271  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.682072  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1461) took 2079 ms. Trace:
I20260709 12:59:23.585881  2305 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:23.682530  1613 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:23.626385  1687 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:59:23.617436  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 218) took 18427 ms (client timeout 15000 ms). Trace:
I20260709 12:59:23.688755  1611 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:23.624752  1507 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:23.690414  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:23.692842  1684 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:23.617234  3959 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:23.754885  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:23.689527  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:23.686569  1681 rpcz_store.cc:276] 0709 12:59:21.602666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.571157 (+1968491us) service_pool.cc:224] Handling call
0709 12:59:23.571424 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.681826 (+110402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.682014 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.756002  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.679190  4011 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:23.757285  1684 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:23.757254  4011 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:23.758248  4011 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:23.704548  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.689015  1541 raft_consensus.cc:2410] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:23.694116  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.745595  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.763389  2309 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:23.691540  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:23.696062  1683 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:23.691776  4103 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.692104  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.684315  4046 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:23.691020  3883 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:23.773763  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.774621  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.775275  1533 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:23.777031  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.777747  1538 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:23.778515  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.779018  1538 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:23.779801  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.690725  1653 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:23.696859  1682 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:23.706664  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 81981.8us
W20260709 12:59:23.752696  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 62347.1us
I20260709 12:59:23.789289  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:23.790490  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:23.747936  1688 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:23.692555  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.705592  4111 consensus_meta.cc:287] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.000s
I20260709 12:59:23.733650  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:23.792945  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 102293us
I20260709 12:59:23.695286  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.613474  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.794361  1609 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:23.695328  4107 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:23.688213  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1270) took 1936 ms. Trace:
I20260709 12:59:23.755380  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.795667  1616 raft_consensus.cc:2393] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:23.756276  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.765663  1534 raft_consensus.cc:2376] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5. Re-sending same reply.
I20260709 12:59:23.796564  1681 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:23.694278  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.756417  3702 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:23.796988  1539 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:23.757710  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.797441  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.610636  3707 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:23.591421  4088 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:23.766884  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.800593  1683 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:23.768540  2302 raft_consensus.cc:2393] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:23.769508  4046 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:23.783329  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 93883us
I20260709 12:59:23.808612  1582 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:23.809715  2306 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:23.784602  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.810462  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.810758  1536 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:23.772125  1610 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:59:23.811494  1537 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:23.776073  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.812170  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1498) took 1012 ms. Trace:
I20260709 12:59:23.756700  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:23.811102  1682 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:23.812940  1685 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.604650  1437 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 5, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195), now has a pending config: VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193), VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194), VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195), VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:23.814749  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.815028  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.815387  1535 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:23.814937  1437 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 2 to 4, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:23.758651  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.797778  1687 rpcz_store.cc:276] 0709 12:59:21.751473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.567455 (+1815982us) service_pool.cc:224] Handling call
0709 12:59:23.567734 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.687895 (+120161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.688145 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.817690  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:23.818866  1582 leader_election.cc:400] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:23.819304  1537 rpcz_store.cc:276] 0709 12:59:22.799924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.773516 (+973592us) service_pool.cc:224] Handling call
0709 12:59:23.812113 (+ 38597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.693289  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.584069  4089 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 12:59:23.746958  4047 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:23.797091  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1468) took 1433 ms. Trace:
I20260709 12:59:23.781759  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.803318  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:23.799168  3702 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:23.806890  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:23.807199  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.812278  1533 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.659598  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:23.798053  2308 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:23.819957  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:23.820726  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:23.821754  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.817368  1437 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 4, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:23.816565  1684 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:23.684501  4079 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:23.915498  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.794741  4023 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:23.688097  1435 rpcz_store.cc:269] 0709 12:59:05.189898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.193104 (+  3206us) service_pool.cc:224] Handling call
0709 12:59:05.732039 (+538935us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb5090 00007f8d58c53f3a 00007f8d5ea0a1cc 00007f8d5eb0837e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc 00007f8d5cfc8392 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:23.617326 (+17885287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:17.314764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:17.315441 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:17.315491 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:59:17.315509 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:17.316183 (+   674us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:17.331639 (+ 15456us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:17.332893 (+  1254us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:17.376741 (+ 43848us) tablet.cc:701] Row locks acquired
0709 12:59:17.376809 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:59:17.377037 (+   228us) write_op.cc:270] Start()
0709 12:59:17.377219 (+   182us) write_op.cc:276] Timestamp: P: 1783601957376950 usec, L: 0
0709 12:59:17.377252 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:59:17.438485 (+ 61233us) log.cc:844] Serialized 1706 byte log entry
0709 12:59:17.875990 (+437505us) op_driver.cc:464] REPLICATION: finished
0709 12:59:18.314560 (+438570us) write_op.cc:301] APPLY: starting
0709 12:59:18.331049 (+ 16489us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:18.393473 (+ 62424us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:18.457988 (+ 64515us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:18.657624 (+199636us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:18.709617 (+ 51993us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:18.709668 (+    51us) write_op.cc:312] APPLY: finished
0709 12:59:18.791695 (+ 82027us) log.cc:844] Serialized 41 byte log entry
0709 12:59:18.832888 (+ 41193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:18.849827 (+ 16939us) write_op.cc:454] Released schema lock
0709 12:59:18.870475 (+ 20648us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:19.089115 (+218640us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:19.092644 (+  3529us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46851,"reported_tablets":34,"spinlock_wait_cycles":963422080,"child_traces":[["op",{"apply.queue_time_us":408115,"apply.run_cpu_time_us":12749,"apply.run_wall_time_us":768223,"num_ops":4,"prepare.queue_time_us":163027,"prepare.run_cpu_time_us":4862,"prepare.run_wall_time_us":161356,"replication_time_us":476133,"thread_start_us":392333,"threads_started":2}]]}
I20260709 12:59:23.824815  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:23.838485  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:23.917232  2307 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.707461  4097 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:59:23.916786  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.799130  3975 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:23.924937  2309 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:23.918493  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1494) took 1148 ms. Trace:
I20260709 12:59:23.918541  1686 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:23.916277  1541 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:23.925850  1686 pending_rounds.cc:85] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 3
I20260709 12:59:23.926205  1686 pending_rounds.cc:107] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:23.926496  1686 raft_consensus.cc:2889] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:23.926844  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.918823  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 112014us
I20260709 12:59:23.853443  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.795058  4109 raft_consensus.cc:2764] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:23.799939  4065 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:23.919585  1437 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 2 to 4, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:23.917789  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:23.919534  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 99645.4us
I20260709 12:59:23.773727  1612 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:23.932828  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.824761  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:23.933425  1539 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:23.933593  1687 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:23.921149  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:23.915771  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 112520us
I20260709 12:59:23.783082  4051 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.919423  1688 rpcz_store.cc:276] 0709 12:59:22.363554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.728212 (+1364658us) service_pool.cc:224] Handling call
0709 12:59:23.728633 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.796886 (+ 68253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.797042 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.805729  3860 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:23.915992  4111 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.927582  1540 rpcz_store.cc:276] 0709 12:59:22.770511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.781493 (+1010982us) service_pool.cc:224] Handling call
0709 12:59:23.918439 (+136946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.932658  1437 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 4, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.927613  1541 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:23.759006  4081 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:23.933075  1532 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:23.928025  1682 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:23.919703  4047 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.919736  4022 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:23.949436  4022 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.949846  4022 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:23.940534  4155 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.427s	user 0.000s	sys 0.003s
I20260709 12:59:23.952207  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:23.953116  2301 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:23.929989  3975 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.958242  1689 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:23.919960  1534 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:23.923776  4046 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:23.923169  3702 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.824466  3883 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.945909  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.947574  1685 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:23.959604  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.937331  2276 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:23.959926  1540 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:23.929721  3959 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:23.960871  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:23.960556  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:23.963804  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.960777  1541 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:23.964578  1536 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:23.964991  1540 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:23.931600  4065 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:23.827350  4088 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:59:23.920190  3707 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:23.973070  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.973860  1534 raft_consensus.cc:2393] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:23.976334  1533 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:23.977268  2307 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:23.978005  1533 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:23.978494  1539 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:23.978662  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1489) took 1209 ms. Trace:
I20260709 12:59:23.979122  1533 rpcz_store.cc:276] 0709 12:59:22.769356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.977391 (+1208035us) service_pool.cc:224] Handling call
0709 12:59:23.977666 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.978441 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.978614 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.967973  1538 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:23.966899  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:23.969866  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.941901  4051 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.965381  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:23.822618  4156 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 12:59:23.981695  1536 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:23.982331  1537 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:23.983621  1541 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:23.984330  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1499) took 1125 ms. Trace:
I20260709 12:59:23.984696  1541 rpcz_store.cc:276] 0709 12:59:22.858851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.983120 (+1124269us) service_pool.cc:224] Handling call
0709 12:59:23.983423 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.984050 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.984271 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.986240  1541 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:23.986826  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1501) took 1127 ms. Trace:
I20260709 12:59:23.991217  1541 rpcz_store.cc:276] 0709 12:59:22.859489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.985553 (+1126064us) service_pool.cc:224] Handling call
0709 12:59:23.985866 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.986582 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.986772 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:23.993918  1541 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.963557  3959 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.000757  3959 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.002074  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.003221  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.004096  1532 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:24.004594  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1486) took 1236 ms. Trace:
I20260709 12:59:24.005075  1536 rpcz_store.cc:276] 0709 12:59:22.768657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.965454 (+1196797us) service_pool.cc:224] Handling call
0709 12:59:23.981492 (+ 16038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.004346 (+ 22854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.004542 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:24.004668  1532 pending_rounds.cc:85] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 3
I20260709 12:59:24.006222  1540 raft_consensus.cc:2410] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:24.006395  1532 pending_rounds.cc:107] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:24.006816  1535 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:24.007458  1532 raft_consensus.cc:2889] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:24.008329  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1495) took 1237 ms. Trace:
I20260709 12:59:24.008695  1532 rpcz_store.cc:276] 0709 12:59:22.770776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.982847 (+1212071us) service_pool.cc:224] Handling call
0709 12:59:23.983092 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.008071 (+ 24979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.008260 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:24.012562  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.016396  1535 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:23.963246  3975 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.029588  4148 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:23.973431  4065 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:23.969529  3998 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:24.042724  3998 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.043135  3998 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:24.043900  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1497) took 1262 ms. Trace:
I20260709 12:59:24.044627  4089 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.045936  4022 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.049034  3707 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.049486  3707 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.049813  3707 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.050706  3959 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.044327  1537 rpcz_store.cc:276] 0709 12:59:22.781028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.982950 (+1201922us) service_pool.cc:224] Handling call
0709 12:59:24.043388 (+ 60438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.043564 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.043588 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:24.043629 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:24.043659 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.043713 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.043829 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:24.048031  4022 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.054525  3959 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.054540  4022 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:24.059751  1536 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:24.064080  4046 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:24.064723  4046 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.065207  4046 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.964617  4047 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:23.958468  4111 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:24.069088  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.004151  4023 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.077545  4023 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.091285   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.030781  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1488) took 1261 ms. Trace:
I20260709 12:59:24.092218  1534 rpcz_store.cc:276] 0709 12:59:22.769093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.974425 (+1205332us) service_pool.cc:224] Handling call
0709 12:59:24.030109 (+ 55684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.030326 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.030357 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:24.030425 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:24.030478 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.030556 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.030704 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:24.093745  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.156s	user 0.015s	sys 0.042s
W20260709 12:59:24.094070  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.015s	sys 0.042s
W20260709 12:59:24.095021  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.096086  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.128616  1538 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:24.066696  4051 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.131486  1534 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:24.106554  4101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.037s	sys 0.047s
I20260709 12:59:24.134750  4079 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.140296  4079 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:24.140693  4079 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.141072  4079 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.100682  3989 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:24.134716  4101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.037s	sys 0.047s
I20260709 12:59:24.159858  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2069) took 1473 ms. Trace:
I20260709 12:59:24.160363  1615 rpcz_store.cc:276] 0709 12:59:22.686829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.686972 (+   143us) service_pool.cc:224] Handling call
0709 12:59:22.687275 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.722355 (+ 35080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.722404 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.727680 (+  5276us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.510264 (+782584us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:23.510309 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.510852 (+   543us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5400320d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:23.510898 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:24.159532 (+648634us) raft_consensus.cc:1685] finished
0709 12:59:24.159554 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.159778 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1318,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2617,"spinlock_wait_cycles":49932800,"thread_start_us":254720,"threads_started":1,"wal-append.queue_time_us":1353108}
I20260709 12:59:24.156834  4011 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.166410  3975 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:24.198925  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.224769  2304 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:24.230475  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.188344  4111 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:24.180567  3707 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.190905  4094 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:24.238703  3887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.003s	sys 0.023s
W20260709 12:59:24.285887  4160 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:24.230194  4065 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.288560  4111 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.297889  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:24.301868  1612 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
W20260709 12:59:24.292042  3887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.004s	sys 0.023s
I20260709 12:59:24.299005  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.303047  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:24.295629  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 457273us
I20260709 12:59:24.304920  1582 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.305805  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:24.308678  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.010s
W20260709 12:59:24.309118  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.003s	sys 0.010s
W20260709 12:59:24.309369  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 517385us
I20260709 12:59:24.287946  3998 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.291561  4094 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:24.293910  4079 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.310187  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.324473  1536 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:24.347280  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 526622us
I20260709 12:59:24.349678  4118 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:24.380038  4118 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:24.312069  1656 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.028s	sys 0.049s
W20260709 12:59:24.381844  1656 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.029s	sys 0.057s
W20260709 12:59:24.382102  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.382305  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 889145us
W20260709 12:59:24.371687  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 443743us
I20260709 12:59:24.320441  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:24.401324  1611 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:24.298326  3883 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:24.381667  4158 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.868s	user 0.005s	sys 0.019s
W20260709 12:59:24.413853  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 410700us
I20260709 12:59:24.416316  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:24.373807  4161 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:24.419044  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:24.421160  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2067) took 1777 ms. Trace:
I20260709 12:59:24.381189  4118 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.310619  3992 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.421861  1607 rpcz_store.cc:276] 0709 12:59:22.643498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.643624 (+   126us) service_pool.cc:224] Handling call
0709 12:59:22.660863 (+ 17239us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:22.675042 (+ 14179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.675072 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:22.688910 (+ 13838us) log.cc:844] Serialized 52 byte log entry
0709 12:59:22.937810 (+248900us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b1800358fc0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 12:59:24.095211 (+1157401us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:24.095288 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.095362 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:24.415350 (+319988us) raft_consensus.cc:1685] finished
0709 12:59:24.415377 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.421079 (+  5702us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":573,"raft.queue_time_us":8325,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1732,"spinlock_wait_cycles":59167104,"thread_start_us":1157226,"threads_started":1,"wal-append.queue_time_us":1500648}
I20260709 12:59:24.421736  1614 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:24.426666  2304 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:24.303336  3887 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:24.392504  4081 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.433375  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.414330  4148 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:24.431773  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 52397.7us
I20260709 12:59:24.402707  4101 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.416332  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.427973  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.439759  1615 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.435245  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:24.430462  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 124755us
W20260709 12:59:24.441212  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 131090us
I20260709 12:59:24.441725  1582 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.438210  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.428673  3992 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.452433  1541 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:24.456815  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:24.454000  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.436463  4118 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:24.418083  4103 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:24.309633  4111 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.456841  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.438968  4011 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:24.437029  4167 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:24.439096  4114 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:24.467242  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 380) took 1762 ms. Trace:
I20260709 12:59:24.436450  3860 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:59:24.464727  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.469619  1615 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:24.492812  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:24.470726  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57629.8us
I20260709 12:59:24.458191  3992 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.489018  2310 rpcz_store.cc:276] 0709 12:59:22.705047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.710869 (+  5822us) service_pool.cc:224] Handling call
0709 12:59:22.711285 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.711728 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.711771 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.723313 (+ 11542us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.567079 (+843766us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:23.567118 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.567187 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:24.381023 (+813836us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:24.460510 (+ 79487us) raft_consensus.cc:1685] finished
0709 12:59:24.460541 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.467178 (+  6637us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":589,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3883,"spinlock_wait_cycles":40486144,"thread_start_us":809810,"threads_started":1,"wal-append.queue_time_us":779538}
I20260709 12:59:24.421098  3883 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.454258  4173 raft_consensus.cc:2764] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:24.463675  4022 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:24.494320  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.495947  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:24.457785  4168 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:24.439349  4081 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.468508  4088 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:24.499974  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 83735.9us
I20260709 12:59:24.439476  4169 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 12:59:24.501533  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 66342.8us
I20260709 12:59:24.507413  2276 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.455967  4101 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.503105  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.504508  3860 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.545717  2304 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [4.6-8.8]
I20260709 12:59:24.504347  4185 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:24.506034  4187 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:24.506546  1507 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:24.550603  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 90657.9us
W20260709 12:59:24.551096  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44601.6us
I20260709 12:59:24.551234  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.551613  1507 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.465998  3702 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.488440  3707 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.508833  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.511893  4065 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.517153  4088 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:24.499504  4165 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.562278  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:24.582211  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.518273  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:24.583806  1689 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:24.499261  3887 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.519160  1682 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:24.519491  3975 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.518303  4094 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:24.524349  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.526592  3883 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.532512  4168 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.586169  4168 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.586647  4168 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.587215  4094 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.587621  4094 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.499564  4174 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:24.533082  3989 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:24.533716  4079 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.537037  4103 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.538205  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.541021  4109 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:24.599308  4109 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:24.599550  4111 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.541955  4162 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:24.500579  4011 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.550289  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:24.552589  1507 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.452991  4097 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:24.539744  4023 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.559183  4089 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.604759  4089 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.605160  4089 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:24.605852  4047 consensus_meta.cc:287] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 12:59:24.606251  4022 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.597514  4174 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:24.563102  3707 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:24.607975  4174 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.608546  3707 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:24.563261  4178 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:24.565174  3702 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:24.570226  4180 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:24.570112  4101 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.571856  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1490) took 1802 ms. Trace:
I20260709 12:59:24.555414  4173 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.544934  3860 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:24.550462  4185 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.590391  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:24.590044  4088 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.591044  3975 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:24.591681  4166 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:24.592446  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.575570  3992 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:24.580796  4046 consensus_meta.cc:287] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:59:24.630357  4046 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.594910  3883 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:24.631381  2306 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:24.598002  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59876.1us
I20260709 12:59:24.601469  2310 raft_consensus.cc:2376] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5. Re-sending same reply.
I20260709 12:59:24.632681  2276 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5.
I20260709 12:59:24.598062  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.587941  4094 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.633489  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.633597  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.635000  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.592758  4186 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:24.635655  3702 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.635818  4186 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:24.636287  3702 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.636910  3702 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.636924  4176 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.611841  1539 rpcz_store.cc:276] 0709 12:59:22.769583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.979146 (+1209563us) service_pool.cc:224] Handling call
0709 12:59:23.979427 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.337580 (+358153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.337631 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.338201 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:59:24.460973 (+122772us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:24.461020 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.461087 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:24.571658 (+110571us) raft_consensus.cc:1685] finished
0709 12:59:24.571676 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.571791 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64552,"raft.queue_time_us":395704,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":415593,"threads_started":2,"wal-append.queue_time_us":162725}
I20260709 12:59:24.640185  3959 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:24.640592  4094 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.640986  4022 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.641597  4046 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:24.611800  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 109542us
I20260709 12:59:24.642688  4094 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:24.642757  4022 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:24.643255  3959 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:24.597406  4103 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.644097  4103 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.644872  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.645951  1579 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:24.647149  4196 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:24.626870  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.648021  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.601758  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49238.1us
I20260709 12:59:24.648686  2276 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:24.648921  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.649333  4196 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:24.649945  4196 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:24.650326  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.651345  4065 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.651489  1507 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.588402  4165 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.636370  4186 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.651784  4065 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.651901  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1492) took 1881 ms. Trace:
I20260709 12:59:24.598899  3998 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:24.652329  3883 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:24.652362  4065 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.652233  4186 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:24.653230  4165 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.652434  1533 rpcz_store.cc:276] 0709 12:59:22.770034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.980303 (+1210269us) service_pool.cc:224] Handling call
0709 12:59:24.019172 (+ 38869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.019368 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:24.371150 (+351782us) log.cc:844] Serialized 14 byte log entry
0709 12:59:24.582879 (+211729us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b180045bb60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a
0709 12:59:24.651569 (+ 68690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:24.651616 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:24.651675 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.651734 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.651843 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":407886,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":13672,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2989,"spinlock_wait_cycles":24051712,"thread_start_us":373388,"threads_started":3,"wal-append.queue_time_us":98967}
I20260709 12:59:24.647306  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.651809  4191 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:24.661103  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.660728  4065 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:24.653045  3883 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:24.663802  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:24.663997  4197 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.664726  4197 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:24.665057  4197 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:24.666369  4065 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.665444  4197 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.666610  4186 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.667290  3883 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.668756  3883 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.672679  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:24.673297  1533 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:24.674746  4197 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.675226  1689 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:24.676824  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:24.677523  1685 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:24.677938  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.678700  1689 raft_consensus.cc:2376] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3. Re-sending same reply.
I20260709 12:59:24.678691  4197 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.680148  4197 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:24.681604  1533 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:24.681630  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.682327  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.682987  1681 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.683470  4188 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:24.684032  4188 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:24.684906  4188 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.628995  4167 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:24.600539  4162 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:24.610486  4079 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:24.689118  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.600385  4183 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.609457  3707 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.694161  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2143) took 1182 ms. Trace:
I20260709 12:59:24.694345  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:24.695996  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.698745  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.709146  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:24.709889  1612 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:24.700325  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 121554us
I20260709 12:59:24.714347  1612 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:24.630476  4187 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:24.715175  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:24.706701  1681 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:24.716154  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:24.716817  2305 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:24.717135  4186 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.708889  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:24.717594  3992 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.619179  3860 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.708000  1536 rpcz_store.cc:276] 0709 12:59:23.512007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.060901 (+548894us) service_pool.cc:224] Handling call
0709 12:59:24.061251 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.378260 (+317009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.693881 (+315621us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400308254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:24.694092 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604989696}
I20260709 12:59:24.721714  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:24.721119  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:24.721377  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.729815  1611 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:24.727795  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 66081.1us
I20260709 12:59:24.733599  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.734198  1610 raft_consensus.cc:2376] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8. Re-sending same reply.
I20260709 12:59:24.735173  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:24.736140  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.736898  1607 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:24.619110  4185 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.735671  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:24.606267  4047 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:24.707393  4192 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:59:24.746254  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.746878  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:24.748831  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 240105us
I20260709 12:59:24.749454  1611 raft_consensus.cc:2368] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:24.749900  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.708201  4173 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.703347  4079 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.750655  1612 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:24.751282  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.749629  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.708146  4065 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.720098  4194 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:24.761025  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.774933  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.720299  3998 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.776265  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:24.750934  3959 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.779043  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.600203  4109 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.750730  4191 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:24.780182  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:24.746157  4114 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:24.780716  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.785225  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.785702  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:24.781874  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66508.5us
I20260709 12:59:24.759032  4173 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.761878  4079 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.747296  3992 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 12:59:24.800819  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.790913  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.780907  4183 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.781661  3959 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.778267  4195 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:24.688057  4167 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.776870  4190 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.825837  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:24.781965  4101 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.775651  4194 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:24.783906  4111 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.809450  4169 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:24.776942  4065 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.817487  4191 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:24.841838  4189 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:24.826054  4183 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.859386  4065 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.846839  4089 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:24.860744  1506 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.922s	user 0.019s	sys 0.006s
I20260709 12:59:24.787567  4166 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:59:24.849300  4101 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.818694  4188 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.826757  4081 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:24.825152  4173 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.842023  3959 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.827328  4200 raft_consensus.cc:2764] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:24.848641  4190 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.855191  4111 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.781774  3998 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.875377  4097 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:24.864951  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 79802.1us
I20260709 12:59:24.918423  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:24.877012  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 155735us
W20260709 12:59:24.880474  1506 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.941s	user 0.019s	sys 0.006s
I20260709 12:59:24.920779  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.843164  4195 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:24.776333  4162 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.737411  4196 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.894555  3860 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.880314  4089 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.895689  4023 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.896014  4047 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.896433  4114 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.865581  4011 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:24.904057  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 447284us
I20260709 12:59:24.951761  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:24.874150  4184 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.863772  4165 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.857450  4169 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:24.921229  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 1.9824e+06us
I20260709 12:59:24.927546  4081 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:24.937297  4148 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:24.884843  4101 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.926270  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:24.777372  4187 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.875806  4203 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:24.883536  4188 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.941704  4186 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:24.923136  4195 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:24.943118  4162 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.919889  4111 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.916939  4190 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.956795  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:24.989761  1681 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:24.876093  4183 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.992462  4118 raft_consensus.cc:2764] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:59:24.993921  4185 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.943893  4097 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:24.962399  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:24.944801  4051 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:24.996929  4097 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.997877  4051 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.959676  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:24.964474  3707 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:24.968182  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.968330  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:24.951452  3702 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.961298  4168 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.959512  4184 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:24.937237  4199 consensus_queue.cc:1059] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:24.930593  4103 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:24.961251  4023 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.984565  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.007876  1612 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.985585  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.011143  1608 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.961683  4169 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:24.987213  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:25.013091  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 88789.8us
I20260709 12:59:24.988338  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:25.014285  1614 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:24.991654  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:25.017109  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 57514.8us
I20260709 12:59:25.017917  1582 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:25.019130  1507 leader_election.cc:400] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:25.019616  1507 leader_election.cc:403] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:24.900867  4191 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.024217  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.025523  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:24.970759  4186 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:24.970099  4011 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:59:25.035202  4184 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:24.979182  2303 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:25.037417  4165 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.038566  3998 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:24.953096  4194 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:25.039963  4182 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.497s	user 0.004s	sys 0.000s
I20260709 12:59:25.025169  4023 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.040825  4047 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:25.040560  4195 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.040983  3860 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:25.025650  3887 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:25.047545  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 121351us
I20260709 12:59:24.977476  4203 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:25.069808  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:25.070729  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52917.2us
I20260709 12:59:25.090969  1616 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:25.073520  1612 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:25.078534  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:25.091830  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:25.092168  1613 raft_consensus.cc:606] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:25.092592  1613 raft_consensus.cc:614] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:25.079645  4198 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:25.100217  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.086395  1608 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:25.088805  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.107254  1681 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
W20260709 12:59:25.090553  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.109519  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.110307  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.110406  1536 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:25.110343  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:25.111302  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:25.111450  1610 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:25.111981  1609 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:25.112977  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.078898  4081 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:25.138921  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.113577  1684 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
W20260709 12:59:25.116863  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 414636us
I20260709 12:59:25.140594  1686 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:25.078774  4208 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:59:25.118311  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.116168  2275 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:25.122073  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.118099  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:25.121881  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.143034  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:25.148444  1539 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:25.122474  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:25.104429  4194 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:25.138949  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:25.154945  1656 connection.cc:256] RPC call timeout handler was delayed by -1.7350917740000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260709 12:59:25.116251  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:25.146252  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 132197us
I20260709 12:59:25.141583  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.141117  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.143483  1535 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:25.155567  1609 raft_consensus.cc:2376] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7. Re-sending same reply.
I20260709 12:59:25.157925  1684 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:25.121352  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.149398  1540 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:25.155323  1656 connection.cc:256] RPC call timeout handler was delayed by -1.6432014629999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
I20260709 12:59:25.154460  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.164568  1610 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:25.158910  1538 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:25.141608  4215 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.113664  3887 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:25.170168  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.172626  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.173554  1684 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:25.174624  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.165939  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.106081  3707 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:59:25.113423  4205 raft_consensus.cc:2764] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:25.107129  4114 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:59:25.179760  4215 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.118199  3959 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.105756  3989 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:59:25.200963  4205 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.201043  3959 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.201584  4205 raft_consensus.cc:697] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:25.202421  4205 consensus_queue.cc:237] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.192148  4224 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:25.207412  4103 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.177093  1686 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
W20260709 12:59:25.157068  4206 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:59:25.209035  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.209657  1686 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 1.
I20260709 12:59:25.210414  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.211385  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.212430  4203 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.214254  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:25.215353  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.117239  3860 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:59:25.177912  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:25.152390  4148 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:25.194131  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:25.249594  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.192857  1540 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:25.104395  4186 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.212050  1686 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:25.226776  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 123502us
I20260709 12:59:25.179306  4022 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:25.273823  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:25.198763  4215 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:25.251104  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:25.252504  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.268622  1653 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:25.258801  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 82174.5us
I20260709 12:59:25.263654  3959 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:25.192018  1684 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:25.281244  1653 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:25.281437  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.282135  1540 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:25.275621  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:25.283222  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.283820  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.285522  1687 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:25.286917  1687 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:25.276022  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:25.276188  1616 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:25.276366  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:25.253474  4148 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:25.312708  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 152496us
W20260709 12:59:25.316370  1656 connection.cc:256] RPC call timeout handler was delayed by -1.464873630999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 12:59:25.317018  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2954697160000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:59:25.317322  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2922917739999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 12:59:25.275988  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 134840us
I20260709 12:59:25.250283  1539 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:59:25.329737  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.325415  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2729697160000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 12:59:25.312060  4148 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:25.295621  4215 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:25.298480  3860 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:25.315718  4186 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.377560  3860 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.378001  3860 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:25.311764  4184 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.379242  4184 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.379652  4200 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:25.380062  4200 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:25.380834  4200 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.381532  4184 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:25.381798  4200 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:25.385102  3860 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.312322  4210 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:25.387133  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.387530  3860 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:25.387894  1610 raft_consensus.cc:2393] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:25.388697  4211 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.438s	user 0.000s	sys 0.003s
I20260709 12:59:25.331548  1581 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:25.312384  3959 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:25.391460  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.391204  3959 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.392154  1537 raft_consensus.cc:2368] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6.
I20260709 12:59:25.393060  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:25.393536  1537 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:25.349413  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:25.250523  4183 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.400384  1537 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
W20260709 12:59:25.372162  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.372810  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.401911  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:25.330441  4195 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.403134  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:25.403190  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:25.373350  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:25.385735  3702 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.404618  4203 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:25.404709  2301 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:25.405496  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:25.405730  2301 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:25.403234  4183 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.406638  2301 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.407673  2301 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:25.401275  2310 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:25.408481  4187 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:25.408991  4187 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:25.409888  4187 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:25.411727  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.412569  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:25.412822  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.413684  4065 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:25.413758  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:25.414359  1682 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:25.414783  2301 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:59:25.414896  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:25.415212  2301 pending_rounds.cc:85] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 6
I20260709 12:59:25.415617  2301 pending_rounds.cc:107] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:59:25.421468  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.422051  1614 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:25.422852  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:25.423378  1613 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:25.346576  4156 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:25.274739  4081 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.430167  4023 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:25.348533  4174 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:25.416023  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:25.372498  4224 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.415936  2301 raft_consensus.cc:2889] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:25.436882  1532 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:25.433007  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 101531us
I20260709 12:59:25.442060  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.321127  4212 consensus_queue.cc:1059] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:59:25.483805  1537 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:25.484196  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:25.484719  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.505010  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:25.442528  4022 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:25.489099  1613 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:25.510581  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:25.511148  1682 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:25.490964  1532 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:25.492388  4114 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:25.346001  3887 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.432508  4215 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:25.517752  1614 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:25.494215  1616 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:25.495909  4101 consensus_meta.cc:287] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.007s
I20260709 12:59:25.497181  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
W20260709 12:59:25.501250  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 503896us
I20260709 12:59:25.520722  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.502396  1609 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:25.429383  4156 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:25.485630  4224 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.507407  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:25.513346  1532 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:25.433692  4184 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:59:25.526859  2310 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:25.516924  4111 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 12:59:25.532752  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:25.568353  1532 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:25.533704  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.569886  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.514891  3989 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:25.533717  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:25.571092  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 63786.2us
I20260709 12:59:25.586566  2307 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:25.534300  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:25.587298  1681 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.572343  1532 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:25.589195  1532 pending_rounds.cc:85] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 2
I20260709 12:59:25.589465  1532 pending_rounds.cc:107] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:25.589738  1532 raft_consensus.cc:2889] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:25.571900  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.514545  3707 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.515022  4114 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:25.447171  4174 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.606874  1682 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:25.526655  4022 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:25.611681  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:25.568625  4165 raft_consensus.cc:2764] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:25.612315  1682 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:25.613644  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:25.620329  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 247057us
I20260709 12:59:25.626468  1681 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:25.585801  3989 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.523910  4101 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.595135  3959 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:25.628516  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:25.638783  1682 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:25.570389  4200 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:59:25.612830  4088 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.621281  3707 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.606889  4065 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:25.642568  4184 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:25.639394  2307 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:25.663784  1653 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:25.633859  3989 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:25.640116  4051 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 12:59:25.592657  4111 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.665678  1683 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:25.670508  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:25.637933  4165 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:25.672739  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:25.683213  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:25.672488  4231 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
W20260709 12:59:25.700945  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.665417  3959 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:25.683542  4088 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:25.704115  1684 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:25.704058  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 133338us
I20260709 12:59:25.672948  4200 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:25.667776  4184 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:25.703464  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 131635us
I20260709 12:59:25.683097  4051 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.659950  4187 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:59:25.694408  4228 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 12:59:25.697036  4229 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 12:59:25.718994  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.721608  1688 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:25.691941  4205 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:25.728109  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.666129  3707 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:25.745632  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 123512us
W20260709 12:59:25.726465  1536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.018s	sys 0.001s
W20260709 12:59:25.760375  1536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.019s	sys 0.001s
I20260709 12:59:25.760478  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.761235  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.761696  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.641206  4236 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:59:25.703586  3975 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:25.715466  4046 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:59:25.763068  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.773067  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.630358  4156 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:25.758618  4230 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:59:25.790678  4051 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:25.868367  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 105401us
I20260709 12:59:25.867440  4253 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:25.726877  4088 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:25.751271  4200 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:25.881726  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:25.901099  4242 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 12:59:25.902074  4245 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:59:25.668514  4215 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.905680  3707 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:25.906769  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 134017us
I20260709 12:59:25.907330  4243 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:25.909160  4216 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.646s	user 0.004s	sys 0.000s
I20260709 12:59:25.786223  3975 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.759321  4247 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.748570  4022 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:25.687384  4114 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:25.869086  4234 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
W20260709 12:59:26.017545  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.030587  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:25.935003  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:25.758824  4065 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:25.986127  4226 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:59:25.986006  4162 consensus_meta.cc:287] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.008s	user 0.012s	sys 0.008s
W20260709 12:59:26.042958  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 108039us
I20260709 12:59:25.875092  4101 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:25.873696  4205 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:25.996562  3959 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:25.873929  4165 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:26.503997  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 398822us
I20260709 12:59:25.986090  4156 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:25.937248  4183 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.936167  4198 consensus_meta.cc:287] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.000s
I20260709 12:59:26.460803  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1493) took 1502 ms. Trace:
I20260709 12:59:25.878981  4236 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:26.311031  4047 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.233s	user 0.011s	sys 0.006s
W20260709 12:59:26.210543  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.973263  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.541591  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.045125  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 320010us
W20260709 12:59:26.131557  4194 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.965s	user 0.007s	sys 0.000s
I20260709 12:59:25.874042  4187 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:26.536826  1683 rpcz_store.cc:276] 0709 12:59:24.958411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.958799 (+   388us) service_pool.cc:224] Handling call
0709 12:59:24.959073 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.672306 (+713233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.460436 (+788130us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400118354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:26.460720 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624544896}
W20260709 12:59:26.554371  1506 connection.cc:256] RPC call timeout handler was delayed by -2.3772115960000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:59:26.554975  1506 connection.cc:256] RPC call timeout handler was delayed by -2.089211596000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 12:59:26.555377  1506 connection.cc:256] RPC call timeout handler was delayed by -2.0505115960000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 12:59:26.555754  1506 connection.cc:256] RPC call timeout handler was delayed by -1.9992115960000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:59:26.556134  1506 connection.cc:256] RPC call timeout handler was delayed by -1.94791159600004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 12:59:26.556916  1506 connection.cc:256] RPC call timeout handler was delayed by -1.9290115960000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:59:26.557322  1506 connection.cc:256] RPC call timeout handler was delayed by -1.8939115960000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 12:59:26.557699  1506 connection.cc:256] RPC call timeout handler was delayed by -1.6320115960000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23340000000000002s for a response
W20260709 12:59:26.558077  1506 connection.cc:256] RPC call timeout handler was delayed by -1.6311115960000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2335s for a response
W20260709 12:59:26.558457  1506 connection.cc:256] RPC call timeout handler was delayed by -1.5654115960000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24080000000000001s for a response
W20260709 12:59:26.558841  1506 connection.cc:256] RPC call timeout handler was delayed by -1.4664115960000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25179999999999997s for a response
W20260709 12:59:26.559229  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1199115960000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2903s for a response
I20260709 12:59:26.049057  4174 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:26.116312  4089 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:26.249647  3707 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.518985  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 488482us
W20260709 12:59:26.295913  4238 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 12:59:26.411588  4046 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:26.423265  4169 consensus_meta.cc:287] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.376s	user 0.012s	sys 0.006s
I20260709 12:59:26.100790  4210 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:26.038837  3975 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:26.310024  4079 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.482s	user 0.011s	sys 0.000s
I20260709 12:59:26.073073  4247 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:26.029227  4253 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.039038  4224 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:26.296258  4263 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.312062  4251 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.564090  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.003s	sys 0.017s
W20260709 12:59:26.042622  4173 consensus_meta.cc:287] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.125s	user 0.007s	sys 0.004s
W20260709 12:59:26.576040  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.004s	sys 0.017s
I20260709 12:59:26.534438  4165 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:26.537524  4051 consensus_meta.cc:287] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
W20260709 12:59:26.550181  4190 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.531s	user 0.006s	sys 0.005s
W20260709 12:59:26.560539  4081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.009s	sys 0.012s
I20260709 12:59:26.547245  4198 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:26.580749  1540 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:26.550464  4047 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:26.581310  4111 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:26.584676  4251 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.597517  4205 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.599038  4251 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:26.551035  4187 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:26.599826  4187 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.601343  1539 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:26.569131  4101 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:26.592598  4190 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.572196  4079 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.585861  4173 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.605827  4190 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:26.288055  4088 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.606146  4079 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:26.606626  1685 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:26.606739  4173 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:25.936681  4184 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.607493  1533 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:26.584898  4263 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.604418  4101 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:26.241218  4200 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.609091  4101 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:26.609781  4263 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:26.572896  4046 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.573206  4194 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.539604  4183 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.575412  4239 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:26.621378  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.616969  4051 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:26.620831  3702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.013s
I20260709 12:59:26.573326  4253 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.581228  4165 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.572404  4169 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.570415  3707 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:26.649230  3702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.004s	sys 0.013s
I20260709 12:59:26.580929  4252 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:59:26.574457  4210 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.623001  4081 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:59:26.624802  4194 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:26.618701  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54689.8us
W20260709 12:59:26.766661  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.921763  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.891847  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 178919us
I20260709 12:59:26.776609  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:26.675323  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.001s	sys 0.006s
W20260709 12:59:26.948171  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.005s	sys 0.009s
I20260709 12:59:26.948348  1611 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:26.653483  4198 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.683243  1682 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:26.907348  4265 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
W20260709 12:59:26.908080  4270 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 12:59:26.951607  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 241392us
I20260709 12:59:26.952821  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:26.729933  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:26.830544  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:26.956583  1683 raft_consensus.cc:2410] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:26.956861  1614 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:26.953917  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:26.718492  4148 consensus_meta.cc:287] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.283s	user 0.012s	sys 0.001s
I20260709 12:59:26.958621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:26.818153  4260 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:59:26.744411  4196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.005s	sys 0.024s
I20260709 12:59:26.968083  1607 raft_consensus.cc:606] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:26.969555  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:26.973771  1611 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:26.715401  4167 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.744436  4051 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:26.952693  4046 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:26.976540  1656 leader_election.cc:400] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6.
I20260709 12:59:26.658181  4264 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.323s
I20260709 12:59:26.984359  4187 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.986770  4274 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:26.975435  3975 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:26.977428  4196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.008s	sys 0.033s
I20260709 12:59:26.956328  4088 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.982100  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1497) took 1471 ms. Trace:
W20260709 12:59:26.983042  4276 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 12:59:26.983263  4275 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:59:26.955987  4200 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:59:26.991324  4169 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:26.990780  4210 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:26.646507  4239 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.965119  4269 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:59:26.985638  4253 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.971261  4218 raft_consensus.cc:2764] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:26.957849  4272 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:59:27.003427  4088 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.981932  4167 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.004767  4101 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.005719  4088 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.006327  4167 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:27.007069  3989 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.322s	user 0.011s	sys 0.001s
I20260709 12:59:27.007232  4101 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.007525  3989 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.010118  4269 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:27.010541  4269 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:26.974972  4236 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:27.013216  4165 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:27.015142  4261 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.883s	user 0.011s	sys 0.006s
I20260709 12:59:26.997833  4051 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:27.022215  4244 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.782s	user 0.003s	sys 0.009s
I20260709 12:59:26.671702  4247 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:26.976617  4148 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.992347  4210 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:27.043680  4210 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:26.958824  4198 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.046241  4210 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.046977  4198 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.052058  4239 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.063937  4253 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:27.096863  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 130090us
I20260709 12:59:27.105373  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.105997  1611 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:27.107671  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.107872  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:27.109465  1613 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:27.109650  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:27.110893  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:27.120610  1611 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
W20260709 12:59:27.125072  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 148536us
I20260709 12:59:27.128213  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:27.129972  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1503) took 1459 ms. Trace:
I20260709 12:59:26.990630  1687 rpcz_store.cc:276] 0709 12:59:25.510831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.519496 (+  8665us) service_pool.cc:224] Handling call
0709 12:59:25.519866 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.567973 (+ 48107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.568019 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.606764 (+ 38745us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.042614 (+435850us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:26.042665 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.042745 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.981814 (+939069us) raft_consensus.cc:1685] finished
0709 12:59:26.981846 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.982019 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47661,"raft.queue_time_us":77010,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21760,"thread_start_us":401785,"threads_started":1,"wal-append.queue_time_us":987237}
I20260709 12:59:27.138052  2305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 383) took 2133 ms. Trace:
I20260709 12:59:27.130574  1688 rpcz_store.cc:276] 0709 12:59:25.670103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.722536 (+ 52433us) service_pool.cc:224] Handling call
0709 12:59:25.722874 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.723273 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.723299 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.723782 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.872126 (+148344us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:25.872179 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.872263 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.129264 (+1257001us) raft_consensus.cc:1685] finished
0709 12:59:27.129301 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.129634 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46,"raft.queue_time_us":189,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":147886,"threads_started":1,"wal-append.queue_time_us":852849}
I20260709 12:59:27.044001  4148 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.147285  4236 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.150918  4051 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.157298  4199 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:27.157613  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.157936  4199 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:27.159394  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.159960  2306 raft_consensus.cc:2393] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:27.138608  2305 rpcz_store.cc:276] 0709 12:59:25.004634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.004756 (+   122us) service_pool.cc:224] Handling call
0709 12:59:25.033538 (+ 28782us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:25.037304 (+  3766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.037338 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:25.498697 (+461359us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b2c00047b98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 12:59:25.499289 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 12:59:25.664369 (+165080us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:25.664404 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.664477 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.021052 (+1356575us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:27.137389 (+116337us) raft_consensus.cc:1685] finished
0709 12:59:27.137430 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.137738 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3376,"raft.queue_time_us":33123,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13140,"spinlock_wait_cycles":118530304,"thread_start_us":164693,"threads_started":1,"wal-append.queue_time_us":598979}
I20260709 12:59:27.161291  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51296 (request call id 10) took 1666 ms. Trace:
I20260709 12:59:27.161777  1607 rpcz_store.cc:276] 0709 12:59:25.494255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.497042 (+  2787us) service_pool.cc:224] Handling call
0709 12:59:27.160924 (+1663882us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003f3254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c45853 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.161067 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3330841344}
I20260709 12:59:27.163437  4292 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.164590  4210 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:27.177202  4263 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.178138  4263 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:27.180415  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.165369  4210 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.159569  4199 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.164211  4292 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.193156  4165 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.194453  1607 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:27.194796  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 392) took 2485 ms. Trace:
I20260709 12:59:27.195116  4148 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:27.190557  4210 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.196027  4148 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.201733  4065 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:27.222798  4109 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.225510  3959 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.226091  4185 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.226310  3959 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.231031  1507 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:27.221894  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 87856.5us
I20260709 12:59:27.195297  2303 rpcz_store.cc:276] 0709 12:59:24.708838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.720463 (+ 11625us) service_pool.cc:224] Handling call
0709 12:59:24.772929 (+ 52466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.064815 (+291886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.194176 (+2129361us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54005fffd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:27.194589 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437418880}
I20260709 12:59:27.250242  4188 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.251773  4165 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:27.255128  3887 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:27.256407  4263 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.256589  4253 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:27.256973  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:27.257678  4253 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:27.258096  4253 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:27.259595  3959 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.259356  4253 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.260562  4088 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:27.261013  4088 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:27.261497  4088 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.264212  3975 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.265771  4187 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.268165  4148 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.268973  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.269202  4292 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.269908  4199 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.276763  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.277711  1537 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.286715  4253 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.287150  1536 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:59:27.288537  3707 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.288864  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.289901  1541 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:27.290750  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.291531  1541 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
W20260709 12:59:27.291947  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1521) took 2000 ms (client timeout 1680 ms). Trace:
I20260709 12:59:27.292073  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:27.292506  1539 rpcz_store.cc:269] 0709 12:59:25.291043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.331360 (+ 40317us) service_pool.cc:224] Handling call
0709 12:59:27.291565 (+1960205us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54004227d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.291742 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737734016}
I20260709 12:59:27.292919  1534 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:27.305356  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.308495  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2162) took 2152 ms. Trace:
I20260709 12:59:27.308949  1540 rpcz_store.cc:276] 0709 12:59:25.155457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.282612 (+127155us) service_pool.cc:224] Handling call
0709 12:59:25.282901 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.594255 (+1311354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.307875 (+713620us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400073354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:27.308285 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2984581504}
I20260709 12:59:27.310525  4269 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:27.317170  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.318935  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:27.320144  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.320737  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.321803  1615 raft_consensus.cc:2410] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:27.322712  2305 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.323586  1609 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:27.323647  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 390) took 2615 ms. Trace:
I20260709 12:59:27.324633  1612 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:27.283692  4165 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:27.333899  4252 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.324101  2308 rpcz_store.cc:276] 0709 12:59:24.708105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.708253 (+   148us) service_pool.cc:224] Handling call
0709 12:59:24.716556 (+  8303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.268581 (+552025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.268610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.280683 (+ 12073us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.634472 (+353789us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:25.661875 (+ 27403us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.668802 (+  6927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.322960 (+1654158us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54000ee2d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:27.323029 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.323095 (+    66us) raft_consensus.cc:1685] finished
0709 12:59:27.323186 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.323423 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21582,"prepare.queue_time_us":26042,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":7502,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":31463,"spinlock_wait_cycles":1268673920,"thread_start_us":303160,"threads_started":1,"wal-append.queue_time_us":398439,"wal-append.run_cpu_time_us":2265,"wal-append.run_wall_time_us":1191632}
I20260709 12:59:27.336402  4162 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:59:27.341177  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:27.342881  4237 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 1.749s	user 0.014s	sys 0.000s
I20260709 12:59:27.343175  4162 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:27.344612  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.345326  4194 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:27.346405  2306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 695) took 2098 ms (client timeout 1522 ms). Trace:
W20260709 12:59:27.346825  2306 rpcz_store.cc:269] 0709 12:59:25.247902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.248061 (+   159us) service_pool.cc:224] Handling call
0709 12:59:27.346081 (+2098020us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540063ea54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.346269 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4286498560}
W20260709 12:59:27.348675  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1489) took 2392 ms (client timeout 1680 ms). Trace:
W20260709 12:59:27.349083  1685 rpcz_store.cc:269] 0709 12:59:24.955753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.956365 (+   612us) service_pool.cc:224] Handling call
0709 12:59:27.348265 (+2391900us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540012e654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.348475 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3693705600}
I20260709 12:59:27.350776  2302 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:27.352471  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 396) took 1949 ms. Trace:
I20260709 12:59:27.352798  2302 rpcz_store.cc:276] 0709 12:59:25.403380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.404961 (+  1581us) service_pool.cc:224] Handling call
0709 12:59:27.350444 (+1945483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.351276 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.352239 (+   963us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540063ea50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.352392 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4473726848}
W20260709 12:59:27.353582  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1280) took 2248 ms (client timeout 2518 ms). Trace:
W20260709 12:59:27.354123  1684 rpcz_store.cc:269] 0709 12:59:25.104783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.282940 (+178157us) service_pool.cc:224] Handling call
0709 12:59:27.353091 (+2070151us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540001e354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.353348 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966148992}
W20260709 12:59:27.355646  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61687.6us
I20260709 12:59:27.359256  3887 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:27.360406  4162 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:27.360322  3887 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:27.360881  4162 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:27.361853  3887 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:27.362262  4162 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.362828  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:27.363679  1608 raft_consensus.cc:606] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:27.363700  4162 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.364599  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.365828  1536 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:27.374516  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:27.374727  4289 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.375263  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 124578us
I20260709 12:59:27.375576  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.375701  4168 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:27.377321  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 321) took 2133 ms (client timeout 1890 ms). Trace:
I20260709 12:59:27.390614  1608 raft_consensus.cc:614] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:27.393107  1690 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:27.399749  1686 rpcz_store.cc:269] 0709 12:59:25.243468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.276125 (+ 32657us) service_pool.cc:224] Handling call
0709 12:59:27.376860 (+2100735us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540011a154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.377082 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3310266624}
I20260709 12:59:27.402815  4094 raft_consensus.cc:3055] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:27.403294  4094 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:27.405120  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1524) took 2111 ms. Trace:
I20260709 12:59:27.405524  1532 rpcz_store.cc:276] 0709 12:59:25.293701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.590741 (+297040us) service_pool.cc:224] Handling call
0709 12:59:25.591144 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.631678 (+ 40534us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:26.065583 (+433905us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.952066 (+886483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.952118 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:26.952159 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.404673 (+452514us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b54004358d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:27.404730 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.404944 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71060,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1894,"raft.queue_time_us":3534,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":92727552,"thread_start_us":1311054,"threads_started":2,"wal-append.queue_time_us":962683}
I20260709 12:59:27.411839  1690 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:27.416074  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:27.419814  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1499) took 1908 ms. Trace:
I20260709 12:59:27.420156  1537 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
W20260709 12:59:27.420692  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.422626  4196 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:27.423434  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:27.423244  4196 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.425375  4196 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.425282  4094 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.426954  4094 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.431169  4118 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:27.431638  4118 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:27.433279  4165 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.440125  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:27.441030  4268 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.441720  4268 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.421234  4289 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.362301  3887 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:27.445895  4268 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.448505  3989 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.450243  2306 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:59:27.452196  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2152) took 2342 ms (client timeout 2439 ms). Trace:
W20260709 12:59:27.452661  1533 rpcz_store.cc:269] 0709 12:59:25.109964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.110097 (+   133us) service_pool.cc:224] Handling call
0709 12:59:27.451807 (+2341710us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000c1a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:27.452011 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3441495424}
I20260709 12:59:27.456732  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:27.457733  1684 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.466764  4289 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.469404  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:27.469714  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:27.470341  1689 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:27.471038  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.471927  1686 raft_consensus.cc:2410] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:27.473289  4184 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.476861  4183 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.478194  4114 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.479934  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.481709  1686 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:27.484025  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.484318  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:27.484730  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.484930  2305 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:27.485296  4065 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:27.486061  4065 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.488312  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.489038  4065 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.490338  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.489205  2305 raft_consensus.cc:2410] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:27.493801  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.494019  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.494184  3887 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.420281  1682 rpcz_store.cc:276] 0709 12:59:25.511333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.645997 (+134664us) service_pool.cc:224] Handling call
0709 12:59:25.646327 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.955097 (+1308770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.419402 (+464305us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400255b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:27.419634 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384253312}
I20260709 12:59:27.496055  2306 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:27.496263  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 135) took 9331 ms. Trace:
I20260709 12:59:27.496450  2306 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:27.512938  1540 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 3: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:27.444813  4269 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.521569  2308 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:27.525668  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.500976  4256 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.545600  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.497473  2306 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.489754  4118 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:27.545270  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.554474  1533 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:27.560647  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.560038  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:27.563791  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.553215  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.564838  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.556134  3887 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:27.571782  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.578083  1532 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:27.580606  2306 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:27.581245  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 158027us
I20260709 12:59:27.564891  4118 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.589866  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.592271  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.595026  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.594099  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.600631  2308 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:27.601898  2307 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:27.595597  1532 raft_consensus.cc:2376] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6. Re-sending same reply.
I20260709 12:59:27.604653  1536 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.590755  4289 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.615724  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.616771  1534 raft_consensus.cc:2410] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:27.623559  1533 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:27.623229  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.618607  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.619115  4196 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.608747  4162 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:27.496724  1437 rpcz_store.cc:276] 0709 12:59:18.180005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.267029 (+ 87024us) service_pool.cc:224] Handling call
0709 12:59:27.495993 (+9228964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:24.377904 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:24.378514 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:24.378549 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:59:24.378570 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:24.379390 (+   820us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:24.379451 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:24.379481 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:59:24.380041 (+   560us) tablet.cc:701] Row locks acquired
0709 12:59:24.380058 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:24.380250 (+   192us) write_op.cc:270] Start()
0709 12:59:24.380358 (+   108us) write_op.cc:276] Timestamp: P: 1783601964380167 usec, L: 0
0709 12:59:24.380379 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:24.439611 (+ 59232us) log.cc:844] Serialized 2766 byte log entry
0709 12:59:24.887315 (+447704us) spinlock_profiling.cc:243] Waited 918 us on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c46e28 00007f8d5c681581 00007f8d5c680d58 00007f8d5c6859f1 00007f8d5c6859a9 00007f8d5c685939 00007f8d5c685901 00007f8d5c684b2d 000000000038f354 000000000038f199
0709 12:59:25.267554 (+380239us) op_driver.cc:464] REPLICATION: finished
0709 12:59:25.532723 (+265169us) write_op.cc:301] APPLY: starting
0709 12:59:25.565208 (+ 32485us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:25.632322 (+ 67114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:25.637211 (+  4889us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:25.900736 (+263525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:25.900960 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:59:25.901030 (+    70us) write_op.cc:312] APPLY: finished
0709 12:59:25.901305 (+   275us) log.cc:844] Serialized 53 byte log entry
0709 12:59:25.901500 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:25.901654 (+   154us) write_op.cc:454] Released schema lock
0709 12:59:25.901715 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:25.902073 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:25.902105 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3085878,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":239461,"apply.run_cpu_time_us":4291,"apply.run_wall_time_us":394758,"num_ops":6,"prepare.queue_time_us":426548,"prepare.run_cpu_time_us":44115,"prepare.run_wall_time_us":509603,"raft.queue_time_us":303489,"raft.run_cpu_time_us":46467,"raft.run_wall_time_us":115169,"replication_time_us":887001,"spinlock_wait_cycles":2111744,"thread_start_us":824350,"threads_started":4,"wal-append.queue_time_us":284662,"wal-append.run_cpu_time_us":80297,"wal-append.run_wall_time_us":2161419}]]}
I20260709 12:59:27.638784  4256 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.644903  4256 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.646356  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:27.646733  4246 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.640832  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 88040.9us
I20260709 12:59:27.640758  1610 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:27.640957  4225 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:27.649595  4196 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.649943  4225 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.651834  4196 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:27.663897  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.668618  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60021.3us
I20260709 12:59:27.642145  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:27.670037  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.697346  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.697546  1684 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:27.671890  1582 leader_election.cc:400] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6.
I20260709 12:59:27.699360  1582 leader_election.cc:403] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:27.674854  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
W20260709 12:59:27.703150  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54849.2us
I20260709 12:59:27.703204  1536 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:27.675793  4023 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:59:27.713004  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.706938  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.714999  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:27.715591  2308 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:27.672465  4224 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.680282  4089 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.698593  4051 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.629803  4289 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.673367  4251 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:27.652097  4225 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.647464  4256 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.673089  4264 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.671121  4197 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.707238  1609 raft_consensus.cc:606] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:27.640908  4198 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:27.668592  4101 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.761849  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 119810us
I20260709 12:59:27.761137  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:27.672804  3707 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.765877  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 94281.6us
I20260709 12:59:27.672598  4247 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.766494  4232 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6.
I20260709 12:59:27.679958  4187 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.772578  4278 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.772404  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:27.670404  4205 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:59:27.763388  4162 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.773408  4224 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:27.801469  4253 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.006s
I20260709 12:59:27.810536  4269 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:27.776846  4089 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.777988  2306 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:59:27.828600  2306 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 5
I20260709 12:59:27.642325  4252 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 12:59:27.669873  4212 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
W20260709 12:59:27.782176  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 78833.3us
I20260709 12:59:27.785142  1682 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:27.786561  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:27.787230  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.788956  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:27.738876  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.800596  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.790334  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.803099  1609 raft_consensus.cc:614] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:27.826782  4269 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.809688  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:27.647481  4246 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.812538  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:27.773823  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:27.825173  2305 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:27.808799  4101 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.826261  4187 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.827399  1537 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:27.810217  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 126163us
I20260709 12:59:27.832388  1685 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:27.820457  4247 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:27.862869  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 152332us
W20260709 12:59:27.861100  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 51536.1us
I20260709 12:59:27.861040  1686 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.812426  4251 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.868484  3860 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.869092  3860 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.869491  4251 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.802608  4264 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.828913  2306 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 12:59:27.872474  2306 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 12:59:27.872828  4264 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.872951  1504 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:27.873646  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 61261.6us
I20260709 12:59:27.874243  1684 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:27.874512  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:27.875268  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.875970  1535 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.855518  4269 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:27.877904  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.801172  4051 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:27.862313  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.872885  2306 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.876098  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:27.898132  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:27.858480  4253 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:27.900565  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 184178us
I20260709 12:59:27.898571  1688 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.903461  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.803404  4198 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:27.876802  4256 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.878279  4246 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.909111  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.876331  4101 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.910040  1534 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:27.877635  4247 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.912632  4251 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:27.914245  2306 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:27.906276  1685 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:27.923360  2306 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.915594  1686 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:27.909341  1683 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:27.917277  1682 raft_consensus.cc:2410] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:27.876557  4225 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:27.873677  4264 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.914103  3989 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:27.918493  1540 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:27.893276  4252 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:27.922991  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 211942us
I20260709 12:59:27.919184  4089 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.894088  4065 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.919524  1610 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:27.919538  1533 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:27.938199  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:27.926074  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.926164  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:27.926533  1536 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:27.940372  1540 raft_consensus.cc:2410] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:27.918962  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.940683  1690 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:27.905036  4253 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:27.861755  3707 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:27.986222  3707 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.988070  1541 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:27.991034  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.935894  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:27.936113  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 70008us
W20260709 12:59:27.922961  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.937153  1610 pending_rounds.cc:85] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 5
I20260709 12:59:27.996397  1610 pending_rounds.cc:107] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:27.996780  1610 raft_consensus.cc:2889] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.945124  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.932164  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.943987  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:27.948237  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.997716  1613 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:27.998109  1615 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:27.953029  4289 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:27.954413  4162 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:27.923312  4251 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:27.946566  1538 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:27.958004  4051 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:27.964322  4224 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:28.009922  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 133982us
I20260709 12:59:27.935927  3989 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.013214  3989 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.017060  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.020725  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:28.021344  1610 raft_consensus.cc:2376] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6. Re-sending same reply.
W20260709 12:59:28.021661  4311 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.261s	user 0.000s	sys 0.004s
I20260709 12:59:28.022183  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:28.022837  1610 raft_consensus.cc:2376] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6. Re-sending same reply.
I20260709 12:59:28.023604  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:27.967730  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:27.969837  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.970610  2275 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:27.971645  4198 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.026690  1690 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:27.975692  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:27.976154  1607 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:27.976373  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:27.998188  1533 raft_consensus.cc:2410] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:27.948922  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.028625  1536 raft_consensus.cc:2410] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:59:27.999183  1535 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:27.999982  1687 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:27.933218  4254 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:28.003376  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.008443  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:27.966351  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:27.973268  4253 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:28.000310  4088 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.001s
I20260709 12:59:28.000501  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.046407  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:28.047036  1611 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:28.030934  1688 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:28.007848  4251 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.034842  1653 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.035827  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.037006  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.040525  4247 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:28.055192  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89000.9us
I20260709 12:59:28.055946  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:28.057878  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.058269  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.058820  2307 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:28.059477  4101 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.060003  4101 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:28.040766  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65232.6us
I20260709 12:59:28.060395  4101 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.041944  4295 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:28.041955  4198 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:28.065642  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.048296  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:28.052760  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.054160  4253 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:28.041718  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 71195.9us
I20260709 12:59:28.025736  4156 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.080410  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.088862  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.096596  1615 raft_consensus.cc:2393] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 4: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:28.063189  4212 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:28.121440  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.127570  1616 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:28.132874  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 132857us
I20260709 12:59:28.136919  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:28.091400  4196 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.086325  4247 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:28.061203  4088 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.143047  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:28.130856  1506 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.528s (SENT)
I20260709 12:59:28.067384  4224 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:59:28.120201  4212 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:28.145571  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.098181  4295 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:28.151787  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:28.157486  2308 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:28.136125  4184 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.166939  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.098349  4183 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:59:28.143637  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.169898  1532 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:28.150219  4196 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:28.149245  4247 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.168769  1610 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:28.086761  4156 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.194756  4232 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:28.131678  4188 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:59:28.200757  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49750.9us
I20260709 12:59:28.165184  4212 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:28.210274  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.221508  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:28.168927  4289 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:28.149720  4254 consensus_queue.cc:1059] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:28.169376  4184 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.151173  4269 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:28.225363  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 135353us
W20260709 12:59:28.227326  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.201807  4196 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.235783  4317 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.238278  4315 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:59:28.238657  4079 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:28.266445  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 145822us
I20260709 12:59:28.241446  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.242475  4247 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.227736  4184 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.264674  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.226099  4289 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.228214  4183 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:28.247107  4254 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:28.282886  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 78426.7us
I20260709 12:59:28.282912  1610 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:28.284086  2303 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:28.285609  1607 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:28.286042  1537 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:28.290576  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:28.257474  4232 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.293778  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:28.299789  4285 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:59:28.290586  4205 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:28.266083  4317 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:28.304673  1506 leader_election.cc:336] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.639s (SENT)
I20260709 12:59:28.304759  4205 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.306332  4317 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.306466  4247 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.306923  4205 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.313205  4295 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.314414  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.315310  1608 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:28.316566  1612 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:28.286737  4254 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.287148  4183 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:28.318555  4183 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.318519  4254 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.319677  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.320926  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.321081  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1506) took 1571 ms. Trace:
I20260709 12:59:28.287747  4289 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.321477  1683 rpcz_store.cc:276] 0709 12:59:26.750080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.958373 (+208293us) service_pool.cc:224] Handling call
0709 12:59:28.320913 (+1362540us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540032d2d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:28.321028 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107735424}
I20260709 12:59:28.323716  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.325136  3860 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:28.300053  1539 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:28.328902  4088 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.332137  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:28.333244  1541 raft_consensus.cc:2410] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:28.319996  4254 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:28.342356  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54594.1us
I20260709 12:59:28.265615  4251 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.321362  4269 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.341089  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:28.348869  2302 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:28.350452  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:28.355829  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.362140  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.371312  1609 raft_consensus.cc:1217] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[4.7-4.7]   Dedup: 4.7->[]
I20260709 12:59:28.373070  1609 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 6. Ops: [4.7-4.7]
W20260709 12:59:28.375618  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 82118.7us
W20260709 12:59:28.381148  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 217446us
I20260709 12:59:28.382376  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.383304  1608 raft_consensus.cc:2410] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:28.368014  4168 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.384033  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.412290  4187 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.447595  3989 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:28.448555  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.449009  4198 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:28.449450  4198 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:28.454919  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 149142us
W20260709 12:59:28.455507  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 284466us
W20260709 12:59:28.455987  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 70599us
I20260709 12:59:28.470865  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.492322  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:28.496794  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.496608  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:28.505123  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47978.8us
W20260709 12:59:28.497697  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.669s (SENT) [suppressed 38 similar messages]
I20260709 12:59:28.512566  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:28.515810  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:28.517220  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.424587  4168 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.502390  4264 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.513934  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.508582  4253 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.531781  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.511893  4088 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.521430  1612 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:28.538760  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.439208  4232 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.525873  4263 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.549405  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.531164  4187 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:28.533212  4252 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:28.532905  4317 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:28.516636  4198 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.526558  4101 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.544334  3707 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.572870  4198 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.574715  4212 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.577911  4101 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:28.570628  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.581425  1612 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:28.553246  4187 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.537499  4264 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.559706  4252 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.553916  4205 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.545928  4253 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.591492  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:28.588050  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 90327.1us
W20260709 12:59:28.591710  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 85775.2us
I20260709 12:59:28.570438  4295 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:28.590915  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.571050  4156 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:28.596999  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:28.595738  1608 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6.
I20260709 12:59:28.553009  4088 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.598500  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:28.594151  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 78443.2us
I20260709 12:59:28.590723  4187 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.564636  4263 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.599326  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.604315  1612 raft_consensus.cc:2410] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:28.592831  4252 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.612445  1683 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:28.582499  4317 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:28.613903  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.604377  4023 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.620288  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:28.588876  3707 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:28.622627  4328 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:59:28.625891  1607 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:28.631057  4184 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.612818  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:28.642405  4317 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.631888  4331 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
W20260709 12:59:28.643617  4330 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:59:28.651424  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.599922  4205 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:28.654887  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52364.4us
I20260709 12:59:28.656386  1609 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:28.620127  4023 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.615684  4183 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.683233  1616 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:28.663319  4023 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:28.701314  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.707778  2302 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:28.686353  4333 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:28.672730  4196 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.719624  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:28.720414  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 58314.4us
I20260709 12:59:28.723557  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.710183  4340 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.725430  1608 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:28.728750  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:28.729163  4336 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:59:28.732930  4168 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.734704  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:28.736822  4264 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.739862  4289 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.743394  3707 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.744660  4349 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:28.745213  4349 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.746081  4349 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.726810  4340 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:28.749004  4340 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.751093  4183 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.757589  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.775987  2308 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:28.775743  4224 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:28.784387  4224 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:28.784770  4224 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:28.785657  4224 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.786782  4224 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.788589  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.789340  2303 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:28.791247  2305 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:28.776736  4295 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:28.797389  1608 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:28.798388  1614 raft_consensus.cc:606] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:28.798753  1614 raft_consensus.cc:614] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:28.820863  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 66022.2us
I20260709 12:59:28.824050  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:28.825380  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.825775  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:28.794116  4253 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.826615  1687 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:28.826099  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.828869  1609 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:59:28.829037  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.827847  1611 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:28.827778  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 228527us
I20260709 12:59:28.815631  4289 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.834806  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:28.838418  1690 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.838459  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:28.834824  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:28.823267  3975 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:28.822758  4263 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.846029  1682 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:28.792945  4295 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.830389  4156 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.830241  4101 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:28.823045  4088 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.850255  1684 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:28.850368  1686 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:28.828329  4254 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:59:28.864696  4319 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.640s	user 0.001s	sys 0.015s
I20260709 12:59:28.867019  4352 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:28.867281  4351 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:28.839905  4184 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:28.871189  4101 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.874218  4187 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.876453  4254 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:28.891549  4254 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:28.890089  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.892539  4254 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.866046  4156 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.893780  4254 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:28.895819  4156 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:28.876914  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 48237.7us
I20260709 12:59:28.877295  4205 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.877457  4264 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.827387  4333 consensus_queue.cc:1059] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:59:28.880304  4340 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:28.881573  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.912967  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.883111  4329 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.444s	user 0.004s	sys 0.000s
I20260709 12:59:28.884752  4212 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.889760  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:28.876775  4196 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:28.922791  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.903713  1690 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:28.910760  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.906745  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.918637  4114 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:28.918684  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 96553.5us
W20260709 12:59:28.922058  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.921892  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:28.926297  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.932401  2308 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:28.937475  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:28.938231  1608 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.939097  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.939814  1532 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:28.941128  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.943730  4187 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.908515  4264 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.947634  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.948197  2302 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:28.949232  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:28.949826  1687 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:28.953728  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.954726  1609 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 12:59:28.955001  1537 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:28.956292  1612 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:59:28.947001  1653 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:28.960554  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:28.960793  4252 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.958359  3860 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:28.961951  3860 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:28.962167  4340 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:28.962987  4252 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:28.962920  3860 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:28.958297  4023 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:28.964562  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:28.964766  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:28.960657  4355 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:28.965312  2304 raft_consensus.cc:2368] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:28.966265  1615 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:59:28.966421  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.957759  4183 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:28.966709  1504 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:28.970986  1687 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:28.969833  1537 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:28.972369  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:28.974721  2305 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.976874  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:28.971123  4183 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:28.977588  4183 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.979686  1536 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:28.980633  4187 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.980577  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.981492  1535 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.981580  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.982193  1685 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:28.982353  4079 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:28.983109  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.983207  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.983762  1685 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:28.983934  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.984277  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.984736  1690 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:28.985472  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.985872  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:28.986546  1541 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:28.986460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.987921  1690 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:28.988255  1535 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:28.988554  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:28.985486  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:28.990814  1538 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.995285  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:29.005925  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.948109  4264 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:29.014652  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 62550.3us
I20260709 12:59:29.016302  4186 consensus_queue.cc:1059] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:59:29.017424  3989 raft_consensus.cc:3055] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:29.017786  3989 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:29.018632  3989 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.019884  3989 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.965783  3860 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.027514  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.027830  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:29.028570  1610 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:29.028664  1682 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:29.029543  1610 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.030584  1682 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:29.031200  4342 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:59:29.032191  4339 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:29.035771  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.041303  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:29.015475  1608 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:29.049394  2305 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:28.969126  4156 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:29.065441  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 65932.5us
I20260709 12:59:29.051519  1685 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:28.936905  4205 consensus_queue.cc:1059] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:59:29.059703  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:29.067956  1610 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:29.073971  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.072803  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:29.077436  1612 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:29.082921  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.083324  1687 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:29.074915  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.093555  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:29.094686  1535 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:29.087584  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.065758  4156 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.091081  1538 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:29.091534  2305 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.066936  4339 raft_consensus.cc:697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:29.099779  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.098619  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.081347  4114 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.140092  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54906.3us
I20260709 12:59:29.140398  4332 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:29.140898  4251 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:29.145722  2276 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:29.149777  1535 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:29.096056  4184 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.107924  4156 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:29.349777  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 254142us
I20260709 12:59:29.299115  1616 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.293009  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:29.420589  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 274944us
I20260709 12:59:29.421725  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:29.425443  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:29.344908  1656 connection.cc:256] RPC call timeout handler was delayed by -1.6314821230000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 12:59:29.431802  1656 connection.cc:256] RPC call timeout handler was delayed by -1.456882123000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:59:29.432261  1656 connection.cc:256] RPC call timeout handler was delayed by -1.3875821230000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:59:29.435834  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.436568  1535 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:29.432623  1656 connection.cc:256] RPC call timeout handler was delayed by -1.3767821229999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:59:29.438323  1656 connection.cc:256] RPC call timeout handler was delayed by -1.3182821230000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 12:59:29.438736  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2660821229999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 12:59:29.435480  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:29.224128  4295 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.441017  4295 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:29.442265  4254 consensus_meta.cc:287] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.001s
I20260709 12:59:29.441952  4295 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.442751  3989 raft_consensus.cc:3055] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:29.424440  4184 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.443150  3989 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:29.444486  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:29.445051  1613 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.445242  4184 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:29.444031  3989 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.305043  4347 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.141955  4269 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.306s
I20260709 12:59:29.225395  4023 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:29.448825  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 69783.1us
I20260709 12:59:29.449606  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:29.450409  4269 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.450912  4269 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:29.451313  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.451789  4269 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.452382  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:29.453635  4359 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 12:59:29.457878  1612 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:29.462646  3975 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:29.463316  3975 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.439774  1610 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:29.465432  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.466395  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:29.466615  1612 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:29.472558  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51296 (request call id 13) took 1327 ms. Trace:
I20260709 12:59:29.472994  1614 rpcz_store.cc:276] 0709 12:59:28.144800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.285063 (+140263us) service_pool.cc:224] Handling call
0709 12:59:29.472396 (+1187333us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b5400216954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c45853 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:29.472496 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158641024}
I20260709 12:59:29.474078  4331 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:29.474509  4264 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.467732  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.149865  4114 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.271278  4252 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 12:59:29.145103  4101 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:29.304493  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 401) took 1165 ms. Trace:
I20260709 12:59:29.470844  4225 consensus_queue.cc:1059] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:29.501221  4225 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:29.501613  4225 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:29.502527  4225 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.503803  4225 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.249796  1439 catalog_manager.cc:5697] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:29.481638  4332 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.481397  4205 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:29.485980  4278 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:59:29.505617  4278 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:29.505952  4278 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:29.505802  1439 catalog_manager.cc:5697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 3, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.506806  4278 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.507944  4278 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.507619  1439 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:29.467026  1607 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.477818  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:29.304281  4350 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:59:29.232100  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.510941  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.511408  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.511526  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.222473  1538 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:29.482067  1532 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 12:59:29.512670  1532 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:29.485075  1613 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:29.476827   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:29.488060  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 332) took 1502 ms. Trace:
I20260709 12:59:29.289927  4289 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:29.281076  4198 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:29.491060  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 69455us
W20260709 12:59:29.494096  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.485491  4251 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.496337  4114 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:29.515964  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.474538  4331 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:29.499851  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.481547  3887 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.308530  4339 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.515951  1534 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:29.485524  1535 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:29.516317  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:29.517530  1540 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:29.514122  1611 rpcz_store.cc:276] 0709 12:59:27.978853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.090123 (+111270us) service_pool.cc:224] Handling call
0709 12:59:28.124567 (+ 34444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.829804 (+705237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.481509 (+651705us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54003b7754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:29.481706 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616850816}
I20260709 12:59:29.525962  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:29.492901  1541 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:29.542969  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.547128  1539 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.520720  1537 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:29.516196  3989 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.546015  1536 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:29.519868  4186 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.548784  1533 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:29.549945  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 953100us
W20260709 12:59:29.550737  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.545583  4183 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.001s
I20260709 12:59:29.540624  4198 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.554387  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.560482  1537 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:29.518532  4079 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:29.556766  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.518339  4289 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.557602  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.557832  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.517966  4332 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:29.560663  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.552969  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.552739  4156 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.541100  4196 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:29.564934  1685 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.565091  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.555589  4023 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:29.562426  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:29.601804  1537 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.564656  4352 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:29.603431   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:29.589582  1541 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:29.604108  4186 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.605433  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.525312  4285 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:29.590103  1538 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:29.590489  1540 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:29.543512  4251 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.606244  1541 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.599073  1535 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.548775  3887 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.570107  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:29.619362  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.621749  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.574268  4351 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:29.622624  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:29.624248  4285 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.624646  4352 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:29.564191  4079 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:29.630646  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60640.8us
I20260709 12:59:29.664763  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:29.632407  4370 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:29.634023  4251 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:29.636439  1681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.011s
W20260709 12:59:29.668509  1681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.005s	sys 0.011s
I20260709 12:59:29.563138  4205 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:59:29.621071  4023 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:29.646214  1686 raft_consensus.cc:2393] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:29.647284  4156 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:29.656379  4332 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.599066  4264 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:29.621850  4186 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:29.661886  1537 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.564756  4254 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:59:29.562436  4183 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.645442  4289 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:29.671607  2305 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:29.661284  1607 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:29.682090  2302 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:29.682217  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.666960  4079 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.684610  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:29.672772  4252 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.695245  1538 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.702116  4285 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:29.690198  1506 leader_election.cc:336] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.506s (SENT)
I20260709 12:59:29.698954  1534 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.674678  4251 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:29.674506  4196 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:29.606776  4331 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.691104  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:29.695034  4186 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.714509  1539 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:29.709969  1439 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.691660  4187 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.731649  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 50627.4us
I20260709 12:59:29.718652  4372 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:29.734735  4187 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.709652  4252 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.740257  4252 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:29.740417  4023 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.509711  2301 rpcz_store.cc:276] 0709 12:59:28.056713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.057506 (+   793us) service_pool.cc:224] Handling call
0709 12:59:28.180670 (+123164us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800075f98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26e9c 00007f8d55b26a5b 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:28.180895 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.525704 (+344809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.528566 (+  2862us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.570213 (+ 41647us) log.cc:844] Serialized 26 byte log entry
0709 12:59:28.668610 (+ 98397us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:28.668660 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.668729 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.068611 (+399882us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b24000d4df8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d559e49c4 00007f8d559e2acb 00007f8d55b9ddc9 00007f8d55b9da55 00007f8d55b9cfb0 00007f8d58813488 00007f8d58813be8 00007f8d587eb398 00007f8d587e676a 00007f8d587e5bb6
0709 12:59:29.149959 (+ 81348us) raft_consensus.cc:1685] finished
0709 12:59:29.149986 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.222525 (+ 72539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33766,"raft.queue_time_us":332464,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":14152,"spinlock_wait_cycles":96566912,"thread_start_us":326038,"threads_started":2,"wal-append.queue_time_us":77865}
I20260709 12:59:29.716794  4186 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:29.709324  4251 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.744148  1532 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:29.770216  1533 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.752637  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.753896  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:29.777256  1685 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.753540  1690 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:29.780999  1686 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:59:29.784543  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.754213  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.756940  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:29.790274  2305 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:29.760561  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:29.792420  2302 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
W20260709 12:59:29.761858  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.793843  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.796092  1688 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:29.760960  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.814947  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.815817  1687 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:29.756953  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:29.856740  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.857005  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 72596.5us
I20260709 12:59:29.836642  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:29.789014  1684 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:29.824687  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.759043  1439 catalog_manager.cc:5697] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 6, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 6 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.754818  4198 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:29.858414  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:29.867018  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:29.858322  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.870400  1682 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:29.870957  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.872031  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.757695  4331 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.859597  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.879396  1687 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:29.857782  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.750555  4347 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:29.857960  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 89394.1us
I20260709 12:59:29.868975  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:29.760262  4251 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:29.867444  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:29.873307  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:29.874287  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:29.758587  4186 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:29.756625  4183 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:29.910179  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 100234us
W20260709 12:59:29.918144  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.919590  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:29.920521  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51976.3us
I20260709 12:59:29.857501  4374 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.867074  4225 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:29.869710  4101 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.780313  4264 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:59:29.755621  4254 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 12:59:29.945250  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:29.906332  3989 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:29.916051  4198 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:29.954900  1687 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:29.754012  3975 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:29.909684  4205 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:29.956393  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 276517us
W20260709 12:59:29.959452  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 336925us
I20260709 12:59:29.959146  1439 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 3 to 4, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.920748  4186 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:29.957247  3989 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.957926  4295 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:29.961973  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:29.963169  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:29.964983  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 52046.8us
W20260709 12:59:29.966660  1506 leader_election.cc:336] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.826s (SENT)
I20260709 12:59:29.979028  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:29.948662  4101 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.965085  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:29.972433  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:29.961483  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1521) took 1049 ms. Trace:
I20260709 12:59:29.974249  1608 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:29.971123  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:29.975771  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:29.964991  4225 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:29.988365  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.989583  1582 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:29.965090  4252 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.994235  2302 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:30.001559  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.002148  1682 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.002391  1688 raft_consensus.cc:2410] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:29.998061  1504 leader_election.cc:400] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:30.003013  1504 leader_election.cc:403] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:59:29.955935  4285 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:59:29.972800  4089 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:29.982859  1681 rpcz_store.cc:276] 0709 12:59:28.912111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.912274 (+   163us) service_pool.cc:224] Handling call
0709 12:59:28.936558 (+ 24284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.944792 (+  8234us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:29.670395 (+725603us) log.cc:844] Serialized 14 byte log entry
0709 12:59:29.959099 (+288704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:29.959155 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:29.959203 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.959264 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.961419 (+  2155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2536,"prepare.queue_time_us":277032,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":10967,"raft.queue_time_us":21606,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5979,"thread_start_us":975258,"threads_started":2}
I20260709 12:59:29.970446  4205 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:29.981442  3989 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.012267  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:29.955250  4374 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.001422  4196 raft_consensus.cc:2764] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:29.988951  4101 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:30.013795  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:30.026536  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 59903us
W20260709 12:59:30.027360  1506 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.869s (SENT)
I20260709 12:59:30.027803  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:30.014396  4379 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:59:30.032284  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.032796  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.033456  1686 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.033502  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.034052  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:30.034548  4186 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.034940  4186 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.035264  4186 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.036156  1684 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:30.036578  3887 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.037398  3887 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.038043  3887 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:30.038509  3887 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:30.039265  1534 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:59:30.039616  1534 pending_rounds.cc:85] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 4
I20260709 12:59:30.039835  1534 pending_rounds.cc:107] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:30.039368  3887 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.040050  1534 raft_consensus.cc:2889] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.040515  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.040398  1439 catalog_manager.cc:5697] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:30.041544  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.042229  1681 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.041051  1682 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.041951  1439 catalog_manager.cc:5697] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 3, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:30.043238  4278 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:30.044292  1439 catalog_manager.cc:5697] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 2 to 4, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:30.047552  4187 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.048489  4269 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.048892  4269 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.049245  4269 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.050499  1439 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 4 to 5, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:30.005800  4252 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.055604  4252 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:30.057626  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.058166  4374 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.058445  1684 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.059336  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.059976  1684 raft_consensus.cc:2368] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:30.060895  3975 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:30.060927  1681 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:59:30.040421  1534 pending_rounds.cc:107] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:30.061478  1681 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 12:59:30.061538  1534 raft_consensus.cc:2889] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.061776  1681 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 12:59:30.062040  1681 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 12:59:30.062572  1681 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.063200  4339 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.063803  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 406) took 1117 ms. Trace:
I20260709 12:59:30.064303  2308 rpcz_store.cc:276] 0709 12:59:28.946119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.946893 (+   774us) service_pool.cc:224] Handling call
0709 12:59:30.063617 (+1116724us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400494b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:30.063727 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454096768}
I20260709 12:59:30.032991  1687 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 12:59:30.063755  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.066434  1683 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:30.035192  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:30.067369  1535 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:29.978195  4198 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:59:30.075243  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.078724  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:30.079507  2301 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:30.015523  4205 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.078399  1439 catalog_manager.cc:5697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 4, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:30.081403  1687 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:30.002763  4289 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:59:30.064623  4264 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.086081  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.089699  1684 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:30.083520  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.015908  4094 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:59:30.016726  4351 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:59:30.096881  4094 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:30.097273  4094 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:30.097306  4351 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:30.097889  4351 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:30.098232  4094 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.076541  4252 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.091893  1687 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.016700  4254 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:59:30.103017  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.109033  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.109438  1687 raft_consensus.cc:2368] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:30.036258  4089 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.111738  4089 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.112928  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.114122  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.119572  1687 raft_consensus.cc:2410] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:59:30.114801  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 87476us
I20260709 12:59:30.116514  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.128762  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.104324  1689 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:30.100374  4264 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.129765  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.130497  1689 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.130833  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.131224  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.103717  1690 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
W20260709 12:59:30.127336  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.099442  4094 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:30.132050  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.132516  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.132565  1684 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.133380  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.133437  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.134479  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:30.128837  1506 leader_election.cc:336] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.926s (SENT)
I20260709 12:59:30.135278  1684 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.135883  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.095762  4079 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.136967  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.137478  1540 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:30.137733  1689 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.083938  4251 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.138062  4079 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:30.138540  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.139227  1689 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.139472  4251 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:30.131270  4264 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:30.136170  1506 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.983s (SENT)
W20260709 12:59:30.141018  1506 leader_election.cc:336] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.004s (SENT)
I20260709 12:59:30.141369  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:30.142390  1506 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.043s (SENT)
I20260709 12:59:30.143028  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:30.143507  4079 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:30.138087  1686 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:30.147045  1506 leader_election.cc:336] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.334s (SENT)
I20260709 12:59:30.134532  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.118423  3989 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.147099  1682 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:30.139050  4186 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.151891  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:30.155689  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 231105us
I20260709 12:59:30.152256  1685 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:30.131573  1687 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.156011  1683 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:30.158720  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.153823  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.160733  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.161872  1686 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.139986  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.164060  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.151909  1688 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:30.164891  1690 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:30.165098  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.166049  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.166675  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.163923  1689 raft_consensus.cc:2393] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:30.185532  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.186254  1686 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:30.186506  1682 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:30.191479  1686 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:30.155367  4184 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.206684  1687 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:59:30.208835  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61824.5us
I20260709 12:59:30.210196  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:30.211433  1506 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.335s (SENT)
W20260709 12:59:30.213428  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 223962us
I20260709 12:59:30.219048  1686 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:30.221357  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:30.213893  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 241551us
I20260709 12:59:30.205506  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.216542  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.217959  1689 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:30.224885  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:30.225657  1684 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 3: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.162679  4198 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:59:30.163902  4264 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:59:30.228443  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:30.229077  1607 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:30.229918  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:30.230335  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:30.232117  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:30.219048  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.218104  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 220269us
I20260709 12:59:30.233063  1687 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:59:30.233366  1506 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.408s (SENT)
I20260709 12:59:30.239262  1506 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:30.240368  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:30.242762  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:30.246364  4205 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.248919  3989 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.249017  4269 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.251197  4269 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:30.234403  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:30.187201  4156 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:59:30.252523  1616 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.252935  4156 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:30.253294  4156 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:30.254130  4156 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.256398  4289 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:30.264930  1538 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:30.265507  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.264930  1616 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:30.271078  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:30.269200  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 255481us
W20260709 12:59:30.269651  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.274801  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:30.277099  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45067.9us
I20260709 12:59:30.278098  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.278466  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.279518  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:30.285467  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.282680  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:30.307346  1616 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:30.308477  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:30.306245  1581 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.306200  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:30.309949  1615 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.261034  4391 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.319141  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:30.319504  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:30.320029  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:30.321668  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:30.322008  4198 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:30.323205  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:30.323307  4198 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:30.324396  4251 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:30.324801  4251 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:30.325202  4251 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:30.328384  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 107106us
I20260709 12:59:30.329589  4384 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:30.330103  4384 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:30.330924  4384 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.331441  1582 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:30.332489  4224 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:30.313480  4333 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:30.334528  4224 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:30.334962  4390 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:59:30.335057  4224 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:30.310339  4196 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:59:30.306583  4285 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:30.310174  4352 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.336997  4352 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.339105  4352 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:30.282536  4187 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:30.340994  4187 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:30.341326  4187 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:30.341490  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:30.306303  4089 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.282773  4051 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:30.342782  4051 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:30.343637  4051 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.345702  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.345824  4264 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.346280  4264 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.346707  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.324401  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:30.347666  1685 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.347229  1611 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:30.280197  4392 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.349269  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:30.356127  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.357314  1610 raft_consensus.cc:2368] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7.
I20260709 12:59:30.357278  1690 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:30.358814  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.362636  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 129308us
W20260709 12:59:30.363224  1506 leader_election.cc:336] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.518s (SENT)
I20260709 12:59:30.308439  4289 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:30.309808  4205 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.306486  4386 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:30.369911  1685 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:30.390563  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.408522  4393 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:30.417961  1690 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:30.453537  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:30.454481  1690 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:30.455531  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 92338.4us
I20260709 12:59:30.455577  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:30.455317  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 106828us
I20260709 12:59:30.456740  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:30.453624  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:30.458451  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 233931us
I20260709 12:59:30.320989  3989 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.452701  1507 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:30.506457  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49815.5us
I20260709 12:59:30.356662  4285 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:30.507562  2276 leader_election.cc:400] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7.
I20260709 12:59:30.507978  2276 leader_election.cc:403] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:30.508473  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 97411.2us
I20260709 12:59:30.509385  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:30.455235  4376 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.534s	user 0.004s	sys 0.000s
I20260709 12:59:30.468554  1686 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:30.519433  1686 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:30.470897  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.464280  1690 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
W20260709 12:59:30.520604  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.451942  4386 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.410593  4374 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:30.362169  4264 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.451002  4333 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:30.336026  4224 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:30.536170  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.505915  4289 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:30.536928  1686 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.518517  4089 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:30.544260  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 191732us
W20260709 12:59:30.543488  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.545486  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.528995  4372 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.507282  4205 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.522568  4079 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:30.553800  1506 leader_election.cc:336] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.903s (SENT)
I20260709 12:59:30.554057  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:30.554236  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:30.524067  4386 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.547361  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.502046  4295 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:30.365525  4392 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.560896  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.566054  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:30.566167  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:30.568701  1536 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:30.572492  1686 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.574702  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:30.559644  4051 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:30.572634  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.582683  4387 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:30.539448  4374 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.591985  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:30.501720  4393 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:30.592828  1536 raft_consensus.cc:2410] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:30.589033  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:30.566757  4094 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:30.569257  4198 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:30.558504  4186 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:30.566545  4205 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.569768  4079 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:30.606858  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52873.9us
I20260709 12:59:30.702606   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:30.702065  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:30.614989  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:30.716488  1536 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.602098  4094 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:30.724647  4094 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.614347  3989 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:30.728709  3989 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.729094  3989 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.613871  4289 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.608307  4333 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:30.737313  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.649207  1686 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:30.738860  1686 pending_rounds.cc:85] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 3
I20260709 12:59:30.739107  1686 pending_rounds.cc:107] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:30.739367  1686 raft_consensus.cc:2889] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.754189  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:30.751447  4352 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:30.769973  4351 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.771039  1536 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:30.771206  4351 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:30.772142  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:30.772747  1536 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:30.773535  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:30.773993  1536 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.777143  4392 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:30.777282  4405 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:59:30.779531  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1562) took 1248 ms. Trace:
I20260709 12:59:30.779912  1540 rpcz_store.cc:276] 0709 12:59:29.530920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.621490 (+ 90570us) service_pool.cc:224] Handling call
0709 12:59:30.779354 (+1157864us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400309154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:30.779475 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184458112}
I20260709 12:59:30.781030  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:30.781420  1536 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:30.781538  1540 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.782835  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:30.783411  1536 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.596376  4285 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:30.753360  4101 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.000s
W20260709 12:59:30.801987  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.805892  1686 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:30.804154  1536 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:30.809628  1536 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:30.896175  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.898083  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.770038  4251 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.924480  1612 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:30.927585  1610 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:30.790069  4352 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:30.806689  4269 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.810274  4198 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:30.954365  4391 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.000s
W20260709 12:59:30.921175  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.740082  4079 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.809644  4264 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:30.816695  4101 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:30.925573  4370 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:31.280194  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.958714  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.038113  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.018s	sys 0.018s
W20260709 12:59:30.991053  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.049433  1540 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:31.286417  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.289649  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 674731us
W20260709 12:59:31.286934  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.019s	sys 0.024s
W20260709 12:59:31.291967  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.294669  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.323637  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.338020  1540 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:31.341001  1540 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:59:31.339448  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.253664  3989 consensus_meta.cc:287] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.001s
I20260709 12:59:30.954869  4205 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:31.357424  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:31.361593  2308 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:31.362062  2308 pending_rounds.cc:85] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 5
I20260709 12:59:31.362303  2308 pending_rounds.cc:107] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:31.362547  2308 raft_consensus.cc:2889] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:31.369371  1681 raft_consensus.cc:2368] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 12:59:30.999138  4387 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:31.212787  4425 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:31.286666  4251 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:31.400489  1540 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:31.286438  4374 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:31.291610  4391 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:31.411211  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 127583us
W20260709 12:59:31.410028  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.019s	sys 0.040s
W20260709 12:59:31.411921  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.020s	sys 0.040s
I20260709 12:59:31.173650  4094 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.356853  4089 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:31.456378  1613 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:31.461511  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1298) took 1450 ms (client timeout 1651 ms). Trace:
W20260709 12:59:31.462163  1506 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.651s (SENT)
I20260709 12:59:31.465204  1506 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:31.206274  4352 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.405414  4425 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:31.463490  4264 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:31.469087  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.467031  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.467135  1688 rpcz_store.cc:269] 0709 12:59:30.011545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.011972 (+   427us) service_pool.cc:224] Handling call
0709 12:59:31.461298 (+1449326us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b540032cdd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:31.461437 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114038144}
W20260709 12:59:31.469489  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.372308  3989 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:31.450852  4374 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.463805  4114 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:31.475392  1688 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:31.479743  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1558) took 1120 ms. Trace:
I20260709 12:59:31.495931  1688 rpcz_store.cc:276] 0709 12:59:30.359755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.473895 (+1114140us) service_pool.cc:224] Handling call
0709 12:59:31.475162 (+  1267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.479405 (+  4243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.479662 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:31.498433  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:31.500770  1688 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:31.479972  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.490531  1506 leader_election.cc:336] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.669s (SENT)
I20260709 12:59:31.504935  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:31.585866  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 291) took 1236 ms. Trace:
I20260709 12:59:31.472026  4425 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:31.492637  4416 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:31.605787  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:31.599340  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 187475us
I20260709 12:59:31.612962  1688 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:31.451465  4198 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:31.597347  4403 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.873s	user 0.015s	sys 0.010s
I20260709 12:59:31.598420  4442 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.181s
I20260709 12:59:31.644533  4443 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:31.653636  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 296301us
I20260709 12:59:31.597081  4114 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:31.598315  4432 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.598268  4436 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.598140  4427 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:31.667357  4417 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:59:31.598407  4435 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.609251  4225 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:31.499864  4374 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.473155  4089 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.630811  4395 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.631429  4434 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:31.693048  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.679065  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:31.653494  4285 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:31.680097  4433 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:31.677992  4101 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:31.724980  1611 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:59:31.609180  4404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.013s
I20260709 12:59:31.706534  4225 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:31.746403  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.737847  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1552) took 1388 ms. Trace:
I20260709 12:59:31.666744  4443 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.703722  4427 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:31.739741  4445 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:31.742067  4399 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 1.198s	user 0.015s	sys 0.027s
W20260709 12:59:31.743301  4372 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.187s	user 0.008s	sys 0.000s
I20260709 12:59:31.719478  4435 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.744565  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 414) took 1437 ms. Trace:
W20260709 12:59:31.736800  4404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.007s	sys 0.013s
I20260709 12:59:31.756461  2302 rpcz_store.cc:276] 0709 12:59:30.307305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.307427 (+   122us) service_pool.cc:224] Handling call
0709 12:59:30.307686 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.308002 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:30.540629 (+232627us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.742392 (+201763us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.743324 (+   932us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.743595 (+   271us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:30.743819 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.744484 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.744545 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.482757 (+738212us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:31.744339 (+261582us) raft_consensus.cc:1685] finished
0709 12:59:31.744367 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.744507 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15479,"prepare.queue_time_us":318469,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":5569,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":10874,"spinlock_wait_cycles":12812928,"thread_start_us":404455,"threads_started":2,"wal-append.queue_time_us":828079}
W20260709 12:59:31.744783  4451 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:59:31.745178  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.745292  4409 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.668s	user 0.003s	sys 0.003s
I20260709 12:59:31.746896  1685 rpcz_store.cc:276] 0709 12:59:30.349467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.458482 (+109015us) service_pool.cc:224] Handling call
0709 12:59:30.458858 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.501642 (+ 42784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.501671 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.513148 (+ 11477us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.606547 (+ 93399us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:30.606590 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.606660 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.737556 (+1130896us) raft_consensus.cc:1685] finished
0709 12:59:31.737584 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.737775 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":650,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10929,"thread_start_us":63137,"threads_started":1,"wal-append.queue_time_us":634169}
I20260709 12:59:31.761375  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 362) took 1156 ms. Trace:
I20260709 12:59:31.761686  1685 rpcz_store.cc:276] 0709 12:59:30.605428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.760546 (+1155118us) service_pool.cc:224] Handling call
0709 12:59:31.760863 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.761036 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.761066 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:31.761104 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:31.761138 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.761207 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.761320 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:31.762885  1685 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:31.763391  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 363) took 1150 ms. Trace:
I20260709 12:59:31.763659  1685 rpcz_store.cc:276] 0709 12:59:30.612996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.762497 (+1149501us) service_pool.cc:224] Handling call
0709 12:59:31.762737 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.763186 (+   449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.763343 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:31.764590  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1547) took 1420 ms. Trace:
I20260709 12:59:31.765069  1684 rpcz_store.cc:276] 0709 12:59:30.344556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.344717 (+   161us) service_pool.cc:224] Handling call
0709 12:59:30.345157 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.345537 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.345562 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.345988 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.570616 (+224628us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:30.570673 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.572425 (+  1752us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.744587 (+1172162us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:31.764302 (+ 19715us) raft_consensus.cc:1685] finished
0709 12:59:31.764321 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.764519 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10793,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4005,"spinlock_wait_cycles":19615104,"thread_start_us":224231,"threads_started":1,"wal-append.queue_time_us":471537}
I20260709 12:59:31.753316  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1481) took 1549 ms. Trace:
W20260709 12:59:31.755134  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 76169.4us
I20260709 12:59:31.769027  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:31.768616  1608 rpcz_store.cc:276] 0709 12:59:30.203307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.203456 (+   149us) service_pool.cc:224] Handling call
0709 12:59:30.219581 (+ 16125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.221546 (+  1965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.221574 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.227626 (+  6052us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.587029 (+359403us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:30.587070 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.587141 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.460211 (+873070us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:31.748184 (+287973us) raft_consensus.cc:1685] finished
0709 12:59:31.748205 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.752157 (+  3952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1624,"raft.queue_time_us":3641,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":14821760,"thread_start_us":335146,"threads_started":1,"wal-append.queue_time_us":349505}
I20260709 12:59:31.772011  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1563) took 1140 ms. Trace:
I20260709 12:59:31.772457  1685 rpcz_store.cc:276] 0709 12:59:30.631493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.770956 (+1139463us) service_pool.cc:224] Handling call
0709 12:59:31.771306 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.771518 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.771655 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:31.771711 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:31.771751 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.771823 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.771947 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:31.784149  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 293673us
W20260709 12:59:31.785215  1506 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.689s (SENT)
I20260709 12:59:31.785691  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:31.605844  4387 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:31.725391  4079 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:31.727742  4285 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.784266  4372 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7.
I20260709 12:59:31.789966  4094 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:31.815053  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.689260  4432 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:31.831692  4452 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:59:31.825342  4225 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.826737  4285 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:31.728703  4434 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.804641  3989 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:31.754858  4114 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:31.830176  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1557) took 1470 ms. Trace:
W20260709 12:59:31.855278  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.789834  4395 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.832199  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1554) took 1473 ms. Trace:
I20260709 12:59:31.856452  1686 rpcz_store.cc:276] 0709 12:59:30.358717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.921419 (+562702us) service_pool.cc:224] Handling call
0709 12:59:30.921745 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.400269 (+478524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.400361 (+    92us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.401637 (+  1276us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.598921 (+197284us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:31.598961 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.599025 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.831997 (+232972us) raft_consensus.cc:1685] finished
0709 12:59:31.832020 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.832139 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":529849,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":611494,"threads_started":2,"wal-append.queue_time_us":323045}
I20260709 12:59:31.834769  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:31.854626  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.804421  4445 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:31.860921  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:31.855635  1689 rpcz_store.cc:276] 0709 12:59:30.359478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.235421 (+875943us) service_pool.cc:224] Handling call
0709 12:59:31.235811 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.359234 (+123423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.359267 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.370063 (+ 10796us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.728144 (+358081us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:31.728189 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.728334 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.829994 (+101660us) raft_consensus.cc:1685] finished
0709 12:59:31.830013 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.830124 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226846,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":393970,"threads_started":2,"wal-append.queue_time_us":391961}
I20260709 12:59:31.835304  4372 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:31.857168  4285 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:31.888716  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:31.889467  1541 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
W20260709 12:59:31.891942  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.896448  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 90247.4us
I20260709 12:59:31.898988  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:31.876801  4432 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:31.899634  1608 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:31.900946  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.866597  4442 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:59:31.903872  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:31.905392  4440 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:59:31.905472  4427 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:31.906002  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:31.906540  4437 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 12:59:31.906988  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:31.889505  4225 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.888860  4445 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.930176  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:31.949818  2305 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:31.949937  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1562) took 1319 ms. Trace:
I20260709 12:59:31.950332  1684 rpcz_store.cc:276] 0709 12:59:30.630561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.766714 (+1136153us) service_pool.cc:224] Handling call
0709 12:59:31.766970 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.767161 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:31.869263 (+102102us) log.cc:844] Serialized 14 byte log entry
0709 12:59:31.949601 (+ 80338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:31.949650 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:31.949692 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.949764 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.949886 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12158,"prepare.queue_time_us":120183,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":169524,"threads_started":2}
W20260709 12:59:31.938915  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.869750  4372 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.959374  4023 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.959546  4445 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:31.964565  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:31.883888  4285 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:31.972741  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.973588  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:31.917383  4432 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.917086  4374 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:31.967555  4094 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:32.008924  2303 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:32.010618  4445 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:31.910862  4459 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:59:32.014709  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1553) took 1664 ms. Trace:
I20260709 12:59:32.015113  1682 rpcz_store.cc:276] 0709 12:59:30.350079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.779033 (+428954us) service_pool.cc:224] Handling call
0709 12:59:30.779344 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.779704 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.779731 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.780188 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.414153 (+633965us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:31.414236 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.414475 (+   239us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.014508 (+600033us) raft_consensus.cc:1685] finished
0709 12:59:32.014527 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.014652 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":668416,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":633553,"threads_started":1,"wal-append.queue_time_us":948523}
I20260709 12:59:32.022616  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1575) took 1464 ms. Trace:
I20260709 12:59:32.023166  1533 rpcz_store.cc:276] 0709 12:59:30.558532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.558846 (+   314us) service_pool.cc:224] Handling call
0709 12:59:30.559233 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.587916 (+ 28683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.587960 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.607929 (+ 19969us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.087585 (+479656us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:31.087642 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.087735 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.014519 (+926784us) raft_consensus.cc:1685] finished
0709 12:59:32.014537 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.022529 (+  7992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4820,"raft.queue_time_us":23344,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":10452,"thread_start_us":336725,"threads_started":1,"wal-append.queue_time_us":688654}
I20260709 12:59:32.032284  2305 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:31.973534  4023 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.014021  4464 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:32.042582  1536 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:32.038108  4443 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.053792  4023 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.026605  4462 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.059484  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.031447  4460 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:32.005674  4432 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.069779  4462 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.073503  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:32.064980  2301 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:32.038475  4089 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.073956  4187 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.072469  4460 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:32.085858  4450 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:32.088471  4023 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:32.114547  4386 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.544s	user 0.011s	sys 0.001s
I20260709 12:59:32.115005  4386 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:32.115808  1506 leader_election.cc:336] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.729s (SENT)
I20260709 12:59:32.116396  4486 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.116439  1541 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:32.117084  4386 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.117031  4486 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.117534  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:32.119017  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:32.102623  4187 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.121111  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:32.121721  2301 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:32.123265  4114 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.132447  4450 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:32.134044  4467 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:59:32.134788  4394 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 1.793s	user 0.012s	sys 0.017s
I20260709 12:59:32.135283  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1560) took 1583 ms. Trace:
W20260709 12:59:32.136490  4471 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:59:32.135859  1688 rpcz_store.cc:276] 0709 12:59:30.551482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.613685 (+1062203us) service_pool.cc:224] Handling call
0709 12:59:31.614057 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.676593 (+ 62536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.676630 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.705789 (+ 29159us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.879264 (+173475us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:31.879320 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.879408 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.135018 (+255610us) raft_consensus.cc:1685] finished
0709 12:59:32.135039 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.135217 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34562,"raft.queue_time_us":55886,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":9825,"thread_start_us":132719,"threads_started":1,"wal-append.queue_time_us":256131}
W20260709 12:59:32.138173  4401 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 1.540s	user 0.004s	sys 0.021s
I20260709 12:59:32.140609  4432 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.141525  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1564) took 2610 ms. Trace:
I20260709 12:59:32.141906  1537 rpcz_store.cc:276] 0709 12:59:29.531535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.698387 (+166852us) service_pool.cc:224] Handling call
0709 12:59:29.700277 (+  1890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.014530 (+314253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.014561 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.015024 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.424291 (+409267us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:30.424348 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.424443 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.088299 (+1663856us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:32.141185 (+ 52886us) raft_consensus.cc:1685] finished
0709 12:59:32.141208 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.141440 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32610,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":106,"spinlock_wait_cycles":4821888,"thread_start_us":633736,"threads_started":2,"wal-append.queue_time_us":450696}
I20260709 12:59:32.144403  4458 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.145071  4458 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:32.148500  4461 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:59:32.149730  4435 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.150524  4372 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.151134  4285 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:32.152474  4472 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:59:32.158680  1653 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:32.160071  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:32.160704  2301 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:32.164083  4114 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:32.164712  4114 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:32.165602  4114 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.166158  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 348) took 1856 ms. Trace:
I20260709 12:59:32.166535  1614 rpcz_store.cc:276] 0709 12:59:30.310078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.310332 (+   254us) service_pool.cc:224] Handling call
0709 12:59:30.321500 (+ 11168us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:30.454741 (+133241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.454775 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:30.536702 (+ 81927us) log.cc:844] Serialized 52 byte log entry
0709 12:59:30.632577 (+ 95875us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:30.787932 (+155355us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.800524 (+ 12592us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.800850 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.800992 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.484811 (+683819us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b1800098200. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b2c2a6 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5db6bb37 00007f8d5db6b9ca 00007f8d5dc6326f
0709 12:59:31.486358 (+  1547us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b48000438d8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5db6bb37 00007f8d5db6b9ca 00007f8d5dc6326f 00007f8d5dc62f37 00007f8d5dc7755c 00007f8d5dc77508 00007f8d5dc77488 00007f8d5dc77443 00007f8d5dc766ec 00007f8d5cba0a96
0709 12:59:32.153850 (+667492us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b1800098200. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:32.165952 (+ 12102us) raft_consensus.cc:1685] finished
0709 12:59:32.165973 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.166097 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100103,"prepare.queue_time_us":398661,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":136241,"raft.run_cpu_time_us":13936,"raft.run_wall_time_us":630567,"spinlock_wait_cycles":252600832,"thread_start_us":218328,"threads_started":2,"wal-append.queue_time_us":404042}
W20260709 12:59:32.169872  4425 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.003s
I20260709 12:59:32.170099  4445 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:32.170580  4445 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.170282  4425 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:32.170996  4445 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:32.172972  4370 consensus_meta.cc:287] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.001s
I20260709 12:59:32.173413  4370 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:32.120373  4023 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.175949  4023 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.178158  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:32.183842  4445 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.187588  4462 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.153285  4460 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.196862  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1334) took 2097 ms. Trace:
I20260709 12:59:32.203925  1687 rpcz_store.cc:276] 0709 12:59:30.099108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.207582 (+108474us) service_pool.cc:224] Handling call
0709 12:59:30.207866 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.238292 (+ 30426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.196606 (+1958314us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400256054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:32.196804 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57057664}
I20260709 12:59:32.204516  4445 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:31.586341  1538 rpcz_store.cc:276] 0709 12:59:30.348960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.360610 (+ 11650us) service_pool.cc:224] Handling call
0709 12:59:30.408971 (+ 48361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.409297 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.409324 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.409746 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.295726 (+885980us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:31.585189 (+289463us) log.cc:844] Serialized 14 byte log entry
0709 12:59:31.585454 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.585553 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.585605 (+    52us) raft_consensus.cc:1685] finished
0709 12:59:31.585621 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.585793 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4390,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":18178,"thread_start_us":993326,"threads_started":2,"wal-append.queue_time_us":1006138}
I20260709 12:59:32.206439  3989 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:32.206921  3989 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.191596  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:32.201004  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 78152us
I20260709 12:59:32.208866  3989 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.212942  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:32.213249  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:32.213999  4450 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.214437  4458 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.215342  4460 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.215451  4450 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:32.216898  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:32.215988  4450 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:32.218272  4450 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.221443  4435 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:32.221566  4406 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.473s	user 0.020s	sys 0.009s
I20260709 12:59:32.221916  4435 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:32.222339  4435 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.225118  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1320) took 2169 ms. Trace:
I20260709 12:59:32.225571  1683 rpcz_store.cc:276] 0709 12:59:30.055897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.167431 (+111534us) service_pool.cc:224] Handling call
0709 12:59:30.208601 (+ 41170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.220483 (+ 11882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.220522 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.236744 (+ 16222us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.505610 (+268866us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:30.527374 (+ 21764us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.527567 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.527635 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.220841 (+1693206us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:32.224775 (+  3934us) raft_consensus.cc:1685] finished
0709 12:59:32.224895 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.225049 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21625,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":2630,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":6927,"spinlock_wait_cycles":12163840,"thread_start_us":165566,"threads_started":1,"wal-append.queue_time_us":315439}
I20260709 12:59:32.228756  4393 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.216988  4434 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.236583  3975 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.237277  3975 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.240075  4186 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.240526  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49005.8us
I20260709 12:59:32.240700  4225 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:32.242167  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:32.242884  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:32.243211  1582 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:32.242274  4225 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:32.236140  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 347) took 1926 ms. Trace:
W20260709 12:59:32.252508  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.254570  1613 rpcz_store.cc:276] 0709 12:59:30.309786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.310390 (+   604us) service_pool.cc:224] Handling call
0709 12:59:30.310689 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.464559 (+1153870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.235921 (+771362us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540020bf54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:32.236082 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634499456}
W20260709 12:59:32.263561  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 221072us
I20260709 12:59:32.270730  2276 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:32.271998  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.274772  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 158993us
I20260709 12:59:32.240549  4186 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.283623  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.284518  1541 raft_consensus.cc:2410] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:59:32.284739  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.284993  4420 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:32.285496  1538 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:32.268553  4254 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:32.268658  4023 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.286854  4435 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.286322  4269 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:32.287467  4023 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.285456  4420 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.302496  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:32.283696  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:32.303676  2304 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.284395  4397 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.294201  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.310256  1608 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:32.307785  4347 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:59:32.311839  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:32.312364  4347 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.312604  2303 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:32.312707  4347 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:32.313550  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.313938  4397 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.268373  4352 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:32.314759  4352 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.315120  4352 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:32.316035  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.313686  1611 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:59:32.317369  2304 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:32.318403  1653 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:32.304885  1506 leader_election.cc:336] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.754s (SENT)
I20260709 12:59:32.315562  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:32.320257  1610 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.348860  1614 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:32.354039  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.355207  1533 raft_consensus.cc:2410] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:32.351020  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:32.356343  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.358657  1536 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:32.288465  4332 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:32.370834  4332 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:32.371374  4332 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.371789  4454 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:32.372205  4454 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:32.372951  4454 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.373870  4454 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.351426  4269 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:32.360124  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.376565  1533 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:32.379045  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.379573  1611 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:32.364753  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:32.380384  4465 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:32.381136  4465 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.366047  1538 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:32.366532  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.383248  1541 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:32.384344  4441 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.384927  4441 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.386914  1611 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:32.380398  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.368782  1608 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:32.369110  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1574) took 1812 ms. Trace:
I20260709 12:59:32.369275  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.390663  1613 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 4.
I20260709 12:59:32.316468  4187 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.370095  4023 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.349318  4445 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:32.364831  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:32.393064  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:32.421579  2305 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:32.421665  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.390372  1534 rpcz_store.cc:276] 0709 12:59:30.556336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.556479 (+   143us) service_pool.cc:224] Handling call
0709 12:59:30.556760 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.581840 (+ 25080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.581874 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.581914 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:30.581950 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.368909 (+1786959us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b54003b4554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:32.368954 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.369060 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57209216}
I20260709 12:59:32.422585  1533 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 12:59:32.423592  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.332998  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:32.302515  4477 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.268946  4434 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:59:32.288602  4460 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:59:32.416842  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.424970  1610 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:32.426151  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.427323  1541 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.320890  4386 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:32.307958  4420 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.429989  1533 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:32.429989  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.435474  1537 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 3.
I20260709 12:59:32.431084  1538 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:32.308717  4425 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:32.322882  3975 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.442497  1610 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:32.444720  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.445657  1532 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:32.447178  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:32.455834  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 150999us
I20260709 12:59:32.428213  4445 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:32.463786  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.466148  1532 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:32.442096  4023 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:32.421319  4187 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.471570  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:32.477312  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 451058us
I20260709 12:59:32.477901  1539 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:32.376132  4269 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.313587  4347 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.480542  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:32.481891  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 238280us
W20260709 12:59:32.482621  1656 connection.cc:256] RPC call timeout handler was delayed by -2.747074973999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:59:32.488320  1656 connection.cc:256] RPC call timeout handler was delayed by -2.7047749739999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 12:59:32.460335  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:32.488796  1656 connection.cc:256] RPC call timeout handler was delayed by -2.6615749739999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:59:32.493173  1656 connection.cc:256] RPC call timeout handler was delayed by -2.6453749739999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 12:59:32.493637  1656 connection.cc:256] RPC call timeout handler was delayed by -2.6327749739999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:59:32.494248  1656 connection.cc:256] RPC call timeout handler was delayed by -2.5886749739999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:59:32.494542  1656 connection.cc:256] RPC call timeout handler was delayed by -2.560774973999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:59:32.439754  4386 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:32.494818  1656 connection.cc:256] RPC call timeout handler was delayed by -2.5526749739999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 12:59:32.464775  4435 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:32.495023  1536 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:32.490720  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:32.495187  1656 connection.cc:256] RPC call timeout handler was delayed by -2.5247749739999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:59:32.496979  1656 connection.cc:256] RPC call timeout handler was delayed by -2.5202749739999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
I20260709 12:59:32.475471  4445 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:32.497344  1656 connection.cc:256] RPC call timeout handler was delayed by -2.3825749739999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:59:32.501993  1656 connection.cc:256] RPC call timeout handler was delayed by -2.3654749739999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:59:32.502313  1656 connection.cc:256] RPC call timeout handler was delayed by -2.3132749739999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:59:32.502573  1656 connection.cc:256] RPC call timeout handler was delayed by -2.3087749739999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 12:59:32.502822  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1602749739999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 12:59:32.503122  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1350749739999628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:59:32.503418  1656 connection.cc:256] RPC call timeout handler was delayed by -1.98027497399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23620000000000002s for a response
W20260709 12:59:32.503674  1656 connection.cc:256] RPC call timeout handler was delayed by -1.9586749739999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23860000000000003s for a response
W20260709 12:59:32.503925  1656 connection.cc:256] RPC call timeout handler was delayed by -1.1792749739999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3252s for a response
I20260709 12:59:32.429836  4477 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:32.490123  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.501381  1690 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:32.511268  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:32.511927  1689 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.512136  1690 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:32.487095  4427 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.507046  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:32.507297  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:32.510598  1686 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:32.498281  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:32.553632  1532 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:32.505491  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:32.554545  1683 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:32.513089  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:32.506913  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:32.555302  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:32.516137  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:32.548527  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1316) took 2493 ms (client timeout 2004 ms). Trace:
W20260709 12:59:32.556300  1681 rpcz_store.cc:269] 0709 12:59:30.054916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.087280 (+ 32364us) service_pool.cc:224] Handling call
0709 12:59:32.548265 (+2460985us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540012e154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:32.548436 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868769664}
I20260709 12:59:32.516256  1684 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.555371  1687 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:32.551021  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 307860us
I20260709 12:59:32.558087  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:32.558826  1687 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:32.566903  1539 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:32.555236  1690 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:32.569629  1684 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:32.569756  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:32.482749  4458 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:59:32.572432  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 78416.3us
W20260709 12:59:32.572919  2306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 416) took 2265 ms (client timeout 2109 ms). Trace:
W20260709 12:59:32.573468  2306 rpcz_store.cc:269] 0709 12:59:30.307863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.309451 (+  1588us) service_pool.cc:224] Handling call
0709 12:59:32.572642 (+2263191us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000ee2d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:32.572831 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3356598144}
I20260709 12:59:32.582628  1539 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [5.3-6.4]
W20260709 12:59:32.583542  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.585911  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:32.587471  1690 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.587983  1690 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:32.589728  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.514616  4441 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:32.592196  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 87512.7us
I20260709 12:59:32.600498  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:32.592350  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 94330us
I20260709 12:59:32.612977  1681 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:32.613020  1689 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:32.626263  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:32.567399  4427 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.581851  4252 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:59:32.633808  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:32.638429  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:32.638552  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:32.639163  1538 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.555603  4395 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:59:32.650977  4156 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.651198  4446 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.652274  4507 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:32.652609  4484 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:32.653086  4484 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.653405  4484 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.660759  1682 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:32.670056  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 62506.5us
I20260709 12:59:32.670056  4506 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:32.671013  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:32.671767  4506 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:32.674713  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.681368  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 98835.5us
I20260709 12:59:32.605078  4460 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:59:32.692696  1539 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:59:32.690644  1682 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:32.694687  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.689677  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:32.719025  4479 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 12:59:32.720144  1688 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:32.731782  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.702414  1538 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
W20260709 12:59:32.736285  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 48421.8us
W20260709 12:59:32.746713  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.734973  4332 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:32.777413  4489 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 12:59:32.777928  4332 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.778818  4051 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:32.779261  4051 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.779611  4051 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.782697  4500 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:59:32.788537  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.726814  4374 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.799952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:32.806455  4385 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:59:32.807004  4352 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.728157  4415 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.320s
I20260709 12:59:32.808732  2308 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.809238  4415 raft_consensus.cc:3055] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.809599  4415 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:32.751073  4224 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:32.800292  4500 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:32.802927  4187 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.651922  4446 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:32.862926  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.830686  4386 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:32.815915  3975 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.894207  4427 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:32.890951  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 200141us
W20260709 12:59:32.847733  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 221562us
I20260709 12:59:32.810524  4415 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.901762  4415 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:32.889402  4498 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:59:32.902745  4474 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.831s	user 0.002s	sys 0.002s
I20260709 12:59:32.905519  4446 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.880146  4500 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:32.906354  3975 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.906896  4500 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.908483  3975 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.846549  4224 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:32.813321  4374 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.912397  4477 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.926533  4420 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:32.921001  4224 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.929502  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:32.935197  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.940790  4420 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.889698  4187 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:32.944571  4477 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:32.944660  4187 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:32.946254  4477 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:32.946815  4477 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:32.947652  4477 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.949014  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:32.950403  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 137838us
I20260709 12:59:32.953040  2308 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:32.952785  4427 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:32.953763  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.959903  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:32.960541  1686 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:32.957927  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.964803  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:32.969446  4427 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:32.969848  4427 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:32.975953  4427 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:32.977814  4427 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.983563  4352 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:32.984745  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 364) took 1371 ms. Trace:
I20260709 12:59:32.985255  1685 rpcz_store.cc:276] 0709 12:59:31.613661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.773917 (+160256us) service_pool.cc:224] Handling call
0709 12:59:31.774190 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.865859 (+ 91669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.865886 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:31.865921 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:31.865949 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.984508 (+1118559us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b540035b954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:32.984549 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.984687 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210422656}
W20260709 12:59:32.988869  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.013176  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 443490us
W20260709 12:59:32.987805  4408 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 2.171s	user 0.016s	sys 0.009s
I20260709 12:59:33.045684  1688 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:33.045820  2275 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:32.951660  4441 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.986868  1690 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.042992  1581 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:33.009627  4497 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:33.051700  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:33.057210  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 129438us
I20260709 12:59:33.058765  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:33.059556  1688 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.042258  4187 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:33.074568  4495 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:33.076424  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:33.053787  4446 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.013396  4156 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:33.079818  1688 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:33.055361  4352 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:33.127182  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:33.066108  4187 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:33.144912  1688 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:33.055016  4441 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.084378  4446 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:33.154136  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88451.7us
I20260709 12:59:33.176112  1656 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6.
I20260709 12:59:33.148490  4352 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.182785  4352 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:33.183521  4352 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:33.184842  4225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.004s	sys 0.019s
W20260709 12:59:33.199537  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.188320  1506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.015s
I20260709 12:59:33.157135  3975 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:33.200088  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.016s
I20260709 12:59:33.174150  4446 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:33.219729  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 581371us
W20260709 12:59:33.197856  4484 consensus_meta.cc:287] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.002s
W20260709 12:59:33.236155  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.237522  4396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.026s	sys 0.052s
W20260709 12:59:33.237977  4396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.026s	sys 0.052s
I20260709 12:59:33.238060  4509 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:33.241967  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.014s
W20260709 12:59:33.242484  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.005s	sys 0.014s
W20260709 12:59:33.242839  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 684544us
W20260709 12:59:33.239876  1684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.009s
W20260709 12:59:33.244787  1684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.010s	sys 0.009s
I20260709 12:59:33.174397  4420 consensus_queue.cc:1059] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:59:33.143117  4502 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 12:59:33.207615  4225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.005s	sys 0.019s
I20260709 12:59:33.154639  4495 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:59:33.224313  4454 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.850s	user 0.013s	sys 0.000s
I20260709 12:59:33.202232  3975 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:33.243682  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:33.197359  4352 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:33.290263  1687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.006s	sys 0.013s
W20260709 12:59:33.314682  1687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.006s	sys 0.014s
W20260709 12:59:33.290607  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.009s
W20260709 12:59:33.314721  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 138818us
W20260709 12:59:33.315474  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.011s	sys 0.009s
W20260709 12:59:33.315771  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 578277us
I20260709 12:59:33.295104  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 344) took 3009 ms. Trace:
I20260709 12:59:33.255419  4509 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.319074  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:33.322151  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:33.323395  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:33.288739  4156 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:33.327708  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.324170  2302 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:33.330828  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 87256us
I20260709 12:59:33.316437  1607 rpcz_store.cc:276] 0709 12:59:30.274959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.275057 (+    98us) service_pool.cc:224] Handling call
0709 12:59:30.306641 (+ 31584us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:30.339775 (+ 33134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.339817 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:30.340421 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 12:59:30.551482 (+211061us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:30.605708 (+ 54226us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.615920 (+ 10212us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.744329 (+128409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.744399 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.739773 (+995374us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b1800357160. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:32.153147 (+413374us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b1800357160. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:32.983691 (+830544us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:33.283952 (+300261us) raft_consensus.cc:1685] finished
0709 12:59:33.283981 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.284161 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167565,"prepare.queue_time_us":544019,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":357551,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":5769,"spinlock_wait_cycles":132006528,"thread_start_us":247905,"threads_started":2,"wal-append.queue_time_us":403823}
I20260709 12:59:33.339097  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:33.340184  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:33.297462  1688 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
W20260709 12:59:33.334405  4051 consensus_meta.cc:287] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.002s
I20260709 12:59:33.277997  4484 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.358338  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:33.353660  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.330579  4415 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.332726  4331 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:33.232100  4187 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.325987  4332 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:33.294304  4224 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:33.351320  4396 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:33.327490  4500 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.363987  4051 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.367177  4331 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:33.377596  4484 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:33.378080  4224 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:33.371455  4503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.014s	sys 0.007s
W20260709 12:59:33.394317  4503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.014s	sys 0.008s
I20260709 12:59:33.394876  4503 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.395395  4503 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.395814  4051 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:33.396454  4051 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.391211  4331 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:33.397795  4503 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:33.402112  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:33.383710  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:33.385360  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.350852  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:33.386879  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:33.365556  4415 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.392889  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:33.418984  1539 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.409693  1541 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
W20260709 12:59:33.468437  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.431872  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 368815us
W20260709 12:59:33.432758  1534 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.045s	sys 0.082s
W20260709 12:59:33.470728  1534 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.050s	sys 0.083s
W20260709 12:59:33.471236  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.407075  4269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.013s	sys 0.010s
I20260709 12:59:33.483006  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 301) took 1057 ms. Trace:
W20260709 12:59:33.424266  4254 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.022s
I20260709 12:59:33.425956  4187 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:33.400471  4445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.012s
I20260709 12:59:33.400986  4352 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:33.429171  3975 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.483706  1534 rpcz_store.cc:276] 0709 12:59:32.425333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.425447 (+   114us) service_pool.cc:224] Handling call
0709 12:59:32.425738 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.426037 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.426063 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.426487 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.603213 (+176726us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:33.472712 (+869499us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.482571 (+  9859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.482682 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.482744 (+    62us) raft_consensus.cc:1685] finished
0709 12:59:33.482764 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.482930 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16724,"prepare.queue_time_us":48294,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":23258,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":11816,"thread_start_us":971830,"threads_started":2,"wal-append.queue_time_us":506103}
I20260709 12:59:33.427901  4415 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.529798  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1569) took 1022 ms. Trace:
I20260709 12:59:33.530277  1682 rpcz_store.cc:276] 0709 12:59:32.506984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.507091 (+   107us) service_pool.cc:224] Handling call
0709 12:59:33.529634 (+1022543us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400363654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:33.529738 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261966080}
W20260709 12:59:33.528332  4445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.020s
I20260709 12:59:33.522212  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:33.539124  1539 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:33.528469  4094 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:33.542645  4094 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.543262  4484 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:33.543807  4484 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.545856  4484 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:33.541312  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:33.470420  4441 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:33.484540  4269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.014s	sys 0.010s
I20260709 12:59:33.564324  1581 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:33.568877  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:33.573006  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:33.532832  4254 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.002s	sys 0.022s
I20260709 12:59:33.481114  4514 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:33.519392  4114 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:33.573668  1534 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:33.520712  4427 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:33.514266  4465 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:33.575858  2276 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:33.588766  1539 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:59:33.594707  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.026s
W20260709 12:59:33.608074  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.000s	sys 0.026s
I20260709 12:59:33.574509  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:33.595224  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 365890us
I20260709 12:59:33.609094  1688 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:33.608955  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:33.609969  1684 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.571568  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:33.576954  4514 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.580422  4484 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:33.581832  4446 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.516067  4397 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:33.584772  4509 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:33.558881  4513 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:33.569007  4500 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:33.594767  4198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.004s	sys 0.024s
I20260709 12:59:33.677515  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:33.586364  4224 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:33.657001  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.679761  4468 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:33.588502  4496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.029s	sys 0.061s
W20260709 12:59:33.700572  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.024s	sys 0.059s
W20260709 12:59:33.717944  4496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.029s	sys 0.061s
I20260709 12:59:33.609421  4269 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:33.631039  4352 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.712371  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:33.713356  1684 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:33.706642  4495 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.715845  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:33.716320  1653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.015s
W20260709 12:59:33.746549  1653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.003s	sys 0.015s
I20260709 12:59:33.699589  4484 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:33.718065  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.024s	sys 0.059s
I20260709 12:59:33.677629  4514 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:33.719748  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48014.9us
I20260709 12:59:33.755491  2302 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 7. Ops: []
W20260709 12:59:33.720218  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.614732  4436 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
W20260709 12:59:33.714612  4198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.004s	sys 0.026s
W20260709 12:59:33.745082  1686 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.018s
W20260709 12:59:33.763923  1686 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.005s	sys 0.018s
W20260709 12:59:33.695683  1506 leader_election.cc:336] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.875s (SENT)
I20260709 12:59:33.722681  4513 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:33.739779  4442 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:33.735499  4468 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:33.764158  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.011s	sys 0.003s
I20260709 12:59:33.765745  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:33.766366  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:33.744643  4224 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:33.767892  1689 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.008s	sys 0.017s
I20260709 12:59:33.745133  4269 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:33.777060  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 376) took 1192 ms. Trace:
W20260709 12:59:33.773319  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.011s	sys 0.003s
W20260709 12:59:33.773718  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.779079  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.773964  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 78322us
W20260709 12:59:33.775226  1689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.009s	sys 0.017s
I20260709 12:59:33.758472  4459 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.761214  4484 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:33.791102  1506 leader_election.cc:336] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.893s (SENT)
W20260709 12:59:33.767505  4412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.029s
W20260709 12:59:33.800065  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.000s	sys 0.021s
I20260709 12:59:33.772989  4533 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.747303  4495 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.772760  4442 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:33.793547  4198 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:33.778970  4477 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:33.822593  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.002s	sys 0.021s
I20260709 12:59:33.761457  4465 consensus_queue.cc:1059] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:59:33.822399  4393 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.796319  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.844498  2276 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 1.970s (SENT) [suppressed 30 similar messages]
I20260709 12:59:33.838680  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:33.846783  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.843045  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:33.822438  4412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.015s	sys 0.030s
I20260709 12:59:33.825590  4533 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:33.854476  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 432042us
I20260709 12:59:33.858295  1539 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:33.758553  4252 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.822219  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:33.863185  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:33.879248  1610 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.864192  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:33.858191  4515 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:59:33.880590  1614 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:33.890324  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:33.861838  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:33.891619  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.853725  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 466943us
W20260709 12:59:33.838733  4530 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:59:33.830364  4442 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:33.883122  1539 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:33.884482  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:33.879298  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:33.837169  4396 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:33.856781  4436 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:33.901968  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:33.891134  1541 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:33.876389  4339 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:33.920395  1534 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:33.922461  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:33.922142  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:33.866165  4198 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:33.828919  4459 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:33.925948  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:33.931272  1534 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:59:33.931651  1541 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.881667  4533 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.937844  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:33.931797  1534 pending_rounds.cc:85] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 3
I20260709 12:59:33.940337  1534 pending_rounds.cc:107] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:59:33.940704  1534 raft_consensus.cc:2889] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:33.942993  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 151928us
W20260709 12:59:33.943811  1506 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.913s (SENT)
I20260709 12:59:33.944270  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:33.921952  4523 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:59:33.947826  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:33.867704  4393 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.965590  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:33.925330  4538 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:33.973663  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:33.974658  1684 raft_consensus.cc:2368] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:33.950886  1610 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:33.922549  4339 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:33.928841  4446 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:33.935165  4500 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:33.982961  4526 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:59:33.984355  4536 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.869083  4224 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.981724  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:33.995781  1684 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 12:59:33.986786  1506 leader_election.cc:336] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.942s (SENT)
I20260709 12:59:33.996937  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:33.946327  4114 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:33.989467  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 377) took 1252 ms. Trace:
I20260709 12:59:33.966974  4427 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:33.926924  4441 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:59:33.860392  4513 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.880685  4269 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:33.990396  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:33.992385  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:33.997915  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.004952  1685 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:34.000144  1535 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.928798  4094 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:33.987991  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 143524us
I20260709 12:59:33.977021  4254 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.998715  1681 rpcz_store.cc:276] 0709 12:59:32.737078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.737241 (+   163us) service_pool.cc:224] Handling call
0709 12:59:32.796216 (+ 58975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.950388 (+154172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.950433 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.950967 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.429320 (+478353us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:33.429385 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.429452 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.989278 (+559826us) raft_consensus.cc:1685] finished
0709 12:59:33.989296 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.989406 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151622,"raft.queue_time_us":153964,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":69,"thread_start_us":477860,"threads_started":1,"wal-append.queue_time_us":784965}
I20260709 12:59:33.927731  4436 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:34.015466  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:34.011042  1506 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.952s (SENT)
I20260709 12:59:33.971423  4445 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:59:34.017596  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.011071  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.022815  1685 raft_consensus.cc:2368] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:34.023775  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.023973  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:33.939949  4537 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:59:34.026937  1682 raft_consensus.cc:1240] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:34.030558  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.030568  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.031193  1689 raft_consensus.cc:2376] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6. Re-sending same reply.
I20260709 12:59:34.031349  1534 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:34.032532  1685 raft_consensus.cc:2368] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 12:59:33.900410  4468 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.041572  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.042969  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1506) took 1089 ms. Trace:
I20260709 12:59:34.044472  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.048128  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.017023  4517 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:34.049237  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.049962  1684 raft_consensus.cc:2368] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
W20260709 12:59:34.045779  1506 leader_election.cc:336] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.965s (SENT)
I20260709 12:59:34.020380  4114 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:34.011644  4254 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:34.004966  4396 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.046167  1616 rpcz_store.cc:276] 0709 12:59:32.954001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.954753 (+   752us) service_pool.cc:224] Handling call
0709 12:59:32.958077 (+  3324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.958391 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.958414 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.958825 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.608437 (+649612us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:33.608476 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.608740 (+   264us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.042763 (+434023us) raft_consensus.cc:1685] finished
0709 12:59:34.042782 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.042911 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19927,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":649220,"threads_started":1,"wal-append.queue_time_us":799485}
W20260709 12:59:34.224346  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.077620  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:34.159804  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.221839  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:34.106001  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 76879.1us
I20260709 12:59:34.082446  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.219059  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.240991  1689 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:34.191136  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.070946  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.081372  1541 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:34.239339  1534 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.113679  1535 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:34.115507  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.063398  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:34.247016  1533 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:34.060940  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.248397  1688 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:34.250757  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.239511  1683 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:34.254184  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.241011  1609 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:34.030566  4295 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.277420  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.277442  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.285533  1532 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:34.278097  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.286537  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.287753  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:34.279232  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 233482us
W20260709 12:59:34.292165  1506 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.991s (SENT)
I20260709 12:59:34.280616  1541 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:34.293310  1541 pending_rounds.cc:85] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 3
I20260709 12:59:34.293637  1541 pending_rounds.cc:107] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:34.293923  1541 raft_consensus.cc:2889] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.298442  1616 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:34.058293  4528 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:59:34.071656  4522 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 12:59:34.135365  4529 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
W20260709 12:59:34.180971  4552 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:59:34.239176  4187 consensus_meta.cc:287] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.002s
I20260709 12:59:34.300593  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.129566  4495 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:34.138662  4540 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:59:34.329312  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.286144  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.302798  1532 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:34.059765  4539 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:59:34.026000  4198 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:34.305053  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.062069  4545 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.305088  1541 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:34.305680  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.311056  1533 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:34.311807  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.183979  4442 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.372207  1684 raft_consensus.cc:2410] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:34.072006  4412 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.138398  4393 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:34.316406  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.223543  4435 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:34.105664  4537 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:34.136452  4436 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:34.321979  1607 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.300920  1685 raft_consensus.cc:2368] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:34.392773  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1511) took 1424 ms. Trace:
W20260709 12:59:34.322801  1506 leader_election.cc:336] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.039s (SENT)
I20260709 12:59:34.329310  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.394223  1609 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:34.351153  4374 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.300500  4295 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:34.400327  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.371132  4415 consensus_meta.cc:287] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.846s	user 0.001s	sys 0.009s
W20260709 12:59:34.363631  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.366789  1683 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:34.368175  1688 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:34.403244  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.114997  4546 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.216s
I20260709 12:59:34.314554  4186 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.061553  4289 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.374449  1532 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:34.385385  1539 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:34.184674  4514 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.389452  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.389851  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.393587  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.393316  1608 rpcz_store.cc:276] 0709 12:59:32.968301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.969371 (+  1070us) service_pool.cc:224] Handling call
0709 12:59:32.970045 (+   674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:32.970611 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.970639 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:32.977586 (+  6947us) log.cc:844] Serialized 52 byte log entry
0709 12:59:33.751340 (+773754us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:33.751394 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.751484 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.072272 (+320788us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:34.385407 (+313135us) raft_consensus.cc:1685] finished
0709 12:59:34.385436 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.392693 (+  7257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7889,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"spinlock_wait_cycles":13738752,"thread_start_us":773333,"threads_started":1,"wal-append.queue_time_us":811648}
I20260709 12:59:34.396116  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:34.361930  1534 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:34.392300  4412 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.044966  4339 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.404026  1688 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:34.409161  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.387696  4094 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:34.417462  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.418829  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:34.419346  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.415031  1616 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:34.416038  1534 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:34.420627  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.420930  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:34.405822  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.421693  1683 raft_consensus.cc:2368] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:34.417788  1689 raft_consensus.cc:2393] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:34.422922  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.424026  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.369352  4495 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:34.425482  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.389058  4565 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:34.415766  4331 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.018s	user 0.009s	sys 0.003s
I20260709 12:59:34.395716  4537 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:34.427829  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.424891  4374 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.421566  4436 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:34.428272  4094 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:34.428653  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1509) took 1472 ms. Trace:
I20260709 12:59:34.424692  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.398846  4435 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:34.430888  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 108130us
W20260709 12:59:34.591591  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1181853579999483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23540000000000003s for a response
I20260709 12:59:34.591755  4412 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:34.592267  1506 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.053s (SENT)
I20260709 12:59:34.591730  4339 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:34.593214  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.505671  1607 raft_consensus.cc:2410] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:34.593681  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.427193  4559 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 12:59:34.566921  1681 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.000s
I20260709 12:59:34.419723  4114 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.521124  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:34.598241  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.596515  1681 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:34.592805  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:34.601195  1689 raft_consensus.cc:2410] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:34.501302  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.443024  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.431418  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.602983  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.594347  1613 rpcz_store.cc:276] 0709 12:59:32.955947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.956072 (+   125us) service_pool.cc:224] Handling call
0709 12:59:32.956417 (+   345us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:32.956753 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.956779 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:32.968039 (+ 11260us) log.cc:844] Serialized 78 byte log entry
0709 12:59:33.778639 (+810600us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:33.778679 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.778744 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.428450 (+649706us) raft_consensus.cc:1685] finished
0709 12:59:34.428470 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.428601 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":107,"thread_start_us":810182,"threads_started":1,"wal-append.queue_time_us":950593}
I20260709 12:59:34.605782  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.606292  1608 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:34.385026  4545 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:34.549216  4458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.909s	user 0.028s	sys 0.063s
I20260709 12:59:34.608721  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:34.607620  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 418343us
W20260709 12:59:34.592708  4551 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:59:34.628589  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.629380  1607 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.606340  1616 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:34.620326  1685 raft_consensus.cc:2410] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:34.626372  1688 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:34.415942  4415 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:34.640769  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 398311us
W20260709 12:59:34.624413  4458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.022s	user 0.029s	sys 0.067s
I20260709 12:59:34.631695  1683 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:34.662528  1683 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:34.592284  4331 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.602434  4459 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:34.647315  4254 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:34.615199  4436 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.649173  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.651943  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.653119  1609 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:34.654036  4569 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:34.605432  4374 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.655826  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.426447  4289 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.658190  4435 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.658037  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:34.686466  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.686499  1688 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:34.686595  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 263300us
I20260709 12:59:34.688396  1608 raft_consensus.cc:2410] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:34.659389  4514 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.660892  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 433) took 1111 ms. Trace:
I20260709 12:59:34.701267  2308 rpcz_store.cc:276] 0709 12:59:33.549249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.549466 (+   217us) service_pool.cc:224] Handling call
0709 12:59:33.574613 (+ 25147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.575524 (+   911us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:33.575549 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:33.587967 (+ 12418us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.915292 (+327325us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:33.915426 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.915808 (+   382us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.660651 (+744843us) raft_consensus.cc:1685] finished
0709 12:59:34.660677 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.660828 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":202980,"threads_started":1,"wal-append.queue_time_us":454411}
W20260709 12:59:34.623904  4557 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
I20260709 12:59:34.668946  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:34.666797  1614 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:34.704190  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.705049  1609 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:34.684249  1683 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:34.655148  4570 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:59:34.657630  4484 consensus_meta.cc:287] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.000s
I20260709 12:59:34.679189  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.681048  4537 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.692812  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:34.689023  1581 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:34.681095  4295 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:34.666725  1607 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:34.608289  4565 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.708292  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:34.709854  1614 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:59:34.716631  1613 raft_consensus.cc:1217] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-7.4]   Dedup: 5.3->[7.4-7.4]
I20260709 12:59:34.716919  1683 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.717350  1613 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [3.2-7.4]
I20260709 12:59:34.719666  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:34.721478  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:34.722810  1611 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:34.725982  1611 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:34.727064  1607 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:34.728425  1688 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:34.729450  1616 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:34.737739  1609 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:34.739609  4374 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.717464  4352 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:34.722600  4444 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.722437  4537 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:34.741343  4546 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.728765  4575 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.743918  4442 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:34.747192  3989 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:34.780947  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.754575  4562 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:59:34.715756  4484 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.751451  4444 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.793001  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.756563  4114 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.754990  4545 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:34.788611  4556 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
I20260709 12:59:34.757982  4546 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.793967  4572 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.794818  4579 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:34.808892  4579 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:34.809255  4579 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.809522  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.811203  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.811852  1609 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 4.
I20260709 12:59:34.815605  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:34.816308  1613 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.810165  4484 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:34.792043  3989 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:34.817562  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 72704.3us
W20260709 12:59:34.796268  4252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.005s	sys 0.033s
I20260709 12:59:34.824131  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:34.804280  4563 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:59:34.807906  4289 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:34.800194  4533 consensus_meta.cc:287] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.848s	user 0.007s	sys 0.004s
I20260709 12:59:34.827886  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:34.805773  4571 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:59:34.820997  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.848681  1532 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:34.849098  4588 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:34.824868  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.850251  4588 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:34.851179  1607 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:34.835170  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.810946  4444 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.805418  4331 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:34.797098  4114 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:34.786552  4254 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:59:34.806177  4546 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:34.800906  4574 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:34.755841  4537 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:34.846587  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:34.853677  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 132287us
W20260709 12:59:34.864485  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 121036us
I20260709 12:59:34.886308  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.830094  3989 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:34.837779  4252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.033s
I20260709 12:59:34.852579  1609 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:34.873584  1613 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:34.855489  4094 consensus_queue.cc:1243] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:34.816247  4513 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:34.890300  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.817472  4575 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:59:34.894449  1532 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
W20260709 12:59:34.897763  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.868983  4486 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.808410  4572 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.891583  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.901921  1607 raft_consensus.cc:2376] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6. Re-sending same reply.
I20260709 12:59:34.879282  4114 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.902637  4389 raft_consensus.cc:1027] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: attempt to promote peer c445b7b7d94f48f99a3599ddfc92f462: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:59:34.902782  4114 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.904480  4352 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.904873  4352 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.910457  4434 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:34.910880  4434 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:34.911748  4434 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:34.912727  4434 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.891345  4198 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:34.929648  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.930439  2305 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:34.931546  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.929343  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.913473  4537 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:34.901176  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:34.918133  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.919462  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 304) took 2487 ms. Trace:
I20260709 12:59:34.935077  1532 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:34.920327  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.921169  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.899430  4094 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:59:34.926194  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.938320  2304 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:34.935863  1607 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:34.928843  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.936339  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:34.935129  1536 rpcz_store.cc:276] 0709 12:59:32.432058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.432209 (+   151us) service_pool.cc:224] Handling call
0709 12:59:32.432702 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.495629 (+ 62927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.919232 (+2423603us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540017b1d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:34.919403 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142531456}
I20260709 12:59:34.935225  2308 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:34.936789  4565 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:34.932088  2305 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
W20260709 12:59:34.943248  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.943825  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.944950  4425 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:34.947845  4425 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:34.949016  4425 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:34.951719  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.928879  4588 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:34.943456  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.957324  1653 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:34.958773  2310 raft_consensus.cc:2410] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:59:34.959259  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.857195  4533 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.962277  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:34.960278  4537 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:34.964511  4537 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.964885  4537 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.964604  4579 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:34.970732  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:34.973273  2307 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:34.975329  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:34.987668  1683 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:59:34.988204  1683 pending_rounds.cc:85] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 3
I20260709 12:59:34.988492  1683 pending_rounds.cc:107] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:59:34.988816  1683 raft_consensus.cc:2889] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:34.990527  1683 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:35.000963  1615 raft_consensus.cc:2393] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:35.003134  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:35.001819  1579 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:35.000481  4578 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:34.972733  4579 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:35.012073  1579 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:35.004837  4545 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:59:35.018227  4545 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.015434  4578 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:35.024992  4492 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.425s	user 0.006s	sys 0.002s
I20260709 12:59:35.025240  4578 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.010589  4198 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.031538  4533 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:35.037927  4586 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
W20260709 12:59:35.043576  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.026s	sys 0.034s
W20260709 12:59:35.044960  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.026s	sys 0.034s
I20260709 12:59:35.049712  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1608) took 1064 ms. Trace:
I20260709 12:59:35.018720  4352 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.056767  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:35.058315  2309 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:35.053278  1541 rpcz_store.cc:276] 0709 12:59:33.984846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.397870 (+413024us) service_pool.cc:224] Handling call
0709 12:59:34.398182 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.398374 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:34.398663 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.048506 (+649843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.048564 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:35.048603 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.049502 (+   899us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.049646 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180803,"prepare.queue_time_us":760,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":105,"thread_start_us":649534,"threads_started":1}
I20260709 12:59:35.092111  4114 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.095628  2309 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.096448  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:35.095364  4114 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:35.097186  2307 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:35.097205  4352 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:35.098801  4546 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:35.101516  1681 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:35.101969  1681 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:35.102891  1681 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:35.103870  4572 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:33.777493  1687 rpcz_store.cc:276] 0709 12:59:32.585106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.585260 (+   154us) service_pool.cc:224] Handling call
0709 12:59:32.585610 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.585862 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:33.315159 (+729297us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.776712 (+461553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:33.776767 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:33.776812 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.776876 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.776993 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9515,"prepare.queue_time_us":957459,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":12188,"thread_start_us":1151181,"threads_started":2}
I20260709 12:59:35.082171  4347 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.114822  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.119077  1687 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.104208  1681 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.133620  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:35.123507  4352 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:35.137858  1687 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:35.120348  4254 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:35.149101  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:35.150049  2309 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.149407  2307 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:35.149097  1681 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:59:35.153123  1681 pending_rounds.cc:85] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 2
I20260709 12:59:35.154481  1681 pending_rounds.cc:107] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:59:35.135212  4352 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.155984  1681 raft_consensus.cc:2889] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.161123  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1370) took 1191 ms. Trace:
I20260709 12:59:35.162151  2302 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:35.163484  2302 pending_rounds.cc:85] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 6
I20260709 12:59:35.163771  2302 pending_rounds.cc:107] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:35.164038  2302 raft_consensus.cc:2889] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.165397  1681 rpcz_store.cc:276] 0709 12:59:33.970206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.600014 (+629808us) service_pool.cc:224] Handling call
0709 12:59:34.600338 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.101401 (+501063us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54000cd120. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc2dc0 00007f8d58c4d1c0 00007f8d58c4e231 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c
0709 12:59:35.160881 (+ 59480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.161069 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611606912}
I20260709 12:59:35.173269  3989 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:35.176002  4545 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:35.177141  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.178892  4554 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.850s	user 0.000s	sys 0.001s
I20260709 12:59:35.180596  4546 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:35.120923  4444 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.183362  4444 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:35.185307  3989 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:35.187959  4535 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 1.246s	user 0.000s	sys 0.001s
I20260709 12:59:35.194020  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:35.196326  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1378) took 1205 ms. Trace:
I20260709 12:59:35.196693  1685 rpcz_store.cc:276] 0709 12:59:33.990955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.393351 (+402396us) service_pool.cc:224] Handling call
0709 12:59:35.196146 (+802795us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400393354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:35.196274 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470997376}
I20260709 12:59:35.197005  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.197788  1541 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:35.198598  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:35.199278  4252 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.199595  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.200562  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.200716  1537 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:35.200899  1532 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:35.201221  1534 raft_consensus.cc:2393] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:35.201727  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.202207  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:35.204698  2306 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.204722  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:35.206087  1607 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:35.207104  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:35.171222  4352 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:35.170922  4254 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:35.172601  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:35.186833  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:35.169075  4578 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.208989  2310 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:35.200171  1541 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
W20260709 12:59:35.215536  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.216113  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.219246  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.222455  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:35.222779  1607 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.223050  1609 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:35.223584  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:35.231050  2309 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:35.232319  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.232982  1681 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.199720  4252 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:35.205605  4567 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:35.245607  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 369915us
I20260709 12:59:35.232241  4389 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:35.236567  4395 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:35.250584  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.242933  4490 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.244910  4331 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.248142  4573 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:35.242555  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 360083us
I20260709 12:59:35.274523  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.275084  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.275503  1681 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:35.276032  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.276337  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:35.276638  1537 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:35.277586  1537 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 7. Ops: []
I20260709 12:59:35.277341  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.281000  1681 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.250353  4389 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:35.303908  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.387349  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.368566  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.380195  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 96222.5us
I20260709 12:59:35.243554  4501 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:59:35.251044  4567 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:35.382380  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.382668  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:35.382380  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:35.383088  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:35.385778  4511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.205s	user 0.020s	sys 0.012s
W20260709 12:59:35.386045  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 139651us
I20260709 12:59:35.386309  4395 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:35.389182  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.424934  1681 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:35.425313  1534 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:35.389171  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:35.426147  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:35.427346  1681 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:35.427392  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:35.390031  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.251524  4051 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 12:59:35.421528  1536 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.389500  4389 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.422686  1537 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.423844  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:35.438337  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:35.429642  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:35.430150  1541 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:35.396754  1687 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:35.421264  4511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.021s	sys 0.012s
I20260709 12:59:35.443063  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:35.442375  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:35.259140  4490 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.444021  1616 raft_consensus.cc:2393] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:35.449806  1613 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:35.453226  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.444445  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 173390us
W20260709 12:59:35.445624  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 835794us
W20260709 12:59:35.454362  1506 leader_election.cc:336] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.083s (SENT)
I20260709 12:59:35.395630  3989 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:35.259343  4331 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.459595  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.460417  1687 raft_consensus.cc:2368] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6.
I20260709 12:59:35.439824  2276 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:35.464788  1536 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:35.395480  4546 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:35.389339  4339 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:35.455103  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:35.465842  1681 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:35.467461  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:35.432425  4572 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:35.470851  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 188884us
I20260709 12:59:35.494119  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:35.494994  1534 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.447247  4332 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:35.498852  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:35.496160  4533 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:35.499394  4594 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:59:35.499774  4395 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.516417  4578 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:35.501642  4609 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:59:35.503923  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.520145  4254 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:35.452169  4347 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:35.520792  4347 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.521179  4347 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.520886  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:35.387218  4573 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.523475  4573 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:35.523710  4441 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:35.451143  4387 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.524114  4579 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:35.524628  4387 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.525319  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:35.525767  4332 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:35.526223  4332 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.526667  4387 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:35.505781  1614 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.528358  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:35.529122  4441 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:35.529695  4441 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:35.530428  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1583) took 1959 ms. Trace:
I20260709 12:59:35.530797  1682 rpcz_store.cc:276] 0709 12:59:33.570750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.570933 (+   183us) service_pool.cc:224] Handling call
0709 12:59:33.571315 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.027372 (+456057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.530134 (+1502762us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400019fd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:35.530373 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047459200}
I20260709 12:59:35.530866  4441 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:35.532567  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:35.508214  4331 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:35.508759  4533 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:35.537570  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.394845  4537 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.508481  4490 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:35.468361  3989 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:35.540861  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1591) took 1640 ms (client timeout 1521 ms). Trace:
I20260709 12:59:35.513085  4252 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:35.541184  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.497031  4442 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:35.541320  1539 rpcz_store.cc:269] 0709 12:59:33.900816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.901053 (+   237us) service_pool.cc:224] Handling call
0709 12:59:35.540646 (+1639593us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b540040ced4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:35.540779 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934365952}
I20260709 12:59:35.541814  4442 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:35.542788  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.542824  4442 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.515547  2275 leader_election.cc:400] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6.
I20260709 12:59:35.512862  4511 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:35.496285  4339 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.544930  4511 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:35.544471  2275 leader_election.cc:403] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:59:35.515003  4567 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.590574  4490 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.598078  4537 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:35.497341  1506 leader_election.cc:336] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.086s (SENT)
I20260709 12:59:35.644253  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:35.496446  4546 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:35.645938  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 117659us
I20260709 12:59:35.646862  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:35.648833  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 143143us
I20260709 12:59:35.562397  1537 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:35.651330  1682 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:35.652297  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:35.656440  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:35.652501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:35.659803  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:35.659940  1614 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:35.645614  4252 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:35.662678  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:35.663466  1534 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:35.706893  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:35.660409  1682 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:35.708511  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:35.709430  1682 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:35.649477  4339 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:35.712332  1690 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.650432  4501 consensus_queue.cc:1243] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:35.648656  4579 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:35.824491  1534 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:35.824347  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:35.661266  4434 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:35.872907  4608 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 12:59:35.707738  4537 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.872516  3989 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:35.651428  4450 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.176s
W20260709 12:59:35.880116  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 413673us
I20260709 12:59:35.883033  1690 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:59:35.911013  1690 pending_rounds.cc:85] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 12:59:35.911324  1690 pending_rounds.cc:107] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:59:35.911562  1690 raft_consensus.cc:2889] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:35.911389  1506 leader_election.cc:336] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.196s (SENT)
I20260709 12:59:35.912034  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:35.930171  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.888660  1614 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:35.660643  4156 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.223s
I20260709 12:59:35.945609  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 375) took 3343 ms. Trace:
I20260709 12:59:35.969933  1682 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:35.968019  1690 rpcz_store.cc:276] 0709 12:59:32.568598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.568862 (+   264us) service_pool.cc:224] Handling call
0709 12:59:32.569129 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.986501 (+417372us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4c0004a980. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d56f17a20 00007f8d56f28a29 00007f8d56eee644 00007f8d56f15f2d 00007f8d56f15b93 00007f8d58c4618b 00007f8d58c46cb5 00007f8d58c41f30 00007f8d58c437de 00007f8d58c4db49 00007f8d58c4e416
0709 12:59:35.711701 (+2725200us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b58006e7ed0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58ba70aa 00007f8d58c29447 00007f8d58c41fe7 00007f8d58c437de 00007f8d58c4db49 00007f8d58c4e416 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4
0709 12:59:35.912009 (+200308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.912211 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108308608}
I20260709 12:59:35.977999  4347 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.931229  4427 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.893640  4252 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:35.987792  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.988673  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 77324.2us
I20260709 12:59:35.980618  4427 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:35.971277  4386 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:36.035408  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.998414  4389 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
W20260709 12:59:36.126777  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.277925  1506 leader_election.cc:336] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.203s (SENT)
I20260709 12:59:36.287935  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:36.270929  4490 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.002s
W20260709 12:59:36.152112  4520 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 2.394s	user 0.002s	sys 0.011s
W20260709 12:59:36.124467  4620 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:59:36.254791  4332 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 12:59:36.287012  4347 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:36.286535  4546 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:36.348101  1683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.050s
I20260709 12:59:35.997906  4252 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:36.285991  4573 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.426733  1683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.009s	sys 0.062s
I20260709 12:59:36.416368  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:36.427259  1690 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:36.427371  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.427484  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1612) took 1223 ms. Trace:
I20260709 12:59:36.428092  1683 rpcz_store.cc:276] 0709 12:59:35.203709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.520628 (+316919us) service_pool.cc:224] Handling call
0709 12:59:35.520883 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.521095 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:35.521393 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.427125 (+905732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.427176 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.427216 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.427302 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.427432 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":148231,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":149888,"thread_start_us":905195,"threads_started":2,"wal-append.queue_time_us":702886}
I20260709 12:59:36.289466  4386 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.381376  4458 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:36.291303  4389 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:36.420467  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 142611us
I20260709 12:59:36.440356  1690 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
W20260709 12:59:36.443655  1506 connection.cc:256] RPC call timeout handler was delayed by -2.7206062910000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:59:36.444168  1506 connection.cc:256] RPC call timeout handler was delayed by -2.7084006820000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3311s for a response
I20260709 12:59:36.425128  4332 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:36.465392  1540 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:59:36.466339  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2202) took 1269 ms. Trace:
W20260709 12:59:36.425644  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.416838  4619 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.012356  4441 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.430095  4578 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.435366  4573 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:36.420324  4490 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6.
I20260709 12:59:36.444864  4614 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.445914  1537 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:36.448011  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1618) took 1056 ms. Trace:
I20260709 12:59:36.452307  4458 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:36.453302  4524 log.cc:927] Time spent T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.640s	user 0.010s	sys 0.012s
I20260709 12:59:36.455297  4389 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:36.460476  4252 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:36.467535  1540 rpcz_store.cc:276] 0709 12:59:35.196811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.200303 (+  3492us) service_pool.cc:224] Handling call
0709 12:59:36.464771 (+1264468us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b5800002a98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:36.465065 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.466000 (+   935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.466257 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17045760}
I20260709 12:59:36.477080  1539 rpcz_store.cc:276] 0709 12:59:35.391711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.709730 (+318019us) service_pool.cc:224] Handling call
0709 12:59:35.710102 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.710563 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:35.823935 (+113372us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.234113 (+410178us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.254033 (+ 19920us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.254251 (+   218us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.254846 (+   595us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.260672 (+  5826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.260778 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.447743 (+186965us) raft_consensus.cc:1685] finished
0709 12:59:36.447770 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.447937 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117236,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":1313,"raft.queue_time_us":310,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":73933,"spinlock_wait_cycles":154434432,"thread_start_us":302114,"threads_started":1,"wal-append.queue_time_us":567726}
I20260709 12:59:36.482455  1540 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:36.483217  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1622) took 1055 ms. Trace:
I20260709 12:59:36.483603  1540 rpcz_store.cc:276] 0709 12:59:35.427647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.480794 (+1053147us) service_pool.cc:224] Handling call
0709 12:59:36.482244 (+  1450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.482933 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.483154 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.476886  4614 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:36.487596  4614 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:36.489691  4507 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:36.490249  4507 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:36.491194  4507 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.498050  4573 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:36.500370  1539 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:36.501266  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1623) took 1068 ms. Trace:
I20260709 12:59:36.501713  1539 rpcz_store.cc:276] 0709 12:59:35.432409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.499534 (+1067125us) service_pool.cc:224] Handling call
0709 12:59:36.499937 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.500968 (+  1031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.501201 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.503660  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1627) took 1057 ms. Trace:
I20260709 12:59:36.504407  1539 rpcz_store.cc:276] 0709 12:59:35.445835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.502696 (+1056861us) service_pool.cc:224] Handling call
0709 12:59:36.503058 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.503267 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.503315 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.503372 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.503414 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.503483 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.503603 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:36.505781  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.040s	sys 0.086s
W20260709 12:59:36.507552  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.510692  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.041s	sys 0.086s
I20260709 12:59:36.474829  4619 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:36.511844  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 856578us
I20260709 12:59:36.511322  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1628) took 1064 ms. Trace:
I20260709 12:59:36.514098  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.510337  4507 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.514150  1539 rpcz_store.cc:276] 0709 12:59:35.446107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.509291 (+1063184us) service_pool.cc:224] Handling call
0709 12:59:36.509660 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.509876 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.509908 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.509966 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:36.510010 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.510081 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.510215 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.519711  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:36.522289  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 107906us
I20260709 12:59:36.511775  4332 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:36.522604  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:36.525662  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:36.533571  4458 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:36.478574  4441 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.533967  4619 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:36.524672  4450 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:36.541112  4450 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:36.541471  4450 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:36.554625  4441 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:36.555501  4441 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:36.564512  1690 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:36.565028  1690 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:36.565752  1690 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:36.566629  1690 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:36.572903  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 127735us
W20260709 12:59:36.573556  1506 leader_election.cc:336] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.667s (SENT)
I20260709 12:59:36.555997  4441 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:36.574815  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:36.572718  4555 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.374s	user 0.000s	sys 0.013s
W20260709 12:59:36.577157  1506 connection.cc:256] RPC call timeout handler was delayed by -2.5541062909999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 12:59:36.572747  4519 raft_consensus.cc:3055] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:36.584744  4519 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:36.585762  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:36.585654  4519 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.586751  4519 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.576192  4441 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.600759  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:36.601886  2308 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:36.604018  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:36.605590  2305 raft_consensus.cc:2376] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7. Re-sending same reply.
I20260709 12:59:36.606990  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:36.586771  1613 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:36.576864  1690 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:36.572698  4625 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.572527  4626 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.613339  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:36.579416  1506 leader_election.cc:336] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.354s (SENT)
I20260709 12:59:36.609864  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:36.610749  1690 pending_rounds.cc:85] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 12:59:36.614926  1690 pending_rounds.cc:107] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:36.614217  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.615295  1690 raft_consensus.cc:2889] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:36.615933  4507 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.619110  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:36.693542  2309 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:36.709336  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 183741us
I20260709 12:59:36.688786  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:36.710427  1616 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:36.710381  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:36.713161  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:36.713763  1539 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:36.688948  4630 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:59:36.720018  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:36.707094  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 97362.1us
I20260709 12:59:36.688006  2308 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEARNER]: Advancing to term 8
I20260709 12:59:36.687497  2307 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:59:36.708418  1506 connection.cc:256] RPC call timeout handler was delayed by -2.5100772270000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 12:59:36.723742  1506 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.600s (SENT)
I20260709 12:59:36.724139  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.728304  1539 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:36.729238  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:36.729750  1539 raft_consensus.cc:2376] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7. Re-sending same reply.
W20260709 12:59:36.729965  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.730655  4625 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:36.733896  4625 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.736445  4567 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:59:36.736881  1506 leader_election.cc:336] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 3.144s (SENT)
I20260709 12:59:36.737335  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:36.748891  1506 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 3.277s (SENT)
I20260709 12:59:36.749521  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.750519  4629 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:36.751340  4612 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:36.713521  4626 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.719120  4561 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.618260  4495 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
W20260709 12:59:36.785033  1506 connection.cc:256] RPC call timeout handler was delayed by -2.3015062769999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 12:59:36.794164  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.764837  1579 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:36.819613  1506 connection.cc:256] RPC call timeout handler was delayed by -2.1410772269999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 12:59:36.820047  1506 connection.cc:256] RPC call timeout handler was delayed by -1.983577227000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 12:59:36.820461  1506 connection.cc:256] RPC call timeout handler was delayed by -1.9115772270000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2303s for a response
W20260709 12:59:36.826566  1506 connection.cc:256] RPC call timeout handler was delayed by -1.3091715480000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:59:36.827076  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1273715480000419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 12:59:36.828150  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:36.846026  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 81292.3us
I20260709 12:59:36.846807  1579 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:36.850907  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.858181  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:36.861913  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.859984  4509 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.776630  4629 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:36.826448  4612 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.849233  4626 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.863196  4509 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:36.861444  4567 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:36.874004  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:36.863775  4224 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.856594  4625 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:36.879344  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:36.846468  4507 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.825692  4513 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:36.903451  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:36.904444  1690 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:36.888607  4634 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:59:36.903489  1609 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:36.882817  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1624) took 1441 ms. Trace:
I20260709 12:59:36.867146  4441 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:36.904700  4507 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.911903  4441 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:36.862685  4619 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.864339  4614 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:36.762773  4450 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.912767  4507 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:36.889936  4626 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:36.817400  4186 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:59:36.918375  4186 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:36.897456  1532 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:36.918716  4186 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:36.865487  3975 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:36.885250  4458 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.887693  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.868011  4590 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.888758  4509 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.900650  4224 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:36.865985  4352 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:59:36.885623  4612 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:36.897451  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.471964  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1621) took 2078 ms. Trace:
I20260709 12:59:36.909044  1540 rpcz_store.cc:276] 0709 12:59:35.441256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.504256 (+1063000us) service_pool.cc:224] Handling call
0709 12:59:36.508746 (+  4490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.509476 (+   730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.509516 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.510117 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.577221 (+ 67104us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.881964 (+304743us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.882294 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.882531 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.882583 (+    52us) raft_consensus.cc:1685] finished
0709 12:59:36.882600 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.882754 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1484,"prepare.queue_time_us":3655,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3306,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":14242,"thread_start_us":361890,"threads_started":2,"wal-append.queue_time_us":207411}
W20260709 12:59:37.472977  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.929617  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2163) took 2279 ms. Trace:
I20260709 12:59:37.473570  1608 rpcz_store.cc:276] 0709 12:59:34.650112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.700890 (+ 50778us) service_pool.cc:224] Handling call
0709 12:59:34.718486 (+ 17596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.742061 (+ 23575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.742091 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.742132 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:34.742160 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.742223 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.929390 (+2187167us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b54003f4150. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:36.929542 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23224,"raft.queue_time_us":23823,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7879,"spinlock_wait_cycles":9850240}
I20260709 12:59:37.472700  1536 rpcz_store.cc:276] 0709 12:59:35.393969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.451312 (+1057343us) service_pool.cc:224] Handling call
0709 12:59:36.451660 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.571169 (+119509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.571214 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.576753 (+  5539us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.844776 (+268023us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:36.844839 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.844938 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.471719 (+626781us) raft_consensus.cc:1685] finished
0709 12:59:37.471741 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.471899 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24042,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":1118,"thread_start_us":386623,"threads_started":2,"wal-append.queue_time_us":326738}
I20260709 12:59:36.931104  1611 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:37.011201  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.476605  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:37.477049  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:37.477623  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.477526  1536 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:36.938910  2308 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:59:36.993660  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2155) took 2376 ms (client timeout 1745 ms). Trace:
W20260709 12:59:37.429272  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.902426  4625 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:37.482180  4625 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:37.484539  4625 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:37.486485  4511 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:36.902508  4513 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:37.493016  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:36.897667  4636 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:37.075943  4637 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:59:37.509832  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:37.531597  1688 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:37.510896  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:37.532835  1687 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
W20260709 12:59:37.263374  4547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.254s	user 0.006s	sys 0.032s
I20260709 12:59:36.901355  4567 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:36.903960  4415 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:36.926128  4079 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:36.932335  4626 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:37.509379  4642 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.475356  4476 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:37.525913  4501 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:37.538005  4547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.530s	user 0.014s	sys 0.040s
I20260709 12:59:37.536149  4636 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:37.537070  4079 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:37.494961  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:36.919796  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.606611  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1620) took 2213 ms. Trace:
I20260709 12:59:37.499161  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.517993  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:36.921315  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.485698  1610 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:37.609575  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.030s	sys 0.030s
W20260709 12:59:37.706360  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.031s	sys 0.031s
I20260709 12:59:37.706929  1540 raft_consensus.cc:2410] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:37.708449  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.709376  1540 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
W20260709 12:59:37.480032  1615 rpcz_store.cc:269] 0709 12:59:34.554015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.554154 (+   139us) service_pool.cc:224] Handling call
0709 12:59:36.930240 (+2376086us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54001793d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:36.930407 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840077824}
I20260709 12:59:37.710822  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.712100  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:37.712590  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:37.712989  1615 raft_consensus.cc:2376] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7. Re-sending same reply.
I20260709 12:59:37.714397  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.715320  1615 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:37.718914  4196 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.718009  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 830121us
W20260709 12:59:37.611287  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.016s	sys 0.060s
W20260709 12:59:37.720496  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.017s	sys 0.060s
I20260709 12:59:37.486210  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1515) took 3651 ms. Trace:
I20260709 12:59:37.722079  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1526) took 2222 ms. Trace:
I20260709 12:59:37.536377  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:37.559106  4567 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.491667  1682 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:37.532408  4450 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:37.615237  4514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.019s	sys 0.045s
I20260709 12:59:37.618270  4612 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:37.572737  4636 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:37.542589  4642 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:37.542511  4501 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:37.632195  4643 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.693548  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.544479  4476 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.695575  1532 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:37.696964  4079 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.554080  4513 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:37.735987  4514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.020s	sys 0.045s
I20260709 12:59:37.699741  1608 raft_consensus.cc:2410] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:37.531615  4186 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.710427  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:37.680640  1534 rpcz_store.cc:276] 0709 12:59:35.393228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.851344 (+458116us) service_pool.cc:224] Handling call
0709 12:59:35.968903 (+117559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.972365 (+  3462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.972528 (+   163us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.998511 (+ 25983us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.572737 (+574226us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18003b7e80. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 12:59:36.852207 (+279470us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.852284 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.852408 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.605361 (+752953us) raft_consensus.cc:1685] finished
0709 12:59:37.605446 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.606199 (+   753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2940,"raft.queue_time_us":3539,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":23466,"spinlock_wait_cycles":23347072,"thread_start_us":279250,"threads_started":1,"wal-append.queue_time_us":882338}
I20260709 12:59:37.720444  4196 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.726040  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.728245  4224 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:37.729852  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.722581  1616 rpcz_store.cc:276] 0709 12:59:35.499283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.721167 (+1221884us) service_pool.cc:224] Handling call
0709 12:59:36.721520 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.723817 (+  2297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.723841 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.724395 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.713420 (+989025us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:37.721257 (+  7837us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:37.721310 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.721453 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.721532 (+    79us) raft_consensus.cc:1685] finished
0709 12:59:37.721548 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.721960 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81551,"raft.queue_time_us":89,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5553,"spinlock_wait_cycles":22041984,"thread_start_us":962822,"threads_started":1,"wal-append.queue_time_us":927114}
I20260709 12:59:37.744292  1615 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:37.745620  4186 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.757359  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:37.758010  4642 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:37.739179  4501 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.759032  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.749472  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.750176  4513 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.742683  1536 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:37.764652  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 319) took 1005 ms. Trace:
I20260709 12:59:37.765079  1536 rpcz_store.cc:276] 0709 12:59:36.758877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.692846 (+933969us) service_pool.cc:224] Handling call
0709 12:59:37.764573 (+ 71727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:37.766281  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:37.767690  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:37.768807  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:37.770040  4196 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:37.770308  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.771781  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:37.764035  4427 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:37.775811  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 84868.5us
I20260709 12:59:37.775408  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 322) took 1013 ms. Trace:
I20260709 12:59:37.748088  4476 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:37.777688  1532 rpcz_store.cc:276] 0709 12:59:36.759781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.919478 (+159697us) service_pool.cc:224] Handling call
0709 12:59:37.762349 (+842871us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:37.777215  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 47836.7us
I20260709 12:59:37.784041  2305 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:37.784574  2305 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:37.785122  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:37.785943  2305 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.787751  4454 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.788463  4454 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.788749  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.789158  4454 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.790040  1534 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 12:59:37.792836  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.794066  4079 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.794293  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 323) took 1021 ms. Trace:
I20260709 12:59:37.795511  1532 rpcz_store.cc:276] 0709 12:59:36.773036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.792484 (+1019448us) service_pool.cc:224] Handling call
0709 12:59:37.793025 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.793668 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.793731 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.793816 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:37.793873 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.793990 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.794183 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:37.806017  1532 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:37.721668  1612 rpcz_store.cc:276] 0709 12:59:33.834916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.835039 (+   123us) service_pool.cc:224] Handling call
0709 12:59:33.835351 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.413042 (+577691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.413086 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.413639 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:59:34.750178 (+336539us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:34.750221 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.485245 (+2735024us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540009b0d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:37.485311 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.485363 (+    52us) raft_consensus.cc:1685] finished
0709 12:59:37.485373 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.486149 (+   776us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51377,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":18229,"spinlock_wait_cycles":353372544,"thread_start_us":577948,"threads_started":2,"wal-append.queue_time_us":283419,"wal-append.run_cpu_time_us":1511,"wal-append.run_wall_time_us":1019531}
I20260709 12:59:37.790685  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:37.814250  1536 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:37.778046  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.814301  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:37.818114  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 318) took 1059 ms. Trace:
I20260709 12:59:37.818918  1536 rpcz_store.cc:276] 0709 12:59:36.758512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.767353 (+1008841us) service_pool.cc:224] Handling call
0709 12:59:37.818031 (+ 50678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:37.822201  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:37.823333  1687 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:37.822167  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:37.824512  1540 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.825578  2305 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.830420  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:37.831545  1682 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:37.832468  4612 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:37.777146  4224 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:59:37.836347  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.839123  4655 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.840961  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1525) took 2382 ms. Trace:
W20260709 12:59:37.842025  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 111140us
I20260709 12:59:37.843065  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:37.845045  1540 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
W20260709 12:59:37.840875  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 347790us
I20260709 12:59:37.813344  4196 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.856123  4532 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:37.841454  1613 rpcz_store.cc:276] 0709 12:59:35.458706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.718161 (+1259455us) service_pool.cc:224] Handling call
0709 12:59:36.731295 (+ 13134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.731506 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:36.900961 (+169455us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.836042 (+935081us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.839931 (+  3889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.839991 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:37.840092 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.840718 (+   626us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.840894 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298844,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":1411,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":380,"spinlock_wait_cycles":1604864,"thread_start_us":1098856,"threads_started":3,"wal-append.queue_time_us":669292}
I20260709 12:59:37.856945  4532 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:37.857424  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.858842  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:37.860477  4643 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.862370  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1577) took 4847 ms. Trace:
I20260709 12:59:37.862797  1686 rpcz_store.cc:276] 0709 12:59:33.015026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.015270 (+   244us) service_pool.cc:224] Handling call
0709 12:59:33.041743 (+ 26473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:33.075729 (+ 33986us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:33.765085 (+689356us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.541705 (+2776620us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:37.842819 (+1301114us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b180033acc0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287
0709 12:59:37.843076 (+   257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.843145 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:37.843285 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.861899 (+ 18614us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54001a5754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:37.861960 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.862146 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2642,"prepare.queue_time_us":468244,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2955,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4226,"spinlock_wait_cycles":402010368,"thread_start_us":1000721,"threads_started":3,"wal-append.queue_time_us":351208,"wal-append.run_cpu_time_us":15477,"wal-append.run_wall_time_us":3514126}
I20260709 12:59:37.865324  4590 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:37.866654  4600 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 2.603s	user 0.018s	sys 0.003s
I20260709 12:59:37.868539  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1616) took 2981 ms. Trace:
W20260709 12:59:37.869326  4611 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.599s	user 0.012s	sys 0.012s
W20260709 12:59:37.870555  4603 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.372s	user 0.009s	sys 0.037s
I20260709 12:59:37.871467  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1601) took 3037 ms. Trace:
I20260709 12:59:37.871132  4612 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:37.872535  1608 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:37.874521  1615 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:37.875066  1609 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:37.860065  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:37.888552  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45719.8us
I20260709 12:59:37.893689  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 375) took 1004 ms. Trace:
I20260709 12:59:37.893193  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 374) took 1010 ms. Trace:
I20260709 12:59:37.895761  1613 rpcz_store.cc:276] 0709 12:59:36.882903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.859770 (+976867us) service_pool.cc:224] Handling call
0709 12:59:37.893114 (+ 33344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:37.896698  1688 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:37.894073  1608 rpcz_store.cc:276] 0709 12:59:36.883211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.749026 (+865815us) service_pool.cc:224] Handling call
0709 12:59:37.887236 (+138210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:37.897904  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:37.899111  2276 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:37.902201  4561 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.902591  4665 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:59:37.831550  4509 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:37.871912  1684 rpcz_store.cc:276] 0709 12:59:34.834368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.834492 (+   124us) service_pool.cc:224] Handling call
0709 12:59:34.837739 (+  3247us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:35.147941 (+310202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.147993 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:35.148725 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 12:59:35.381885 (+233160us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.381925 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.381998 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.868455 (+2486457us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:37.870916 (+  2461us) raft_consensus.cc:1685] finished
0709 12:59:37.870940 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.871262 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27674,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":12999,"spinlock_wait_cycles":32775552,"thread_start_us":354057,"threads_started":2,"wal-append.queue_time_us":33473}
I20260709 12:59:37.937057  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.938201  4514 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.938964  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.939929  4514 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.868921  1535 rpcz_store.cc:276] 0709 12:59:34.886766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.922269 (+ 35503us) service_pool.cc:224] Handling call
0709 12:59:34.922557 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.950844 (+ 28287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.950888 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.970672 (+ 19784us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.264837 (+294165us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.268778 (+  3941us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.435348 (+166570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.435422 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.865688 (+2430266us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:37.867954 (+  2266us) raft_consensus.cc:1685] finished
0709 12:59:37.868059 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.868339 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20426,"prepare.queue_time_us":3435,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":186544,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":20297,"spinlock_wait_cycles":267032960,"thread_start_us":420184,"threads_started":2,"wal-append.queue_time_us":284656}
I20260709 12:59:37.895452  4655 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.942761  4509 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:37.944756  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:37.946358  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.949229  4514 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.949734  4612 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:37.958040  4642 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:37.958472  4593 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.958720  4642 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:37.959259  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.960074  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.960955  1506 leader_election.cc:400] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:37.961292  1506 leader_election.cc:403] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:37.961674  1612 raft_consensus.cc:2376] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6. Re-sending same reply.
I20260709 12:59:37.962947  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.963172  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.963949  4514 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:37.959987  4642 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.964797  4514 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.967900  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:37.968597  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 132230us
I20260709 12:59:37.968858  4445 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.969450  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.970568  4445 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.971424  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:37.972465  4196 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.973045  4196 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.973569  4196 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.963909  1612 raft_consensus.cc:2376] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6. Re-sending same reply.
I20260709 12:59:37.981446  2305 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:37.902842  4561 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:37.990485  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:37.990932  4425 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:37.965025  4374 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:59:37.993379  4186 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:37.980119  4665 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 12:59:37.998672  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2221) took 1265 ms. Trace:
I20260709 12:59:37.999086  1534 rpcz_store.cc:276] 0709 12:59:36.732911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.790937 (+1058026us) service_pool.cc:224] Handling call
0709 12:59:37.791421 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:37.792147 (+   726us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:37.804968 (+ 12821us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.806655 (+  1687us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.807046 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.807195 (+   149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:37.865738 (+ 58543us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.865947 (+   209us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:37.866192 (+   245us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.866691 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.866765 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.998384 (+131619us) raft_consensus.cc:1685] finished
0709 12:59:37.998409 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.998567 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69242,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":16877,"raft.queue_time_us":777,"raft.run_cpu_time_us":586,"raft.run_wall_time_us":589,"spinlock_wait_cycles":79616,"thread_start_us":13035,"threads_started":2,"wal-append.queue_time_us":1247}
W20260709 12:59:38.004588  1507 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.012s	sys 0.007s
W20260709 12:59:38.005106  1507 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.013s	sys 0.007s
W20260709 12:59:38.005525  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 700043us
W20260709 12:59:38.006281  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.006363  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1626) took 2560 ms. Trace:
I20260709 12:59:38.006866  1537 rpcz_store.cc:276] 0709 12:59:35.445545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.706563 (+261018us) service_pool.cc:224] Handling call
0709 12:59:38.005890 (+2299327us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54002d7dd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.006166 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697682304}
I20260709 12:59:38.009418  1539 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:59:38.011409  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.013348  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.015120  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.015820  1607 raft_consensus.cc:2376] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8. Re-sending same reply.
I20260709 12:59:38.013388  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.022012  4578 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:38.018437  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.027050  4578 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:38.029268  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:38.029888  4094 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.032770  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:38.040438  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.042266  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2220) took 1311 ms. Trace:
I20260709 12:59:38.042723  1539 rpcz_store.cc:276] 0709 12:59:36.730890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.735710 (+  4820us) service_pool.cc:224] Handling call
0709 12:59:38.008049 (+1272339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.009909 (+  1860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.042061 (+ 32152us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002d7dd0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.042206 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2924045056}
W20260709 12:59:38.043473  1582 connection.cc:256] RPC call timeout handler was delayed by -2.3712713770000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 12:59:38.046432  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:38.047207  1534 raft_consensus.cc:2376] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8. Re-sending same reply.
I20260709 12:59:38.047581  1540 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:38.048019  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:38.048698  1541 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:38.048859  1532 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:38.050418  1538 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:59:38.050882  1538 pending_rounds.cc:85] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 6
I20260709 12:59:38.051182  1538 pending_rounds.cc:107] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 12:59:38.051607  1538 raft_consensus.cc:2917] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 12:59:38.052042  1538 raft_consensus.cc:2889] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.077203  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:38.085196  1537 raft_consensus.cc:2410] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:59:38.091781  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.097823  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.098973  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 377) took 1215 ms. Trace:
I20260709 12:59:38.099359  1607 rpcz_store.cc:276] 0709 12:59:36.883815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.073796 (+1189981us) service_pool.cc:224] Handling call
0709 12:59:38.098903 (+ 25107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:38.100479  1616 raft_consensus.cc:2368] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:38.100623  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.101495  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.102128  4465 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.102728  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.104017  4454 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.106407  4454 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:38.108407  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.110656  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.116400  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 361) took 3268 ms. Trace:
I20260709 12:59:38.117000  1611 rpcz_store.cc:276] 0709 12:59:34.809464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.810748 (+  1284us) service_pool.cc:224] Handling call
0709 12:59:36.930872 (+2120124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.476111 (+545239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.056399 (+580288us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54001793d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.078203 (+ 21804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4875472256}
I20260709 12:59:38.117971  2307 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.118608  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:38.118918  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 147712us
I20260709 12:59:38.119794  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:38.118645  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.122284  1582 connection.cc:256] RPC call timeout handler was delayed by -2.2479713770000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:59:38.122613  1582 connection.cc:256] RPC call timeout handler was delayed by -2.1417713770000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 12:59:38.104070  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.119807  1611 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:38.026634  4501 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.125361  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.096045  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.127177  1612 raft_consensus.cc:2376] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7. Re-sending same reply.
I20260709 12:59:38.125722  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 383) took 1097 ms. Trace:
I20260709 12:59:38.129076  1611 rpcz_store.cc:276] 0709 12:59:37.028915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.118252 (+1089337us) service_pool.cc:224] Handling call
0709 12:59:38.125648 (+  7396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:38.136922  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.146159  1539 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:38.151887  4561 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:38.153935  1607 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:38.155511  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:38.156164  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.157099  2304 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:38.157217  1607 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.158025  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.158732  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 370) took 1288 ms. Trace:
I20260709 12:59:38.159003  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2146) took 3918 ms. Trace:
I20260709 12:59:38.161880  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.162636  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.162775  2275 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.162652  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:38.165594  4476 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.167212  4595 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.159181  1609 rpcz_store.cc:276] 0709 12:59:36.870436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.712154 (+841718us) service_pool.cc:224] Handling call
0709 12:59:38.158557 (+446403us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001b6054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.158673 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347347840}
I20260709 12:59:38.172632  4661 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:38.174712  4501 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.174717  4415 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:38.163244  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:38.177454  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:38.178035  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 82219.3us
I20260709 12:59:38.178977  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:38.179822  4514 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:38.180594  4612 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.159569  1610 rpcz_store.cc:276] 0709 12:59:34.240805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.241003 (+   198us) service_pool.cc:224] Handling call
0709 12:59:37.485515 (+3244512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.704302 (+218787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.158670 (+454368us) spinlock_profiling.cc:243] Waited 3.19 s on lock 0x7b540009b0d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.158814 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7326413056}
I20260709 12:59:38.183147  2304 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:38.184132  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1528) took 2535 ms. Trace:
I20260709 12:59:38.184523  1611 rpcz_store.cc:276] 0709 12:59:35.649084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.182968 (+2533884us) service_pool.cc:224] Handling call
0709 12:59:38.183443 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.183776 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.183802 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.183862 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:38.183891 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.183950 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.184063 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13696}
I20260709 12:59:38.185928  4532 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:38.186582  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 372) took 1315 ms. Trace:
W20260709 12:59:38.186746  1582 connection.cc:256] RPC call timeout handler was delayed by -1.4640808940000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 12:59:38.187067  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 382) took 1183 ms. Trace:
W20260709 12:59:38.187276  1582 connection.cc:256] RPC call timeout handler was delayed by -1.2552808940000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:59:38.187697  1582 connection.cc:256] RPC call timeout handler was delayed by -1.1396384700000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 12:59:38.187543  1615 rpcz_store.cc:276] 0709 12:59:37.004066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.771357 (+767291us) service_pool.cc:224] Handling call
0709 12:59:38.186902 (+415545us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b54003f4b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.187009 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205759232}
I20260709 12:59:38.188491  4575 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.179972  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:38.189110  4575 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.137005  4445 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:38.191509  4575 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:38.177470  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.163481  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1534) took 1249 ms. Trace:
I20260709 12:59:38.159708  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.189527  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 376) took 1306 ms. Trace:
I20260709 12:59:38.192945  1608 rpcz_store.cc:276] 0709 12:59:36.914379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.162299 (+1247920us) service_pool.cc:224] Handling call
0709 12:59:38.163422 (+  1123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:38.171933  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.193593  1615 rpcz_store.cc:276] 0709 12:59:36.883537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.188611 (+1305074us) service_pool.cc:224] Handling call
0709 12:59:38.188936 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.189223 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.189250 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.189301 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:38.189332 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.189384 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.189483 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:38.188163  1582 connection.cc:256] RPC call timeout handler was delayed by -1.0338565440000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 12:59:38.186978  1611 rpcz_store.cc:276] 0709 12:59:36.881277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.185601 (+1304324us) service_pool.cc:224] Handling call
0709 12:59:38.185986 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.186239 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.186265 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.186319 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:38.186348 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.186401 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.186512 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:38.198238  4598 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 2.935s	user 0.009s	sys 0.013s
I20260709 12:59:38.150542  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:38.201654  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 379) took 1317 ms. Trace:
I20260709 12:59:38.202164  1609 rpcz_store.cc:276] 0709 12:59:36.884415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.171590 (+1287175us) service_pool.cc:224] Handling call
0709 12:59:38.201570 (+ 29980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:38.178896  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:38.207026  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 58087.3us
I20260709 12:59:38.202975  4501 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.179651  4476 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:38.218547  4445 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.218789  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:38.222751  1611 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:38.222824  1613 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.192086  4578 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.226490  2301 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:38.227566  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 434) took 3597 ms. Trace:
I20260709 12:59:38.227967  2302 rpcz_store.cc:276] 0709 12:59:34.629949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.630345 (+   396us) service_pool.cc:224] Handling call
0709 12:59:34.630697 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.164595 (+533898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.208519 (+3043924us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54000ee2d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:38.227356 (+ 18837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221514624}
I20260709 12:59:38.229352  1615 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:38.230062  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2174) took 1200 ms. Trace:
I20260709 12:59:38.230429  1615 rpcz_store.cc:276] 0709 12:59:37.029322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.201348 (+1172026us) service_pool.cc:224] Handling call
0709 12:59:38.225425 (+ 24077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.229766 (+  4341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.229980 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:38.231696  4578 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:38.232481  4454 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:38.224080  4465 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:38.236835  1689 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:38.237270  1689 pending_rounds.cc:85] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 3
I20260709 12:59:38.237534  1689 pending_rounds.cc:107] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:38.237761  1689 raft_consensus.cc:2889] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.222278  4532 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.244923  4532 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.247303  4532 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:38.236835  4465 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:38.221647  4476 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:38.254133  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.252880  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:38.256608  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 97045.2us
I20260709 12:59:38.251829  4612 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:38.235805  4196 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.248696  4465 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.268296  1607 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:38.276098  1610 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:38.259719  4612 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.280565  4533 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.285287  4476 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.285804  2275 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:38.286537  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 184718us
I20260709 12:59:38.287109  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:38.287289  1581 connection.cc:256] RPC call timeout handler was delayed by -1.0061710090000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 12:59:38.288108  4532 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.288761  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.288725  4532 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.290405  4425 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:38.290660  4590 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.291107  4532 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:38.291056  4425 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.291829  4533 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.292469  4533 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.293671  4425 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:38.294082  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 67242.6us
I20260709 12:59:38.295467  4533 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.299225  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.291318  4590 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.301762  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:38.304450  1683 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:38.305028  1685 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:38.305794  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.306268  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.307130  1685 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:38.307323  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:38.305120  4669 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:38.297109  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:38.317101  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1610) took 3113 ms. Trace:
I20260709 12:59:38.281325  4612 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.317628  1689 rpcz_store.cc:276] 0709 12:59:35.203177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.519378 (+316201us) service_pool.cc:224] Handling call
0709 12:59:35.519705 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.238219 (+2718514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.308594 (+ 70375us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b540032d7d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:38.317021 (+  8427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6248066944}
I20260709 12:59:38.306290  4454 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:38.298050  4196 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.329144  4089 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:38.329768  1682 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:38.331665  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.330929  1686 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:38.340924  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.332315  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.364792  1683 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:38.343971  1656 leader_election.cc:400] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:38.377169  1656 leader_election.cc:403] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:38.369289  2305 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEARNER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:38.384809  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 97792us
I20260709 12:59:38.382477  1685 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:38.325244  4425 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:38.296469  4561 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:38.397013  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.323964  4575 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:38.339426  4089 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.316078  4224 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:59:38.382050  4661 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.380394  4454 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:38.398991  4196 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:38.400354  4089 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.415652  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:38.412499  4196 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.424433  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.425357  4196 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.425818  2302 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:59:38.408949  4532 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:38.431083  1682 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:38.433100  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:38.433637  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 80585.5us
I20260709 12:59:38.434502  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.436407  4425 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.437117  4425 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:38.439539  4496 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:38.440418  4662 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:38.404574  4575 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.445858  1686 raft_consensus.cc:2410] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:38.433120  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1524) took 2874 ms. Trace:
I20260709 12:59:38.443140  1688 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:38.449115  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 152161us
I20260709 12:59:38.430711  4590 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:38.445554  4501 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:38.450482  1653 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:38.477963  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 146348us
I20260709 12:59:38.446955  1614 rpcz_store.cc:276] 0709 12:59:35.454737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.290496 (+835759us) service_pool.cc:224] Handling call
0709 12:59:36.407676 (+117180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.407935 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:36.620366 (+212431us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.999304 (+1378938us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b18001f5fa0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a
0709 12:59:38.000006 (+   702us) log.cc:844] Serialized 14 byte log entry
0709 12:59:38.033495 (+ 33489us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b18001f5fa0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:38.188064 (+154569us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18001f5fa0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:38.260764 (+ 72700us) log.cc:844] Serialized 14 byte log entry
0709 12:59:38.275531 (+ 14767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.278402 (+  2871us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:38.310904 (+ 32502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.323537 (+ 12633us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.328564 (+  5027us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1023,"prepare.queue_time_us":482971,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":1747,"raft.queue_time_us":13886,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":5680,"spinlock_wait_cycles":110318592,"thread_start_us":698368,"threads_started":3,"wal-append.queue_time_us":617446,"wal-append.run_cpu_time_us":1216,"wal-append.run_wall_time_us":1022737}
I20260709 12:59:38.479911  1582 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:38.484181  4532 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:38.484499  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:38.485044  4532 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:38.488291  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.489898  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:38.489065  4089 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.448882  4514 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:38.492561  4514 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.493665  4089 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.470643  4661 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:38.443102  4682 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:59:38.472787  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 56633.1us
I20260709 12:59:38.484417  1681 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:59:38.484267  4671 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:59:38.486246  4532 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.424158  4655 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:59:38.524788  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.504602  4514 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:38.532444  4672 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:59:38.536898  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 81267.6us
I20260709 12:59:38.542726  4196 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.506944  4501 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.545795  4476 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:38.547024  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1529) took 2413 ms. Trace:
I20260709 12:59:38.497040  4661 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:38.506454  4673 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:38.478263  4458 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.529430  1690 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:38.566363  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.564911  1610 rpcz_store.cc:276] 0709 12:59:36.133956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.183000 (+2049044us) service_pool.cc:224] Handling call
0709 12:59:38.269025 (+ 86025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.279324 (+ 10299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.546333 (+267009us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b54000b6dd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:38.546805 (+   472us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b54000b6dd0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:38.546938 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212577792}
W20260709 12:59:38.569469  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.576145  4661 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.560776  4561 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.581542  4561 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:38.582046  4561 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.590242  4501 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:38.635850  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.646468  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 75286.5us
W20260709 12:59:38.646564  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 74538us
W20260709 12:59:38.641237  4672 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:59:38.656323  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.600276  4425 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.659139  4445 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.681691  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 274896us
I20260709 12:59:38.505142  4454 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.692569  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:38.701864  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:38.708873  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.712522  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:38.715026  1611 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.715037  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:38.715713  1613 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:38.716023  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 241659us
W20260709 12:59:38.723989  1506 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.065s (SENT)
I20260709 12:59:38.700795  4655 consensus_queue.cc:1059] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:59:38.697981  4445 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.698282  4425 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.691282  4578 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:59:38.759649  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 107521us
I20260709 12:59:38.763216  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:38.758355  4682 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:38.730085  4465 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:59:38.758659  4532 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.819216  4196 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:38.819361  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 52051.5us
W20260709 12:59:38.819886  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 88978.4us
W20260709 12:59:38.815591  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 46213.1us
W20260709 12:59:38.836341  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.837407  4425 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:38.838335  4532 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.857515  4445 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:38.833875  4501 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.859408  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.899154  2305 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:38.860409  4514 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:38.861268  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.861816  4561 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:38.862469  4692 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:38.862663  2306 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:38.901983  2309 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:59:38.866410  1611 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:38.817232  4682 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:38.904150  4532 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:38.909380  4612 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.002s
I20260709 12:59:38.914386  4575 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.918190  4501 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:38.919185  4509 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.919579  4079 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.920076  4089 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.920470  4561 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:38.922600  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:38.922909  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:38.817842  4186 consensus_queue.cc:1059] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 12:59:38.926249  2302 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:38.934216  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 208362us
I20260709 12:59:38.935352  1613 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
W20260709 12:59:38.937031  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 79564.2us
W20260709 12:59:38.930207  4690 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 12:59:38.930176  4496 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:38.901398  4514 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:38.923264  4395 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:38.947089  1535 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:38.940404  4509 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:38.953915  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.955017  2301 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:38.952078  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:38.950448  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 80558.5us
I20260709 12:59:38.956993  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:38.959656  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:38.940377  4612 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 12:59:38.962899  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 104643us
I20260709 12:59:38.960577  4692 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:38.960819  4702 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
W20260709 12:59:38.969368  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 137397us
I20260709 12:59:38.952659  4496 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:38.973721  1539 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:38.949047  4089 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.021656  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:38.964720  4395 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.953629  4079 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:39.022202  4685 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.517s	user 0.004s	sys 0.000s
I20260709 12:59:39.032196  4709 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:39.033560  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 83902.2us
I20260709 12:59:39.033442  4695 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:39.031975  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65606.4us
I20260709 12:59:39.036832  4692 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.038133  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:39.038058  4198 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:39.020345  4702 raft_consensus.cc:1068] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Unable to promote non-voter c445b7b7d94f48f99a3599ddfc92f462: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:59:39.032021  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 68270.7us
I20260709 12:59:39.045603  4089 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.049225  4514 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.024459  4224 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:59:39.064479  4612 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:39.065804  4501 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:39.073412  1687 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:39.023017  4445 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.101650  4445 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.103861  4445 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:39.074478  4698 raft_consensus.cc:3055] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:39.104385  4698 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:39.075101  4496 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.076138  4509 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:39.087354  1656 connection.cc:256] RPC call timeout handler was delayed by -1.8991939560000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 12:59:39.117089  1656 connection.cc:256] RPC call timeout handler was delayed by -1.6705939560000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 12:59:39.088821  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.094096  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.090155  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:39.096303  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.118098  1690 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.118335  1615 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:39.096988  1616 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:39.080873  4709 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:39.122288  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 84279.9us
I20260709 12:59:39.105957  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:38.961933  4682 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.106618  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:39.114308  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.125610  1609 raft_consensus.cc:2410] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:39.097970  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:39.117189  1681 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:39.095397  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:39.119673  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 197207us
I20260709 12:59:39.132647  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.133312  1613 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:39.133908  4079 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.134753  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:39.135814  4710 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:39.132649  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.140463  4710 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:39.140875  4710 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:39.141247  4710 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.140489  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:39.142758  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.143508  4699 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:39.143901  4578 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:39.144483  4578 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.146416  4578 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:39.124769  4709 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.152793  4496 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:39.156910  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.158972  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:39.166874  4612 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:39.167172  4716 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.167558  4532 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.167820  4716 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.168069  4532 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.168798  2305 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:38.921289   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:39.129596  4198 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:39.174137  1614 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:39.143915  4699 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:39.208088  4079 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.169878  4514 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.105314  4698 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.218269  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:39.219257  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:39.183130  4224 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:59:39.273128  1690 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:39.208775  4079 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:39.274017  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 109038us
I20260709 12:59:39.170771  4689 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:59:39.170951  4688 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 12:59:39.278146  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 119264us
I20260709 12:59:39.278838  2308 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:39.276907  4684 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:59:39.283761  4688 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:39.284245  4688 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:39.285108  4688 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.286410  4688 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.288484  4698 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.288993  4716 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:39.292512  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 118800us
I20260709 12:59:39.292769  4699 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.293833  4079 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.294382  4699 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:39.294731  4425 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:39.295137  4425 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.274679  4612 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.295506  4425 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.295780  4612 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.296698  4532 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:39.297215  4532 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:39.297644  4532 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.223737  4089 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.298588  4089 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.272547  4590 raft_consensus.cc:2764] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:59:39.282121  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:39.293298  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:39.297887  4612 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.309309  4079 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:39.330817  4393 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.339658  4612 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.340463  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:39.300237  4561 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:39.323638  4532 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:39.327227  4224 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:39.343690  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:39.329818  4590 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:39.327051  4445 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.327942  4501 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.355373  4198 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:39.345193  4079 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.369730  4079 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:39.348322  4590 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.348449  4695 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:39.384456  4701 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:59:39.387174  4089 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:39.388185  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57882.2us
I20260709 12:59:39.389223  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:39.344039  4393 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.392071  4393 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:39.393074  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48934.4us
I20260709 12:59:39.349900  4700 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:59:39.394866  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:39.364391  4532 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:39.400591  4532 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:39.401149  4532 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.364590  4561 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:39.404562  4561 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:39.404976  4561 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.409008  4575 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:39.409507  4575 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:39.410483  4575 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.411792  4575 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.374053  4501 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.358600  4612 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.414593  4501 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:39.353130  4566 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:59:39.414978  4612 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.416519  4682 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:39.417073  4682 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.417567  4682 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.378284  4590 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:39.378033  4695 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:39.425258  4695 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.426860  4695 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:39.427098  4709 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.429014  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:39.430174  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:39.430454  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.431145  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.437016  1537 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.377091  4445 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.431478  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.438656  1533 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:39.441679  1541 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:39.444051  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.445303  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.445472  4445 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:39.443104  4612 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.446931  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.449386  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.450801  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.451749  4655 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.452370  4655 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.453887  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.454694  1610 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 12:59:39.455873  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66785.9us
I20260709 12:59:39.457813  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:39.458654  4655 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:39.459352  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:39.459815  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.459633  1436 catalog_manager.cc:5697] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 5, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 5 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.461629  1436 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 5 to 6, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 6 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.464501  4700 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:39.465303  4700 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:39.466210  4642 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:39.466735  4642 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:39.467976  4420 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:39.446957  4612 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:39.469726  4420 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:39.466770  4700 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:39.472182  4612 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.472368  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.473320  1612 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:39.478385  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.473701  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:39.474642  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:39.474706  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.460050  1607 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.475445  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.464057  1436 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.480541  1536 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:39.459360  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:39.483392  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:39.430799  4509 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.502192  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.487473  1541 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:39.505666  4727 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:39.506773  4727 consensus_queue.cc:1243] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:39.507407  4727 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:39.507807  4727 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:39.527535  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:39.681921  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 222558us
I20260709 12:59:39.546571  1537 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:39.508095  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:39.523989  2306 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
W20260709 12:59:39.593408  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.683589  4718 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:39.521308  4578 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.622646  1535 raft_consensus.cc:2410] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:59:39.508747  4708 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:39.684626  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:39.510748  4458 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:39.681530  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 245075us
I20260709 12:59:39.685824  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.685902  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:39.663938  4731 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 12:59:39.685853  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 158446us
I20260709 12:59:39.467911  4642 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:39.691329  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 262493us
I20260709 12:59:39.691565  1540 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
W20260709 12:59:39.685245  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.697454  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 332780us
W20260709 12:59:39.685315  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 177311us
I20260709 12:59:39.510013  4655 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:39.583402  4700 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:39.684180  4718 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:39.700526  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.509s (SENT) [suppressed 39 similar messages]
I20260709 12:59:39.512799  4445 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:39.583688  4716 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.716820  1607 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:39.718298  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:39.703780  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.690490  4476 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:39.719327  1533 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:39.721587  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.732627  1537 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:39.722235  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.722837  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.702230  4458 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.724713  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.520701  4733 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.205s
I20260709 12:59:39.736729  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.735575  1536 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:39.515065  4710 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.726768  4420 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:39.743357  1537 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:39.743963  1536 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:39.731038  4496 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.007s
I20260709 12:59:39.741945  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:39.692001  4578 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.745767  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:39.664239  4727 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.749981  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.750573  1615 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:39.751271  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:39.756174  2303 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:39.759246  4709 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.759400  4567 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:39.759910  4567 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.747713  4420 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.766482  4415 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:39.767059  4415 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.768337  4420 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:39.768857  4420 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.769124  4415 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.769340  4420 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.755458  4728 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:39.770596  4728 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:39.771358  4420 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:39.736522  4445 raft_consensus.cc:697] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:39.773633  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:39.740828  4642 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:39.767607  4682 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.774374  1534 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:39.728268  4655 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.733498  4716 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.737828  4680 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:39.764381  4696 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:39.773020  4567 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.771889  4420 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 12:59:39.852500  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 134267us
I20260709 12:59:39.828047  4727 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.755486  4425 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:39.864085  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 109421us
W20260709 12:59:39.867364  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 121463us
I20260709 12:59:39.867905  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:39.771551  4728 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.869046  4458 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:39.877275  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:39.877745  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 177249us
I20260709 12:59:39.863351  4696 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:39.852077  4655 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:39.895057  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.929311  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 46882.3us
W20260709 12:59:39.931623  4726 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.578s	user 0.000s	sys 0.003s
I20260709 12:59:39.931680  4734 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:39.932706  4738 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:59:39.932456  4734 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:39.934428  4737 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:59:39.934713  4733 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.834324  4718 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:39.935493  4733 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:39.939253  4393 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:39.882870  4698 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:39.940742  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.954756  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 74730.1us
I20260709 12:59:39.986830  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:39.892710  4465 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:39.988811  1506 leader_election.cc:336] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.658s (SENT)
W20260709 12:59:40.011520  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81124.7us
W20260709 12:59:40.022122  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 140408us
I20260709 12:59:40.022966  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:40.023870  1688 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:40.024893  4578 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.026311  4739 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.026847  4739 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.027374  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:40.027702  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:40.028498  4740 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:40.028921  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:40.029196  4739 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.029506  1540 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:40.029778  4739 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:40.030624  1540 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:40.030840  1582 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:40.032634  1506 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:40.033108  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:40.037492  4735 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:40.038175  4699 consensus_meta.cc:287] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.743s	user 0.020s	sys 0.001s
I20260709 12:59:40.038766  4700 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:40.039299  4700 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:40.040438  4700 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.042014  4700 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.031580  4702 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:40.052601  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:40.052843  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:40.056177  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:40.053706  4694 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:40.013936  4454 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:39.868489  4445 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:40.055511  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 173245us
I20260709 12:59:40.073478  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:40.073302  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:40.005152  4476 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:40.011406  4393 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.091203  1681 raft_consensus.cc:2376] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8. Re-sending same reply.
I20260709 12:59:40.054828  4733 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.072991  1687 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:40.097029  1688 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:40.054868  4532 consensus_meta.cc:287] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.003s
I20260709 12:59:40.096349  1685 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:40.100569  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:40.105393  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 149165us
I20260709 12:59:40.108000  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:40.116972  1684 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:40.117008  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.056030  4702 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.119978  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:40.120527  4532 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.035532  4698 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:59:40.056946  4739 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:59:40.124657  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:40.130681  1687 raft_consensus.cc:2368] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:40.137413  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:40.144271  1688 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:40.150418  1683 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:40.125819  4702 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.119338  4454 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:40.121946  4655 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:40.130234  4710 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:40.125365  4393 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:40.198439  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 148249us
W20260709 12:59:40.289635  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 55650.3us
I20260709 12:59:40.321895  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:40.323508  4186 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:40.323971  4186 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.324362  4186 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:40.200524  4561 consensus_meta.cc:287] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.795s	user 0.004s	sys 0.006s
I20260709 12:59:40.329597  4561 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:40.203001  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 90837.7us
W20260709 12:59:40.201996  4695 consensus_meta.cc:287] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.000s
I20260709 12:59:40.152412  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:40.147719  4728 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.343515  4728 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.342227  4695 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:40.346005  4728 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.098340  4696 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:40.150527  4682 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:40.246352  4578 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.200873  4723 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:40.353060  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.146191  4739 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:40.313033  4748 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
W20260709 12:59:40.310765  4590 consensus_meta.cc:287] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.890s	user 0.008s	sys 0.001s
I20260709 12:59:40.151388  4733 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:40.350852  4578 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.151867  4734 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:40.315667  4716 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:40.375936  4454 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.377934  4578 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:40.360569  4739 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:40.360780  4655 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.380097  4739 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.381810  4739 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:40.383459  4756 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 12:59:40.363607  4575 consensus_meta.cc:287] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.930s	user 0.021s	sys 0.010s
W20260709 12:59:40.414500  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 89537.9us
W20260709 12:59:40.414533  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 77217.6us
I20260709 12:59:40.416999  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:40.418323  4445 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:40.418866  4445 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:40.419309  4445 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:40.420986  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:40.423045  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.439836  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:40.363945  4590 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:40.456938  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.496528  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.512900  4710 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.513550  4710 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.516647  4578 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:40.518963  4749 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:59:40.516549  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:40.435387  4733 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:40.521950  4733 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:40.522469  4733 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.526772  4532 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:40.509241  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.450098  1685 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:40.357677  4476 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:40.509599  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 61731.5us
I20260709 12:59:40.537009  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:40.515944  4710 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:40.538486  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:40.362551  4723 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.554836  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 421) took 1017 ms. Trace:
I20260709 12:59:40.559008  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 754) took 1399 ms. Trace:
I20260709 12:59:40.563601  1683 rpcz_store.cc:276] 0709 12:59:39.537036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.583448 (+ 46412us) service_pool.cc:224] Handling call
0709 12:59:39.613950 (+ 30502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.150865 (+536915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.554594 (+403729us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400393354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:40.554766 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233417600}
I20260709 12:59:40.568468  4716 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:40.568915  4716 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.569262  4716 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.569914  1685 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:40.564414  2303 rpcz_store.cc:276] 0709 12:59:39.159671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.159807 (+   136us) service_pool.cc:224] Handling call
0709 12:59:39.173554 (+ 13747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.756616 (+583062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.558759 (+802143us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001fb8d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:40.558919 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339606912}
I20260709 12:59:40.576815  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:40.543956  4532 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:40.566123  4708 consensus_meta.cc:287] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.869s	user 0.006s	sys 0.009s
I20260709 12:59:40.585896  1541 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:40.585187  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:40.597352  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:40.598049  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:40.598948  1540 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:40.586069  4532 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.606335  1540 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:40.543479  4702 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.595203  4708 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:40.598073  4561 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.605067  4734 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:40.612080  4532 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.653475  4734 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:40.654982  4702 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:40.656685  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:40.657279  1537 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:59:40.660390  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.636938  4578 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:40.628155  4723 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:40.623513  4775 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:59:40.646983  4767 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:40.687820  1506 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.757s (SENT)
I20260709 12:59:40.688512  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:40.646783  4716 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.599185  4709 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:59:40.648782  4590 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:40.649617  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:40.721073  1541 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.650272  4445 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:40.652179  4727 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.786s	user 0.005s	sys 0.003s
I20260709 12:59:40.718704  4767 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:40.734058  1537 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:40.731029  4775 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:40.677659  4733 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.736666  4775 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:40.757992  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 172912us
I20260709 12:59:40.758863  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:40.760303  1541 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:40.764889  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:40.765872  4781 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:40.765275  4775 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.766861  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:40.761633  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:40.655014  4734 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:40.770579  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:40.766877  4567 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.903s	user 0.010s	sys 0.002s
I20260709 12:59:40.751868  4767 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:40.769375  4642 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.981s	user 0.008s	sys 0.004s
I20260709 12:59:40.770031  4775 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:40.732972  4186 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.776173  4775 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.785166  4775 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.776297  4781 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:40.788731  4781 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:40.789119  4781 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.793303  4445 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:40.781301  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.779083  1687 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:40.775920  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:40.803953  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1655) took 1080 ms. Trace:
W20260709 12:59:40.805728  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 46998.7us
I20260709 12:59:40.806703  1582 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:40.794906  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 334) took 1621 ms (client timeout 1617 ms). Trace:
I20260709 12:59:40.802883  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1654) took 1079 ms. Trace:
W20260709 12:59:40.826866  1535 rpcz_store.cc:269] 0709 12:59:39.173812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.183394 (+  9582us) service_pool.cc:224] Handling call
0709 12:59:40.794638 (+1611244us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54004358d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:40.794793 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913784704}
I20260709 12:59:40.808571  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:40.828992  1540 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.838903  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:40.803393  4770 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:59:40.859341  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 83502.2us
I20260709 12:59:40.862303  1581 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:40.779018  4750 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.776s	user 0.001s	sys 0.001s
I20260709 12:59:40.860834  1683 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:40.827375  1533 rpcz_store.cc:276] 0709 12:59:39.723582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.747799 (+ 24217us) service_pool.cc:224] Handling call
0709 12:59:39.785336 (+ 37537us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:39.839484 (+ 54148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.839526 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:39.884073 (+ 44547us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.056465 (+172392us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:40.319061 (+262596us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.802403 (+483342us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.802581 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.802650 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.802685 (+    35us) raft_consensus.cc:1685] finished
0709 12:59:40.802697 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.802814 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":485352,"prepare.queue_time_us":56254,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":532177,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":124,"spinlock_wait_cycles":21369728,"thread_start_us":320744,"threads_started":2,"wal-append.queue_time_us":167648}
I20260709 12:59:40.866137  1687 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:40.797840  4612 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.783389  4425 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.780586  4590 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:41.056875  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 132821us
I20260709 12:59:41.221957  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:40.946779  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:41.123628  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:40.924479  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 85712.8us
I20260709 12:59:41.297933  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:41.321022  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1659) took 1582 ms. Trace:
I20260709 12:59:41.433071  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:40.826045  1536 rpcz_store.cc:276] 0709 12:59:39.723747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.755806 (+ 32059us) service_pool.cc:224] Handling call
0709 12:59:39.786188 (+ 30382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:39.864328 (+ 78140us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:40.106490 (+242162us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.318571 (+212081us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:40.319208 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.319350 (+   142us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:40.319597 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.803605 (+484008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.803685 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.803725 (+    40us) raft_consensus.cc:1685] finished
0709 12:59:40.803738 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.803891 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520506,"prepare.queue_time_us":246068,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":92,"raft.queue_time_us":30007,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5707,"thread_start_us":429847,"threads_started":2,"wal-append.queue_time_us":264529}
I20260709 12:59:41.056013  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:41.222002  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:40.922884  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 116238us
I20260709 12:59:41.087204  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:40.876842  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:41.267784  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.433775  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 571582us
I20260709 12:59:41.307260  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:41.436189  1540 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 12:59:41.437798  1613 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:41.440210  1540 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:41.438716  2305 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:41.438534  2303 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:41.434636  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.438791  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:41.439311  1608 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 12:59:40.925169  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 237410us
W20260709 12:59:41.456105  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.457748  1506 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.798s (SENT)
I20260709 12:59:40.783905  4186 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.858697  4777 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.481348  2310 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:41.480760  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:41.464598  1581 leader_election.cc:400] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
W20260709 12:59:41.314631  4771 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.317s	user 0.002s	sys 0.001s
I20260709 12:59:41.086599  4745 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:40.948211  4764 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.269s	user 0.000s	sys 0.002s
W20260709 12:59:41.315712  4787 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:59:40.877790  4561 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.492612  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:40.868309  4575 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.444247  4754 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.583s	user 0.005s	sys 0.025s
I20260709 12:59:40.946985  4696 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.521013  4575 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:40.922394  4775 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.521885  4696 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.523535  4575 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.037972  4445 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.524245  4775 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.524406  4696 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:40.961339  4532 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:41.455566  4750 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:59:41.437167  1538 rpcz_store.cc:276] 0709 12:59:39.738624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.758896 (+ 20272us) service_pool.cc:224] Handling call
0709 12:59:39.759204 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.826796 (+ 67592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.826834 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.839620 (+ 12786us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.003032 (+163412us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.149255 (+146223us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.149507 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.149592 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.778302 (+628710us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:41.301983 (+523681us) raft_consensus.cc:1685] finished
0709 12:59:41.320656 (+ 18673us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.320924 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626479,"prepare.queue_time_us":107523,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":31026,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":59227,"spinlock_wait_cycles":10515840,"thread_start_us":275694,"threads_started":2,"wal-append.queue_time_us":137804}
I20260709 12:59:40.833443  4727 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:40.833233  4198 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.632s
I20260709 12:59:40.923292  4224 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:40.948921  4089 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:40.841040  4781 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.047122  4710 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.877947  4723 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.223570  4716 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:41.219386  4759 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:40.922627  4765 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:40.869025  4718 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.947045  4501 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:40.946715  4702 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:40.953042  4786 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.481925  4785 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:59:40.805220  4567 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.512900  4743 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:41.456816  4590 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.513772  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.479230  4792 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:41.514911  4767 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
W20260709 12:59:41.316362  4753 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:59:41.517655  4745 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.320453  4784 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.315913  4766 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.402s
W20260709 12:59:41.528833  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.525902  4727 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:41.509630  4425 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:41.544214  4501 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.564791  4425 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.566386  4501 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.519658  4186 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:41.542887  4532 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:41.573330  4590 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.574057  4727 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.540089  1507 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:41.540984  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.477152  4612 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:41.541635  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 101803us
I20260709 12:59:41.506999  4777 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.533746  4393 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.536005  4710 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.539881  4692 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.558609  4745 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.559850  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.570762  4781 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.571781  4716 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:41.549394  4743 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.531186  4224 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:41.596165  4198 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.604527  4224 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:41.604898  4198 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.607096  4198 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.607755  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:41.608824  2308 raft_consensus.cc:2410] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:41.579200  4089 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:41.609661  4089 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.581862  4612 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.582556  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 426) took 1434 ms. Trace:
I20260709 12:59:41.612740  1684 rpcz_store.cc:276] 0709 12:59:40.148564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.148713 (+   149us) service_pool.cc:224] Handling call
0709 12:59:41.581793 (+1433080us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26e9c 00007f8d55b26a5b 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:41.581990 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.582185 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.582215 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.582261 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:41.582296 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.582351 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.582459 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8455808}
I20260709 12:59:41.546725  4702 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:41.561332  4784 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.614897  4702 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.616773  1683 raft_consensus.cc:2410] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:41.544448  4786 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.618687  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.619347  1684 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:41.620723  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.621201  1616 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:41.530464  4561 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.538642  4696 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:41.624452  4561 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:41.588793  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 131101us
W20260709 12:59:41.628988  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.630610  4566 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:41.631177  4566 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:41.567939  4425 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.538187  4718 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.592133  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.635144  1689 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
W20260709 12:59:41.638370  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 52908.9us
I20260709 12:59:41.600528  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:41.639670  1611 raft_consensus.cc:2393] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:41.602597  4567 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.537106  4723 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.634291  4708 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:41.543162  4759 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.621829  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.588326  4501 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:41.650280  1613 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:41.583451  4186 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:41.555878  4767 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.596387  4716 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:41.655699  2304 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:41.681558  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51198.9us
I20260709 12:59:41.662274  1684 raft_consensus.cc:2410] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:41.662597  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:41.664814  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:41.682658  1685 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:41.682658  1616 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:41.665467  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.590123  4746 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.670006  4804 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.554126  4792 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.619817  4786 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.690107  1689 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:41.690544  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.656416  4708 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:41.664426  4501 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.692981  4501 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:41.701929  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.703156  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.703074  4716 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.636442  4692 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.704667  4186 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.706085  4792 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:41.706404  4692 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:41.707430  4794 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:59:41.700210  4804 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.699043  4781 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.708372  4781 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:41.709616  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1660) took 1047 ms. Trace:
I20260709 12:59:41.710139  4804 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.710328  4781 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.711402  1612 raft_consensus.cc:2410] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:41.712617  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.713433  1689 raft_consensus.cc:2410] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:41.716023  1685 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:41.680733  4089 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.709976  1687 rpcz_store.cc:276] 0709 12:59:40.662048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.833119 (+171071us) service_pool.cc:224] Handling call
0709 12:59:40.833452 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.884146 (+ 50694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.708538 (+824392us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54003ad020. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc2dc0 00007f8d58c4ea02 00007f8d58c4add6 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 12:59:41.709401 (+   863us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5400392e54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:41.709560 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180124288}
W20260709 12:59:41.721990  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 82912.2us
I20260709 12:59:41.680263  4784 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:41.723145  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.725121  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.725862  1685 raft_consensus.cc:2368] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:41.726215  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.726811  1687 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:41.727586  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:41.729159  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.730167  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.723807  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:41.730877  1687 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:41.676635  4612 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:59:41.737587  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.735670  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:41.736389  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 55908.1us
I20260709 12:59:41.736800  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:41.738643  1689 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.655279  4566 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.740162  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:41.741755  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.742389  1684 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:41.728601  4198 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.710793  4804 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:41.693079  4746 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:41.732203  4791 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:59:41.730310  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
W20260709 12:59:42.249629  1579 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.014s
I20260709 12:59:41.859977  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:41.835583  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.054178  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.185662  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.958393  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:42.305395  1683 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:41.843293  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:41.843765  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:42.205669  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 429463us
I20260709 12:59:42.306782  2305 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:42.302935  1616 raft_consensus.cc:606] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:41.751824  1684 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:41.833760  1690 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:59:42.307813  2309 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:42.169025  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1560) took 2428 ms. Trace:
I20260709 12:59:42.308576  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1650) took 2021 ms. Trace:
I20260709 12:59:41.958737  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:42.309152  1690 rpcz_store.cc:276] 0709 12:59:40.287550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.314082 (+ 26532us) service_pool.cc:224] Handling call
0709 12:59:41.833322 (+1519240us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:41.833534 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.308143 (+474609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.308519 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13101824}
I20260709 12:59:42.307763  1616 raft_consensus.cc:614] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:42.310137  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:42.308490  1607 rpcz_store.cc:276] 0709 12:59:39.741107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.745708 (+  4601us) service_pool.cc:224] Handling call
0709 12:59:39.745957 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.773399 (+ 27442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.773430 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.773501 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:39.773533 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.168727 (+2395194us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b54002b5054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:42.168796 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.168960 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62712192}
I20260709 12:59:42.311549  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:42.307478  1579 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.015s
W20260709 12:59:42.304147  2304 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.016s
W20260709 12:59:42.312434  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 570036us
I20260709 12:59:42.312723  2304 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:41.764359  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:41.832278  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1648) took 1685 ms. Trace:
I20260709 12:59:42.313951  1687 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:42.313885  1688 rpcz_store.cc:276] 0709 12:59:40.146588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.147469 (+   881us) service_pool.cc:224] Handling call
0709 12:59:41.831375 (+1683906us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:41.831612 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.831879 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.831909 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.831971 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:41.832004 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.832064 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.832189 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7754496}
I20260709 12:59:42.314915  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:42.301208  1506 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.509s (SENT)
I20260709 12:59:42.315438  1687 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:42.316267  1506 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.558s (SENT)
I20260709 12:59:41.831856  1436 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:42.317519  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:41.737617  4089 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:42.305688  2307 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:42.318099  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.320798  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.321130  1684 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:42.321555  1609 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 12:59:42.318885  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.318116  1686 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.316766  1506 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:42.319495  1689 consensus_meta.cc:287] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
W20260709 12:59:42.322525  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.820544  4567 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.288694  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:42.323208  1689 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
W20260709 12:59:42.124835  4224 consensus_meta.cc:287] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.003s
W20260709 12:59:42.168712  4727 consensus_meta.cc:287] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
W20260709 12:59:42.111583  4700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.004s	sys 0.054s
I20260709 12:59:42.329353  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:42.318495  4198 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.331627  4567 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:41.839219  4718 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:42.339104  2305 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:42.324800  4688 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:42.327062  4415 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.350535  4415 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:42.351689  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.352165  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.330307  4420 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.340725  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.171885  4501 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.341779  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:41.845197  4723 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:42.320582  4089 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.838542  4733 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:42.320750  4728 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:41.840062  4767 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:42.347172  1607 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:42.377274  4089 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.378286  4767 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:42.378866  4767 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:42.379213  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.379853  1607 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:42.380460  4733 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:41.744457  4781 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.595s
I20260709 12:59:42.382134  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.382752  1690 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:42.349924  4198 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:42.383603  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:42.384814  4710 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:41.744905  4740 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.595s
I20260709 12:59:42.327270  4804 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.357298  1615 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:42.357776  1609 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:41.751588  4393 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.592s
I20260709 12:59:42.341323  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:42.344410  4700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.004s	sys 0.055s
I20260709 12:59:42.359215  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 763) took 1053 ms. Trace:
I20260709 12:59:42.360579  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 759) took 1233 ms. Trace:
I20260709 12:59:42.362335  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:42.363852  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:42.396644  1611 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:42.364681  1614 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.366596  4567 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:42.395583  2304 rpcz_store.cc:276] 0709 12:59:41.305532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.305666 (+   134us) service_pool.cc:224] Handling call
0709 12:59:42.359033 (+1053367us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540015e0d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:42.359140 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496593792}
I20260709 12:59:42.396116  2308 rpcz_store.cc:276] 0709 12:59:41.127507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.213719 (+ 86212us) service_pool.cc:224] Handling call
0709 12:59:42.360381 (+1146662us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54004bc154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:42.360527 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394981632}
I20260709 12:59:42.367453  4759 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:42.362974  4420 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.405859  4420 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:42.406195  4655 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:41.819479  4799 consensus_queue.cc:1175] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "631fb66c0070402b8f78fd74633dae6f" responder_term: 10 status { last_received { term: 10 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:41.845404  4708 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:42.346566  4688 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:42.409970  4688 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:42.411172  4688 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.372061  4458 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:42.372066  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.373445  4746 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:42.373641  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.374919  2302 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:42.384469  4728 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:42.340545  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:42.417124  1689 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:42.384146  1690 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.390841  4797 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:42.391626  4501 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:42.392565  4415 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:42.394521  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.419735  1615 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:42.397819  1616 raft_consensus.cc:2410] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:42.338594  4224 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.399127  1608 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:42.400920  4767 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:42.385842  4723 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:42.398638  4804 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:42.342248  4727 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.413791  1686 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:42.415354  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:42.418272  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.435922  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:42.455425  4775 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:42.430907  4728 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:42.456835  4089 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.570039  4089 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:42.422139  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.440165  1436 catalog_manager.cc:5697] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.571461  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:42.571527  1436 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 5 to 6, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 6 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:42.572360  1688 raft_consensus.cc:2410] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:42.573297  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.572973  1436 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.574096  1688 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:59:42.419373  4797 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:42.461889  4716 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:42.472035  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.574852  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.472697  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.575552  1688 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:42.575879  1537 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:42.473160  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.473407  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.577410  1540 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:42.474052  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.442538  1609 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:42.477089  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.578118  1539 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:42.578246  1689 raft_consensus.cc:2376] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9. Re-sending same reply.
I20260709 12:59:42.495651  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.578812  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.495049  1611 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:42.425383  4806 raft_consensus.cc:1064] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 12:59:42.480113  1690 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:42.501541  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.580651  1537 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:42.492563  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:42.548130  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 112320us
I20260709 12:59:42.489593  1541 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:42.492923  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.494849  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.549520  1683 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:42.550148  4723 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.550536  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.479117  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.553110  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:42.419852  4809 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:59:42.555248  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.579434  1536 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:42.584980  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:42.633289  1688 raft_consensus.cc:2376] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9. Re-sending same reply.
I20260709 12:59:42.585129  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.580567  1614 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:42.589655  1612 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:42.582576  1535 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 3.
I20260709 12:59:42.631188  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.634810  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.635751  1538 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:42.635803  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.636453  1689 raft_consensus.cc:2393] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:42.637593  1686 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:59:42.639151  1610 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:42.639297  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:42.639611  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.640249  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:42.640399  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.552599  4699 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:42.640820  1689 raft_consensus.cc:2376] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7. Re-sending same reply.
I20260709 12:59:42.643563  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.643898  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.644557  1683 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:42.551050  4775 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:42.644639  1689 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:42.645753  1534 raft_consensus.cc:2368] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:42.646621  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:42.647007  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 208) took 34342 ms (client timeout 15000 ms). Trace:
I20260709 12:59:42.646560  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.647552  1541 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:42.656836  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.658011  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.658757  1689 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:42.659698  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.660450  1689 raft_consensus.cc:2368] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:42.623333  4767 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.670774  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.672048  1534 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:42.673887  1436 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 6 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.632014  4393 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.678951  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.677579  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:42.680661  1538 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.682545  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.682721  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:42.683521  1541 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.679745  1683 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:42.687323  4775 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:42.688736  4775 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:42.647459  1439 rpcz_store.cc:269] 0709 12:59:08.304436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.319099 (+ 14663us) service_pool.cc:224] Handling call
0709 12:59:42.646771 (+34327672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:30.943594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:30.951340 (+  7746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:30.951397 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:59:30.951415 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:30.952640 (+  1225us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:30.952721 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:30.952752 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:59:30.953918 (+  1166us) tablet.cc:701] Row locks acquired
0709 12:59:30.953966 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:59:30.954136 (+   170us) write_op.cc:270] Start()
0709 12:59:30.954312 (+   176us) write_op.cc:276] Timestamp: P: 1783601970954068 usec, L: 0
0709 12:59:30.954333 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:31.050084 (+ 95751us) log.cc:844] Serialized 4422 byte log entry
0709 12:59:31.966815 (+916731us) op_driver.cc:464] REPLICATION: finished
0709 12:59:32.470965 (+504150us) write_op.cc:301] APPLY: starting
0709 12:59:32.475359 (+  4394us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:32.475723 (+   364us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:32.475896 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:32.716861 (+240965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:32.717196 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:59:32.717244 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:32.717640 (+   396us) log.cc:844] Serialized 83 byte log entry
0709 12:59:32.717829 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:32.717968 (+   139us) write_op.cc:454] Released schema lock
0709 12:59:32.718027 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:32.718394 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:32.718421 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42865,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":473487,"apply.run_cpu_time_us":5336,"apply.run_wall_time_us":270732,"num_ops":11,"prepare.queue_time_us":547867,"prepare.run_cpu_time_us":25572,"prepare.run_wall_time_us":865095,"raft.queue_time_us":59017,"raft.run_cpu_time_us":29774,"raft.run_wall_time_us":101959,"replication_time_us":1012335,"thread_start_us":1164308,"threads_started":4,"wal-append.queue_time_us":550724,"wal-append.run_cpu_time_us":14599,"wal-append.run_wall_time_us":2116559}]]}
I20260709 12:59:42.695714  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.701090  1687 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
W20260709 12:59:42.703701  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 403034us
W20260709 12:59:42.710179  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.707695  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1652) took 2337 ms. Trace:
I20260709 12:59:42.773468  1541 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:42.675467  4699 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:42.777809  1436 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 4, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.787806  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 432) took 1155 ms. Trace:
I20260709 12:59:42.788467  1683 rpcz_store.cc:276] 0709 12:59:41.632537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.706758 (+1074221us) service_pool.cc:224] Handling call
0709 12:59:42.787171 (+ 80413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.787391 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.787418 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.787475 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:42.787519 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.787590 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.787730 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.791541  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.795219  1611 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:42.780642  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 433) took 1147 ms. Trace:
I20260709 12:59:42.799269  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:42.684942  4783 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:42.642877  4797 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:42.878257  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.909587  2309 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.010s	sys 0.018s
W20260709 12:59:42.821689  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.868530  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 757) took 3082 ms. Trace:
I20260709 12:59:42.816664  2276 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:42.952553  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 135987us
I20260709 12:59:42.822363  1533 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:59:42.903638  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 190637us
W20260709 12:59:42.948207  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 631990us
I20260709 12:59:42.897648  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:42.815965  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 489108us
I20260709 12:59:42.947276  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:42.954252  1506 leader_election.cc:336] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.652s (SENT)
I20260709 12:59:42.954471  2302 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:42.954722  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:42.955374  4680 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:42.955857  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:42.913012  1436 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 4, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:42.743289  1682 rpcz_store.cc:276] 0709 12:59:40.370135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.370268 (+   133us) service_pool.cc:224] Handling call
0709 12:59:40.383239 (+ 12971us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:40.383649 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.383681 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:40.384307 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.428960 (+ 44653us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.625473 (+196513us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.403594 (+1778121us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b180040afe0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 12:59:42.676888 (+273294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.684451 (+  7563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.684519 (+    68us) raft_consensus.cc:1685] finished
0709 12:59:42.707447 (+ 22928us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.707619 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3432,"prepare.queue_time_us":134710,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":5732,"raft.queue_time_us":99321,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":1420,"spinlock_wait_cycles":6754688,"thread_start_us":404177,"threads_started":3,"wal-append.queue_time_us":237870,"wal-append.run_cpu_time_us":2084,"wal-append.run_wall_time_us":1022488}
I20260709 12:59:42.956658  4501 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:42.968466  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.962764  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:42.969429  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:42.970808  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:42.971010  1614 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:42.971482  1537 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:42.922202  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:42.805480  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1422) took 1065 ms. Trace:
I20260709 12:59:42.973371  1687 rpcz_store.cc:276] 0709 12:59:41.745777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.804340 (+1058563us) service_pool.cc:224] Handling call
0709 12:59:42.804780 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.805039 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.805077 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.805136 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.805181 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.805253 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.805399 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.796514  1686 rpcz_store.cc:276] 0709 12:59:41.632826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.730823 (+1097997us) service_pool.cc:224] Handling call
0709 12:59:42.779902 (+ 49079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.780132 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.780172 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.780297 (+   125us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:42.780344 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.780426 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.780570 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.939396  2304 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
W20260709 12:59:42.951043  2309 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.011s	sys 0.018s
W20260709 12:59:42.958293  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.958575  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:42.958712  1541 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:42.959883  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.001106  1536 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.686697  4767 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:42.974694  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.009357  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.009737  1687 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:43.010089  1535 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.007053  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.011368  1682 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:42.951520  2306 rpcz_store.cc:276] 0709 12:59:39.785993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.922960 (+1136967us) service_pool.cc:224] Handling call
0709 12:59:41.075972 (+153012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.109113 (+ 33141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.109164 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.854256 (+745092us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b2c00047b98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 12:59:41.854762 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.111304 (+256542us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.111355 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.111451 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.776526 (+665075us) raft_consensus.cc:1685] finished
0709 12:59:42.776556 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.868433 (+ 91877us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11774,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":19389,"spinlock_wait_cycles":743607040,"thread_start_us":256037,"threads_started":1,"wal-append.queue_time_us":461344}
I20260709 12:59:43.011670  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1671) took 1258 ms. Trace:
I20260709 12:59:43.017992  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.012185  1686 rpcz_store.cc:276] 0709 12:59:41.753707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.010850 (+1257143us) service_pool.cc:224] Handling call
0709 12:59:43.011158 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.011337 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.011361 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.011404 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:43.011442 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.011506 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.011610 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:43.021529  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.022686  1614 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
W20260709 12:59:43.029031  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 71103.9us
I20260709 12:59:43.030727  1653 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:42.704675  4393 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.028940  1436 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.036432  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:43.047636  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.049018  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.040632  1537 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:43.054819  2308 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:43.056180  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.056854  1537 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 3.
I20260709 12:59:43.057677  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.058246  1537 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:43.059001  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.059687  1537 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:43.064352  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.065307  1683 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:43.042171  1682 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:43.066414  1682 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:43.042825  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:43.044389  1686 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:43.044771  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:43.005942  4698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.038s
I20260709 12:59:43.068830  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.069124  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.069454  1532 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:43.071074  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.074322  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.075485  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:42.968529  4728 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:43.079694  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.075505  2307 raft_consensus.cc:2410] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:43.080714  2305 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:43.099970  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.101006  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.100051  1436 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 5, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 5 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.084641  1682 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:43.046111  4797 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.102890  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.104362  1686 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:43.073817  4698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.008s	sys 0.038s
I20260709 12:59:43.110673  1436 catalog_manager.cc:5697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.111456  1682 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.100741  1533 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:43.115662  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.116534  1537 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:43.126478  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.070844  4089 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.130868  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:43.148965  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 195506us
I20260709 12:59:43.149678  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:43.150877  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.139698  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.152684  1686 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:43.153855  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:43.043632  4501 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.155961  1533 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:43.158957  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0409082479999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 12:59:43.162703  1686 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:43.163481  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.170161  1436 catalog_manager.cc:5697] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 4, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.965770  4783 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.173373  1436 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 4, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:43.197422  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.198536  1614 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:43.199582  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.201630  1686 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:43.152635  4727 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:43.107535  4728 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.218384  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.220806  1533 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.222306  1614 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
I20260709 12:59:43.161625  4680 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:43.164572  4821 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:43.228878  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:43.233794  4806 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.237766  4728 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:43.238425  4728 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:43.238884  4728 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:43.190006  4815 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.240931  4815 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.241956  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.181039  4224 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:43.245301  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.246241  1615 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:43.247455  1615 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:43.250247  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1566) took 2378 ms. Trace:
I20260709 12:59:43.250687  1610 rpcz_store.cc:276] 0709 12:59:40.872286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.873094 (+   808us) service_pool.cc:224] Handling call
0709 12:59:41.434506 (+561412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.639635 (+1205129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.250017 (+610382us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540020c454. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:43.250182 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2761939712}
W20260709 12:59:43.252345  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.257447  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.101058  4699 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.275539  1610 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:43.276889  1615 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:43.276741  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.281235  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.284857  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.286337  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.277807  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.288800  1532 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:43.201195  4723 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:43.223693  4089 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:43.296089  1504 leader_election.cc:336] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.693s (SENT)
I20260709 12:59:43.292371  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.306452  1532 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:43.239749  4728 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.326241  4680 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.290112  4590 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:59:43.327903  4819 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:43.329488  4716 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.000s
I20260709 12:59:43.329751  4501 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:43.334198  4826 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:43.275053  4612 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.335057  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 303330us
I20260709 12:59:43.279902  4727 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:43.290385  4746 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:43.379047  1685 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
W20260709 12:59:43.350610  1504 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 2.146s (SENT)
I20260709 12:59:43.352099  4817 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.352119  4827 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.352893  4590 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:43.350126  4819 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:43.348734  4698 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:43.360265  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.275686  4821 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:43.365793  4775 consensus_meta.cc:287] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.000s
I20260709 12:59:43.308807  4723 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:43.336629  4224 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.371050  1687 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:43.469297  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1441) took 1065 ms. Trace:
W20260709 12:59:43.372294  1538 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 12:59:43.470549  1538 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:43.470715  1535 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:43.375460  1536 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:43.471921  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.472726  1536 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:43.309832  4089 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.384146  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.437311  4698 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.419468  4612 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.442130  4590 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:43.447175  4393 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:43.448189  4820 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:59:43.448469  4566 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.422930  4827 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:43.425019  4819 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.454082  4799 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:59:43.455432  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 499721us
I20260709 12:59:43.458614  4723 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.383400  4727 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.462529  4696 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:43.467422  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 390) took 1113 ms. Trace:
I20260709 12:59:43.473749  4224 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.473018  4812 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.547224  1608 rpcz_store.cc:276] 0709 12:59:42.354075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.354175 (+   100us) service_pool.cc:224] Handling call
0709 12:59:42.389947 (+ 35772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.551350 (+161403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.467189 (+915839us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b54003f4b50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:43.467349 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5869440}
I20260709 12:59:43.469626  1687 rpcz_store.cc:276] 0709 12:59:42.403817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.053157 (+649340us) service_pool.cc:224] Handling call
0709 12:59:43.370410 (+317253us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54001190a8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5dbefebc 00007f8d5dc2508c 00007f8d5dc0f93b 00007f8d5dc0f3d2 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c
0709 12:59:43.370577 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.469045 (+ 98468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.469246 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32278784}
I20260709 12:59:43.383616  4746 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.453979  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.561775  1539 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:43.478324  1533 raft_consensus.cc:2410] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:59:43.478210  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 127640us
W20260709 12:59:43.564785  1504 leader_election.cc:336] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 2.207s (SENT)
W20260709 12:59:43.566497  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.479480  1682 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:59:43.567552  1682 pending_rounds.cc:85] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 12:59:43.567869  1682 pending_rounds.cc:107] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:59:43.568185  1682 raft_consensus.cc:2889] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:43.479094  4501 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.537706  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.479243  4089 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.481653  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.540067  1611 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:43.437624  4804 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:43.541184  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.538589  4821 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:43.541975  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.419131  4814 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.549031  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:43.581599  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:43.587734  1539 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:43.546800  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 516158us
I20260709 12:59:43.422648  4716 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:43.549002  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.480981  4823 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.592722  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.593811  1687 raft_consensus.cc:2410] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:43.595120  1687 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:43.596910  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.597867  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1442) took 1193 ms. Trace:
I20260709 12:59:43.598274  1690 rpcz_store.cc:276] 0709 12:59:42.404093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.580078 (+175985us) service_pool.cc:224] Handling call
0709 12:59:43.596727 (+1016649us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 12:59:43.597796 (+  1069us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10997120}
W20260709 12:59:43.600955  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 52026.6us
I20260709 12:59:43.561653  4727 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.562053  4224 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.547116  4696 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:43.481971  4698 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.492417  1532 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:43.583434  1535 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:43.572499  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:43.584365  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.035s
I20260709 12:59:43.584542  1538 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:43.616988  1533 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:43.584676  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1440) took 1181 ms. Trace:
I20260709 12:59:43.617750  1682 rpcz_store.cc:276] 0709 12:59:42.403550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.041646 (+638096us) service_pool.cc:224] Handling call
0709 12:59:43.042027 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.584176 (+542149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.584597 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:43.542940  4799 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:43.419116  4826 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.590466  1653 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:43.591077  1537 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:43.622582  1506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.009s
W20260709 12:59:43.622963  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.013s	sys 0.009s
I20260709 12:59:43.623111  1687 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:59:43.623399  1506 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.665s (SENT)
W20260709 12:59:43.624373  1506 leader_election.cc:336] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.693s (SENT)
I20260709 12:59:43.570040  4746 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.437748  4817 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.545346  4827 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:43.619746  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.011s	sys 0.035s
I20260709 12:59:43.568853  4718 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:59:43.621155  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.570977  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1406) took 1944 ms. Trace:
I20260709 12:59:43.612206  4501 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:43.642467  1656 connection.cc:256] RPC call timeout handler was delayed by -2.4108430990000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:59:43.569520  4812 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:43.639118  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.012s
I20260709 12:59:43.634303  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.633037  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.642026  1532 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
W20260709 12:59:43.653192  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.654858  1536 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.655695  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 393) took 1300 ms. Trace:
I20260709 12:59:43.642894  1689 rpcz_store.cc:276] 0709 12:59:41.626566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.673190 (+1046624us) service_pool.cc:224] Handling call
0709 12:59:42.673543 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.703281 (+ 29738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.703318 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.743182 (+ 39864us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.117807 (+374625us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:43.570049 (+452242us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.570350 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.570645 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.570711 (+    66us) raft_consensus.cc:1685] finished
0709 12:59:43.570730 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.570904 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52650,"raft.queue_time_us":47314,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":51898,"thread_start_us":568388,"threads_started":2,"wal-append.queue_time_us":543408}
I20260709 12:59:43.647295  1535 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 12:59:43.656209  1613 rpcz_store.cc:276] 0709 12:59:42.355019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.355157 (+   138us) service_pool.cc:224] Handling call
0709 12:59:42.368634 (+ 13477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.368997 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.369027 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.369499 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.789302 (+419803us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:43.030286 (+240984us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.130457 (+100171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.130544 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.655442 (+524898us) raft_consensus.cc:1685] finished
0709 12:59:43.655471 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.655621 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86933,"prepare.queue_time_us":255224,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":148496,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":16976,"thread_start_us":419377,"threads_started":1,"wal-append.queue_time_us":755720}
I20260709 12:59:43.611290  4823 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.658733  1535 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:43.659863  1535 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.643455  4501 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.660465  4501 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.660521  4826 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:43.661343  4777 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:43.663671  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.605482  4716 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.649161  1533 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:43.631659  4821 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:43.638166  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:43.693634  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69311.1us
W20260709 12:59:43.650735  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1597430990000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:59:43.650966  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 497227us
W20260709 12:59:43.695679  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1534430990000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 12:59:43.696043  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1435430989999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:59:43.696360  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1417430989999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:59:43.696648  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1075430989999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 12:59:43.682066  1539 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 4.
W20260709 12:59:43.696938  1656 connection.cc:256] RPC call timeout handler was delayed by -1.9527430990000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 12:59:43.697247  1656 connection.cc:256] RPC call timeout handler was delayed by -1.8996430990000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 12:59:43.697346  1538 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:43.697556  1656 connection.cc:256] RPC call timeout handler was delayed by -1.8411430990000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 12:59:43.697862  1656 connection.cc:256] RPC call timeout handler was delayed by -1.4910430990000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25270000000000004s for a response
W20260709 12:59:43.698199  1656 connection.cc:256] RPC call timeout handler was delayed by -1.307443099000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2731s for a response
I20260709 12:59:43.683406  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:43.700276  1607 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.685357  1532 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:43.686307  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:43.686844  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.035s	sys 0.042s
I20260709 12:59:43.701649  1610 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:43.701691  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.035s	sys 0.042s
W20260709 12:59:43.688076  1579 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.015s	sys 0.012s
W20260709 12:59:43.702924  1579 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.016s	sys 0.012s
W20260709 12:59:43.703400  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 570545us
I20260709 12:59:43.704768  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:43.695369  1506 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.046s (SENT)
I20260709 12:59:43.705679  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:43.695467  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.011s	sys 0.039s
I20260709 12:59:43.699362  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:43.687846  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.005s	sys 0.012s
I20260709 12:59:43.668416  4828 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:43.697983  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.708590  1532 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:43.709197  1579 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:43.709658  1539 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:43.709761  1532 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:43.710860  1539 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:43.707235  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.012s	sys 0.039s
I20260709 12:59:43.712924  1608 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:43.605639  4814 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:43.720827  1537 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
W20260709 12:59:43.646941  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.716717  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2223) took 1146 ms. Trace:
I20260709 12:59:43.723882  1611 rpcz_store.cc:276] 0709 12:59:42.570337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.970177 (+399840us) service_pool.cc:224] Handling call
0709 12:59:43.716553 (+746376us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400216e54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:43.716660 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947636480}
I20260709 12:59:43.727586  2309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 469) took 1737 ms. Trace:
I20260709 12:59:43.727810  1536 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:43.714103  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.768496  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:59:43.770136  1689 raft_consensus.cc:606] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:43.758687  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:43.764881  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 45227.3us
I20260709 12:59:43.774421  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:43.770138  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.019s	sys 0.064s
I20260709 12:59:43.775419  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:43.776865  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.019s	sys 0.064s
I20260709 12:59:43.776031  1607 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:43.692736  4743 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:43.773022  1609 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 12:59:43.780102  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:43.781091  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 493746us
I20260709 12:59:43.795846  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.782847  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:43.797070  1608 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
W20260709 12:59:43.783877  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.784368  2302 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 12:59:43.786430  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.712033  4846 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.638811  4590 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.718268  4826 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.815471  1535 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:43.729353  4832 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:59:43.819283  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:43.833962  1532 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:59:43.820720  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 106671us
I20260709 12:59:43.728051  2309 rpcz_store.cc:276] 0709 12:59:41.990138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.323596 (+333458us) service_pool.cc:224] Handling call
0709 12:59:42.342817 (+ 19221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.343026 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:42.976270 (+633244us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.727257 (+750987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.727311 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:43.727351 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.727413 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.727528 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51884,"prepare.queue_time_us":937199,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":139664,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":1315672,"threads_started":3,"wal-append.queue_time_us":493609}
W20260709 12:59:43.822345  1681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.016s
I20260709 12:59:43.823644  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.710006  4718 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.720252  4702 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:43.835815  1681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.013s	sys 0.017s
W20260709 12:59:43.836796  1684 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.009s	sys 0.021s
W20260709 12:59:43.852630  1684 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.009s	sys 0.021s
I20260709 12:59:43.852769  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.853703  2302 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:43.717660  4813 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:59:43.859565  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:43.859822  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:43.863291  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 167980us
I20260709 12:59:43.863866  2308 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:43.862390  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.728804  4804 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 12:59:43.669579  4799 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:43.816080  4846 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:43.832401  4496 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.866978  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.832278  4834 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.855635  4702 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.880707  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:43.887538  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 148104us
I20260709 12:59:43.911500  4834 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.912060  4834 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:43.889042  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 59506.6us
I20260709 12:59:43.890061  1579 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:43.871131  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.887069  4496 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:43.914983  4496 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.922662  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:43.921096  4699 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.932847  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.933697  2302 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
W20260709 12:59:43.946990  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 223892us
I20260709 12:59:43.949791  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.954274  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.952855  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.957310  2305 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:43.957355  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.850582  4800 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:59:43.958194  1687 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:43.876004  4846 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.951862  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:43.959528  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 88554.9us
W20260709 12:59:43.958662  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46773.6us
I20260709 12:59:43.962630  2308 raft_consensus.cc:2410] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:43.970178  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.975023  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1649) took 3778 ms. Trace:
I20260709 12:59:43.975476  1681 rpcz_store.cc:276] 0709 12:59:40.196936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.197337 (+   401us) service_pool.cc:224] Handling call
0709 12:59:40.801714 (+604377us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:40.805317 (+  3603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.805524 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:40.923658 (+118134us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.043179 (+2119521us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b1800015fa0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a 00007f8d58c55a2a
0709 12:59:43.863668 (+820489us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.974607 (+110939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.974682 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:43.974739 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.974833 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.974961 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232471,"prepare.queue_time_us":702287,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":255453,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":208803968,"thread_start_us":915283,"threads_started":3,"wal-append.queue_time_us":2671874}
I20260709 12:59:43.864195  4735 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:59:43.978861  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.990531  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.866421  4844 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.995580  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.996438  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:43.999328  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:43.930868  4561 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.888774  4612 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:44.002270  1506 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.168s (SENT)
I20260709 12:59:44.005664  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:44.003647  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:43.929562  4702 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:44.008927  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 45438.9us
I20260709 12:59:44.010418  1507 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:44.012503  4858 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.013296  4828 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:44.013156  4858 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.014125  4828 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:43.961817  4799 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.919942  4834 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.017179  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:44.020236  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:44.021724  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:43.942723  4833 consensus_queue.cc:1059] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:59:43.930783  4745 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
W20260709 12:59:44.024866  4837 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:59:43.988963  4821 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:43.930735  4699 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.006192  4728 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.005067  4561 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:44.043608  4825 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.329s	user 0.000s	sys 0.003s
I20260709 12:59:44.040609  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:44.017204  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 127225us
I20260709 12:59:43.994894  4700 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:59:44.042327  1506 leader_election.cc:336] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.207s (SENT)
I20260709 12:59:44.068015  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:44.000736  4777 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:59:44.186328  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.186868  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.187189  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 477) took 1170 ms. Trace:
W20260709 12:59:44.187507  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.188796  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:44.190095  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:44.190697  1607 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:44.025936  4838 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.191982  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:44.187567  2306 rpcz_store.cc:276] 0709 12:59:43.017046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.017193 (+   147us) service_pool.cc:224] Handling call
0709 12:59:43.109662 (+ 92469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.112408 (+  2746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.112627 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.113255 (+   628us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:43.113314 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.113395 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.187005 (+1073610us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54004bc150. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:44.187133 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71979904}
W20260709 12:59:44.185141  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 146030us
I20260709 12:59:44.197116  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:44.205266  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 343) took 1018 ms. Trace:
I20260709 12:59:44.205525  1539 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:44.205691  1537 rpcz_store.cc:276] 0709 12:59:43.186612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.481399 (+294787us) service_pool.cc:224] Handling call
0709 12:59:44.205087 (+723688us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b54002c6d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:44.205211 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15200128}
I20260709 12:59:44.206954  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 478) took 1189 ms. Trace:
W20260709 12:59:44.203192  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1419) took 2531 ms (client timeout 2078 ms). Trace:
I20260709 12:59:44.207616  2304 rpcz_store.cc:276] 0709 12:59:43.017569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.017714 (+   145us) service_pool.cc:224] Handling call
0709 12:59:44.206694 (+1188980us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54002e5254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:44.206850 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722428800}
W20260709 12:59:44.208443  1685 rpcz_store.cc:269] 0709 12:59:41.671772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.726652 (+ 54880us) service_pool.cc:224] Handling call
0709 12:59:44.202954 (+2476302us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540012e154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:44.203080 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3773422848}
I20260709 12:59:44.058360  4561 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.050509  4716 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:44.035122  4496 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:44.234601  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 192303us
W20260709 12:59:44.203488  4819 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.001s
W20260709 12:59:44.243763  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.185583  4844 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.258315  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:44.259651  2304 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:44.194494  4804 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.195660  4393 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:44.185356  4863 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:44.231793  4831 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 12:59:44.206878  4612 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:44.209466  4733 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.267843  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:44.222169  4806 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:44.231161  4815 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:44.267802  2275 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:44.277696  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1681) took 1452 ms. Trace:
W20260709 12:59:44.273928  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 253794us
I20260709 12:59:44.290978  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1687) took 1329 ms. Trace:
W20260709 12:59:44.283409  1506 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.597s (SENT)
I20260709 12:59:44.308609  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:44.304615  1540 rpcz_store.cc:276] 0709 12:59:42.961267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.961384 (+   117us) service_pool.cc:224] Handling call
0709 12:59:42.961666 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.977313 (+ 15647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.977344 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.977849 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.712665 (+734816us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:43.712709 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.712773 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.290768 (+577995us) raft_consensus.cc:1685] finished
0709 12:59:44.290788 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.290920 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305,"raft.queue_time_us":234414,"raft.run_cpu_time_us":2864,"raft.run_wall_time_us":16473,"thread_start_us":625384,"threads_started":1,"wal-append.queue_time_us":775605}
I20260709 12:59:44.294199  1686 rpcz_store.cc:276] 0709 12:59:42.825170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.220730 (+395560us) service_pool.cc:224] Handling call
0709 12:59:43.221046 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.221264 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:43.622347 (+401083us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.038607 (+416260us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.276825 (+238218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.277268 (+   443us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:44.277335 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.277426 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.277594 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61783,"prepare.queue_time_us":754471,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":8425,"raft.queue_time_us":45938,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":32633,"thread_start_us":978987,"threads_started":4,"wal-append.queue_time_us":417124}
I20260709 12:59:44.311674  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2254) took 1624 ms. Trace:
I20260709 12:59:44.312134  1534 rpcz_store.cc:276] 0709 12:59:42.692713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.707144 (+ 14431us) service_pool.cc:224] Handling call
0709 12:59:42.784308 (+ 77164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.784595 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.784635 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.827302 (+ 42667us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.420971 (+593669us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:43.421032 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.421122 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.311420 (+890298us) raft_consensus.cc:1685] finished
0709 12:59:44.311447 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.311607 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":468219,"threads_started":1,"wal-append.queue_time_us":731921}
I20260709 12:59:44.309706  4735 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:44.316634  4841 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.317173  4841 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:44.317634  4841 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:44.317829  4850 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:59:44.320474  4866 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:44.320930  4866 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:44.321305  4866 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.321504  4723 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:44.322085  4723 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.264320  4823 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:44.322983  4823 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:44.323320  4823 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.323661  4823 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:44.324035  4835 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.331s	user 0.000s	sys 0.000s
W20260709 12:59:44.328534  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.329026  4854 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:59:44.330940  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1407) took 2704 ms. Trace:
I20260709 12:59:44.331501  1688 rpcz_store.cc:276] 0709 12:59:41.626830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.677348 (+1050518us) service_pool.cc:224] Handling call
0709 12:59:42.677622 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.707310 (+ 29688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.707350 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.968942 (+261592us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.702481 (+733539us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:43.702537 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.702631 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.330746 (+628115us) raft_consensus.cc:1685] finished
0709 12:59:44.330764 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.330887 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12261,"raft.queue_time_us":174154,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":45312,"thread_start_us":601626,"threads_started":1,"wal-append.queue_time_us":816071}
I20260709 12:59:44.332780  4767 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:44.332882  4874 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:44.333393  4874 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.333700  4874 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.334246  4767 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.334775  4767 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:44.334813  1426 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ff79ac342d91424db634ca7802846535 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:44.335790  1426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89994.4us
I20260709 12:59:44.334340  1682 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:44.332903  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:44.337949  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:44.370822  2304 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:44.372041  1653 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:44.291584  4612 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.284173  4833 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.289093  4716 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:44.405090  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:44.273955  4842 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.309900  4393 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:44.330961  4501 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.000s
I20260709 12:59:44.293615  4806 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:44.261924  4819 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.272006  4804 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.335790  4767 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.438903  4745 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:44.498294  4767 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.498646  4745 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:44.499010  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1677) took 1915 ms. Trace:
W20260709 12:59:44.484157  4831 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:59:44.492671  4834 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:44.409590  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 101644us
I20260709 12:59:44.300570  4821 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.511739  4745 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.513337  4745 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.316645  4735 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.486261  4836 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.524813  4501 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.464166  2309 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:44.566445  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:44.566654  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:44.596287  2307 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:44.596773  2307 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:44.336366  4879 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:44.598433  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:44.368456  4817 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:44.449853  4855 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:59:44.527478  4716 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:44.604003  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.616865  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:44.405454  4612 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:44.610324  2276 connection.cc:256] RPC call timeout handler was delayed by -2.5435945379999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:59:44.610399  4819 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:44.611186  4806 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.638710  4806 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.475541  4833 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:44.640060  4833 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.608300  4393 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.603238  2307 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:44.629685  2276 connection.cc:256] RPC call timeout handler was delayed by -2.2834945379999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 12:59:44.642328  2276 connection.cc:256] RPC call timeout handler was delayed by -2.1331945379999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:59:44.642669  2276 connection.cc:256] RPC call timeout handler was delayed by -1.9378945379999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:59:44.642989  2276 connection.cc:256] RPC call timeout handler was delayed by -1.9243945379999445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:59:44.642433  2307 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:44.643293  2276 connection.cc:256] RPC call timeout handler was delayed by -1.3150945379999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2882s for a response
W20260709 12:59:44.643858  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 376164us
I20260709 12:59:44.644897  4813 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:44.632948  4775 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.657219  1615 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:44.603310  4879 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:44.628798  4716 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:44.700047  1687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.003s	sys 0.007s
I20260709 12:59:44.604117  2304 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.499421  1684 rpcz_store.cc:276] 0709 12:59:42.583997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.144329 (+560332us) service_pool.cc:224] Handling call
0709 12:59:43.144846 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.145106 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:43.853096 (+707990us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.498441 (+645345us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b180040b580. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a
0709 12:59:44.498680 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.498729 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:44.498770 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.498841 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.498958 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29522,"prepare.queue_time_us":743728,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":56196864,"thread_start_us":792978,"threads_started":2}
W20260709 12:59:44.663457  1610 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.010s
W20260709 12:59:44.671741  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.707434  1610 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 12:59:44.698379  1683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.005s	sys 0.005s
I20260709 12:59:44.699237  1615 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:44.708150  1683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.005s	sys 0.005s
I20260709 12:59:44.699860  1609 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:59:44.646363  2276 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Timed out: RequestConsensusVote RPC to 127.0.107.193:34321 timed out after 1.517s (SENT)
I20260709 12:59:44.709277  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1673) took 2284 ms. Trace:
W20260709 12:59:44.702242  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.710603  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.702919  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.000s	sys 0.010s
W20260709 12:59:44.711639  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.011s
W20260709 12:59:44.707674  1687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.004s	sys 0.007s
W20260709 12:59:44.697914  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.001s	sys 0.009s
W20260709 12:59:44.713738  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.001s	sys 0.009s
W20260709 12:59:44.714597  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.712103  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 718061us
I20260709 12:59:44.716936  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:44.715350  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.104s
I20260709 12:59:44.640503  4833 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:44.717644  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.011s	sys 0.104s
W20260709 12:59:44.717980  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 696343us
I20260709 12:59:44.718602  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:44.727058  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:44.723594  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.004s	sys 0.008s
W20260709 12:59:44.728367  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.004s	sys 0.008s
I20260709 12:59:44.763592  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:44.764659  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 118323us
W20260709 12:59:44.698669  4590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.000s	sys 0.011s
W20260709 12:59:44.721447  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 438114us
W20260709 12:59:44.773844  2276 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34321 timed out after 1.806s (SENT) [suppressed 41 similar messages]
I20260709 12:59:44.724625  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1585) took 1050 ms. Trace:
I20260709 12:59:44.775202  1610 rpcz_store.cc:276] 0709 12:59:43.657569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.657670 (+   101us) service_pool.cc:224] Handling call
0709 12:59:44.707994 (+1050324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.776077  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:44.777168  2310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.025s	sys 0.023s
I20260709 12:59:44.765492  4879 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.709758  1683 rpcz_store.cc:276] 0709 12:59:42.425163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.066055 (+640892us) service_pool.cc:224] Handling call
0709 12:59:43.106452 (+ 40397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.106667 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:43.706818 (+600151us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.708761 (+1001943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.708834 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:44.708897 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.708985 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.709211 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":662497,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":85520,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"thread_start_us":1560961,"threads_started":3}
I20260709 12:59:44.717444  4728 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.719219  4867 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.771890  4496 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:44.732052  4844 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:44.729154  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 806600us
I20260709 12:59:44.777721  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:44.661851  4501 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:44.777709  2310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.026s	sys 0.024s
I20260709 12:59:44.797751  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1694) took 1822 ms. Trace:
W20260709 12:59:44.811959  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.807739  2305 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:59:44.820866  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 104022us
I20260709 12:59:44.801980  4708 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.850464  1616 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:44.726747  4863 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:44.784543  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 66028.7us
I20260709 12:59:44.839847  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:44.856729  1540 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.802965  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:44.857347  1683 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:44.857648  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.851225  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.857026  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:44.812470  4743 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.806218  4476 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.110s
W20260709 12:59:44.921276  4698 consensus_meta.cc:287] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.306s	user 0.011s	sys 0.004s
I20260709 12:59:44.921746  4698 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.923611  2307 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:59:44.923864  4698 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:44.983250  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.848126  4727 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.230s	user 0.009s	sys 0.005s
I20260709 12:59:44.916467  4743 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:44.932886  4879 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.928699  4858 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:44.931916  4746 consensus_meta.cc:287] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.283s	user 0.027s	sys 0.013s
I20260709 12:59:44.928647  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:44.925055  4863 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.832166  4728 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:44.934175  4696 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.928505  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:44.846540  1538 rpcz_store.cc:276] 0709 12:59:42.974928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.621488 (+646560us) service_pool.cc:224] Handling call
0709 12:59:43.697173 (+ 75685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.697763 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.797546 (+1099783us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54002c7c50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:44.797693 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173302656}
I20260709 12:59:44.804286  4832 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 12:59:44.930684  4823 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 12:59:44.924405  1611 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:44.941108  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.929461  4866 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.003s
W20260709 12:59:44.932600  4089 consensus_meta.cc:287] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.325s	user 0.011s	sys 0.007s
I20260709 12:59:44.782704  4812 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:44.885960  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:44.826426  4889 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:44.843924  4804 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:44.825030  2304 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:44.966107  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:44.782021  4853 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:59:44.850833  4887 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.277s
I20260709 12:59:44.995743  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1714) took 1206 ms. Trace:
I20260709 12:59:44.997679  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:44.848889  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:44.920207  4841 consensus_meta.cc:287] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.009s
W20260709 12:59:44.835554  4827 consensus_meta.cc:287] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.185s	user 0.017s	sys 0.003s
W20260709 12:59:44.780360  4590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.000s	sys 0.014s
W20260709 12:59:45.009240  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 153021us
I20260709 12:59:45.011484  4727 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:44.934223  4846 consensus_meta.cc:287] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.970s	user 0.005s	sys 0.010s
I20260709 12:59:44.853524  4783 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:44.924089  2307 pending_rounds.cc:85] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 7
I20260709 12:59:44.806003  4874 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:44.814601  4816 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.273s
I20260709 12:59:45.018123  2306 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:45.224684  2303 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:45.021948  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:44.839656  4699 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:44.796514  4842 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.809789  4735 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.277740  1540 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
W20260709 12:59:45.136248  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.279273  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:45.109709  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:45.280495  2307 pending_rounds.cc:107] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:59:45.379344  2307 raft_consensus.cc:2889] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.380388  1615 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:45.276026  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:45.281515  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:45.381393  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 105466us
I20260709 12:59:45.382083  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:45.382402  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:45.277000  1609 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:45.317190  1683 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:45.362287  1539 rpcz_store.cc:276] 0709 12:59:43.789319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.814494 (+ 25175us) service_pool.cc:224] Handling call
0709 12:59:44.205283 (+390789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.238334 (+ 33051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.995455 (+757121us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002c6d50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:44.995664 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897410816}
I20260709 12:59:45.383000  1534 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:45.383873  1656 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:45.345521  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.434029  1616 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:45.389655  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 457) took 1457 ms. Trace:
I20260709 12:59:45.423619  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:45.437486  1534 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:45.437055  2303 rpcz_store.cc:276] 0709 12:59:43.932281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.933779 (+  1498us) service_pool.cc:224] Handling call
0709 12:59:45.389433 (+1455654us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540063ea54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:45.389580 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836540800}
W20260709 12:59:45.227289  4745 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.013s
I20260709 12:59:45.087589  1610 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:45.335990  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 772) took 1022 ms. Trace:
I20260709 12:59:45.285817  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:45.397008  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:45.205766  4767 consensus_meta.cc:287] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.707s	user 0.012s	sys 0.003s
W20260709 12:59:45.253244  4612 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.604s	user 0.002s	sys 0.006s
I20260709 12:59:45.020850  4718 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:45.143353  4566 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.581s	user 0.010s	sys 0.004s
W20260709 12:59:45.143715  4224 consensus_meta.cc:287] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.523s	user 0.008s	sys 0.006s
W20260709 12:59:45.236517  4857 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:59:45.443780  1689 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:45.445603  2301 rpcz_store.cc:276] 0709 12:59:44.258238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.262421 (+  4183us) service_pool.cc:224] Handling call
0709 12:59:44.289549 (+ 27128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.289769 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:44.818996 (+529227us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.280091 (+461095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:45.280148 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:45.280205 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.280282 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.280385 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48225,"prepare.queue_time_us":515096,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":42755,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":74075,"thread_start_us":831753,"threads_started":2}
I20260709 12:59:45.142984  4849 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:45.014211  4833 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.450268  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:45.082945  4813 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.234539  4702 consensus_meta.cc:287] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.195s	user 0.008s	sys 0.005s
I20260709 12:59:45.454169  1684 raft_consensus.cc:2410] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:45.454258  1616 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:45.456117  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 403) took 1267 ms. Trace:
I20260709 12:59:45.456653  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:45.026173  4728 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.009142  4476 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.427s
W20260709 12:59:45.443243  4826 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:59:45.017721  4746 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:45.221555  4561 consensus_meta.cc:287] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.960s	user 0.006s	sys 0.013s
I20260709 12:59:45.346455  4827 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.334824  4841 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:45.605392  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.548187  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.385203  4795 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.436174  4783 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:45.647898  1537 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:45.500995  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.440064  4889 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:45.012480  4882 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.670876  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.507020  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:45.497085  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:45.671730  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.444046  4696 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:45.675390  2308 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:45.610190  1611 rpcz_store.cc:276] 0709 12:59:44.189003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.191315 (+  2312us) service_pool.cc:224] Handling call
0709 12:59:44.191584 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.345491 (+1153907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.455839 (+110348us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540009abd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:45.456046 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685062400}
I20260709 12:59:45.647517  1534 raft_consensus.cc:2376] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11. Re-sending same reply.
I20260709 12:59:45.468743  1614 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:59:45.249958  4799 consensus_meta.cc:287] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.224s	user 0.023s	sys 0.018s
W20260709 12:59:45.584717  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 305529us
W20260709 12:59:45.650648  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 251055us
I20260709 12:59:45.586102  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:45.655112  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.014s	sys 0.021s
W20260709 12:59:45.677947  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.014s	sys 0.021s
W20260709 12:59:45.496026  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.514868  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:45.678849  1539 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
W20260709 12:59:45.662854  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 814063us
I20260709 12:59:45.680011  1582 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:45.571426  1609 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:45.601393  4735 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.462160  4767 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:45.673333  4727 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.603039  4812 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.675439  1612 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:59:45.444157  4821 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.696973  4566 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:45.667989  4849 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:45.679379  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.722177  4566 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.722623  4566 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:45.723320  4883 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:59:45.674482  4745 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:45.677973  1538 raft_consensus.cc:2376] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8. Re-sending same reply.
I20260709 12:59:45.467716  4612 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.049382  4878 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:45.463584  4892 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.243s
I20260709 12:59:45.659586  4863 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.689771  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:45.690490  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:45.662429  4476 consensus_queue.cc:1243] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:59:45.690523  1506 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.650s (SENT)
W20260709 12:59:45.897610  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 207169us
I20260709 12:59:45.898491  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 444) took 2124 ms. Trace:
W20260709 12:59:45.899415  1506 leader_election.cc:336] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.753s (SENT)
I20260709 12:59:45.899967  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:45.355829  4846 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.449154  4866 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:45.721879  4821 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.678318  2309 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:59:45.457597  4862 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.662019  4783 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:45.462901  4718 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:45.448992  4823 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:45.728569  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:45.436450  4089 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.678759  4777 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.723913  4849 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:45.807116  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 410210us
I20260709 12:59:45.677165  4813 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.691047  4847 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.818868  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.859355  4902 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:59:45.815884  4905 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:59:45.668182  4795 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.681481  4882 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:45.945259  4882 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:45.660334  4224 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.947475  4224 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.814630  4814 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.663532  4561 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.949743  4561 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:45.816337  4856 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.010s	user 0.000s	sys 0.014s
I20260709 12:59:45.728425  4767 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:45.951500  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.951907  1656 connection.cc:256] RPC call timeout handler was delayed by -2.0130091689999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:59:45.952397  1656 connection.cc:256] RPC call timeout handler was delayed by -2.0130091689999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 12:59:45.951864  4767 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:45.952694  1656 connection.cc:256] RPC call timeout handler was delayed by -1.9833091689999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 12:59:45.952999  1656 connection.cc:256] RPC call timeout handler was delayed by -1.9473091689999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:59:45.953260  1656 connection.cc:256] RPC call timeout handler was delayed by -1.9257091690000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:59:45.953531  1656 connection.cc:256] RPC call timeout handler was delayed by -1.886109169000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:59:45.953787  1656 connection.cc:256] RPC call timeout handler was delayed by -1.8735091689999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:59:45.954049  1656 connection.cc:256] RPC call timeout handler was delayed by -1.8204091690000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 12:59:45.954306  1656 connection.cc:256] RPC call timeout handler was delayed by -1.7808091690000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 12:59:45.954579  1656 connection.cc:256] RPC call timeout handler was delayed by -1.7745091689999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:59:45.954871  1656 connection.cc:256] RPC call timeout handler was delayed by -1.7133091690000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 12:59:45.955144  1656 connection.cc:256] RPC call timeout handler was delayed by -1.6413091690000101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 12:59:45.955363  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1687) took 2721 ms. Trace:
I20260709 12:59:45.955802  1690 rpcz_store.cc:276] 0709 12:59:43.234166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.618578 (+384412us) service_pool.cc:224] Handling call
0709 12:59:43.630424 (+ 11846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.630854 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.630896 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.635346 (+  4450us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.865470 (+230124us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:43.865577 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.865727 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.604649 (+1738922us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:45.955089 (+350440us) raft_consensus.cc:1685] finished
0709 12:59:45.955111 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.955311 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9113,"raft.queue_time_us":237711,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13758,"spinlock_wait_cycles":13933440,"thread_start_us":184641,"threads_started":1,"wal-append.queue_time_us":1076920}
I20260709 12:59:45.677387  4702 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.957836  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 484) took 1151 ms. Trace:
I20260709 12:59:45.958236  2308 rpcz_store.cc:276] 0709 12:59:44.806580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.814248 (+  7668us) service_pool.cc:224] Handling call
0709 12:59:44.814542 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.676037 (+861495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.957624 (+281587us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54004bc154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:45.957782 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979456256}
I20260709 12:59:45.959885  4688 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:59:45.860348  4906 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:59:45.729213  4799 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:59:45.938808  4895 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.744738  4812 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.938511  4746 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:45.476649  4885 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.288s
I20260709 12:59:45.805825  4874 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:45.942065  4827 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:45.805596  4863 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:45.894276  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 159452us
W20260709 12:59:45.860383  4908 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:59:45.903971  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 214263us
I20260709 12:59:45.963904  4566 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:45.685251  4889 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:45.898919  2310 rpcz_store.cc:276] 0709 12:59:43.774403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.792916 (+ 18513us) service_pool.cc:224] Handling call
0709 12:59:43.793317 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.793699 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.793726 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.812637 (+ 18911us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.224276 (+411639us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b1800454240. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 12:59:44.846782 (+622506us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:44.965529 (+118747us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.981950 (+ 16421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.982055 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.895681 (+913626us) raft_consensus.cc:1685] finished
0709 12:59:45.898284 (+  2603us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.898424 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28130,"prepare.queue_time_us":69462,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":37415,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":24842,"spinlock_wait_cycles":2305280,"thread_start_us":622197,"threads_started":1,"wal-append.queue_time_us":1533731}
I20260709 12:59:45.927124  4393 raft_consensus.cc:2764] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:46.006980  4846 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.987498  4680 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:59:46.012723  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.013293  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 446) took 1364 ms. Trace:
I20260709 12:59:46.013532  2309 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:45.933250  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2225) took 3299 ms. Trace:
I20260709 12:59:46.014127  4566 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:45.901999  4841 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:45.939218  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1704) took 1093 ms. Trace:
I20260709 12:59:46.015040  1684 rpcz_store.cc:276] 0709 12:59:44.838156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.928383 (+ 90227us) service_pool.cc:224] Handling call
0709 12:59:45.931672 (+1003289us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400255b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:45.931806 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1014468480}
I20260709 12:59:45.908896  4783 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:46.016108  4864 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.211s	user 0.000s	sys 0.012s
I20260709 12:59:46.018009  4889 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.018707  4889 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.018736  4743 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.941046  1533 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:46.021346  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:45.904953  4821 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.024552  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.025772  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.026494  1685 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:45.904953  4816 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.013671  1681 rpcz_store.cc:276] 0709 12:59:44.648528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.648667 (+   139us) service_pool.cc:224] Handling call
0709 12:59:44.718130 (+ 69463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.724249 (+  6119us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:44.844086 (+119837us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.144106 (+300020us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.335006 (+190900us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.335328 (+   322us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:45.335442 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.335591 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.858769 (+523178us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:46.013021 (+154252us) raft_consensus.cc:1685] finished
0709 12:59:46.013118 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.013240 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81411,"prepare.queue_time_us":24905,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":6053,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":103460,"spinlock_wait_cycles":228593408,"thread_start_us":277290,"threads_started":2,"wal-append.queue_time_us":732060}
I20260709 12:59:46.028023  4816 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:45.960322  4702 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.960500  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 406) took 1309 ms. Trace:
I20260709 12:59:46.029850  1607 rpcz_store.cc:276] 0709 12:59:44.650634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.650752 (+   118us) service_pool.cc:224] Handling call
0709 12:59:44.764429 (+113677us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:44.773252 (+  8823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.773295 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:44.779266 (+  5971us) log.cc:844] Serialized 52 byte log entry
0709 12:59:45.162610 (+383344us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:45.162675 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.162786 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.960299 (+797513us) raft_consensus.cc:1685] finished
0709 12:59:45.960319 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.960445 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474609,"raft.queue_time_us":73610,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4002,"thread_start_us":237272,"threads_started":1,"wal-append.queue_time_us":1004032}
I20260709 12:59:45.963346  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46804 (request call id 75) took 1464 ms. Trace:
W20260709 12:59:45.955394  1656 connection.cc:256] RPC call timeout handler was delayed by -1.533309169000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 12:59:45.966532  4879 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.942s	user 0.007s	sys 0.002s
W20260709 12:59:45.967707  4903 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:59:45.968750  4904 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
I20260709 12:59:45.929497  4877 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:45.969480  4612 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.970818  4718 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:45.969506  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 443) took 1639 ms. Trace:
I20260709 12:59:45.744524  4878 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:45.980623  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.985363  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:45.930296  4833 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:45.731494  4745 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.934846  4777 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:45.725831  4716 consensus_meta.cc:287] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.996s	user 0.011s	sys 0.000s
I20260709 12:59:45.999128  2304 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.002095  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:46.073740  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 71726.5us
I20260709 12:59:46.074644  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:45.909211  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 218799us
I20260709 12:59:46.002629  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:45.984068  4688 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:46.005403  1540 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:46.006906  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1593) took 1279 ms. Trace:
I20260709 12:59:45.941298  4847 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.007630  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:46.014276  1614 rpcz_store.cc:276] 0709 12:59:42.633812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.270020 (+636208us) service_pool.cc:224] Handling call
0709 12:59:43.270441 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.676805 (+2406364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.933014 (+256209us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54003d72d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:45.933193 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5055177984}
I20260709 12:59:46.076756  2308 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 12:59:46.031874  1608 rpcz_store.cc:276] 0709 12:59:44.498514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.498668 (+   154us) service_pool.cc:224] Handling call
0709 12:59:45.963079 (+1464411us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001b5b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c51735 00007f8d58c499fa 00007f8d5dc114c9 00007f8d5718dc54 00007f8d5718dbe2 00007f8d5718db11 00007f8d5718da8c 00007f8d5718cd42 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:45.963267 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033757952}
W20260709 12:59:46.037516  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.089957  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 82402.3us
I20260709 12:59:46.049424  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.090606  1539 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.090644  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:46.091207  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.050284  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.091568  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.091912  1538 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:46.092384  1609 raft_consensus.cc:2368] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:46.051685  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.053462  1537 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.054718  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.093559  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.093964  1536 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:46.056025  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.095191  1541 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
W20260709 12:59:46.095404  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 196041us
I20260709 12:59:45.988517  4826 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:59:46.063755  1689 rpcz_store.cc:276] 0709 12:59:44.330502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.330605 (+   103us) service_pool.cc:224] Handling call
0709 12:59:44.330929 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.622079 (+1291150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.969299 (+347220us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400393854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:45.969452 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559101696}
I20260709 12:59:46.065917  1532 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.069406  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.096624  1535 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
W20260709 12:59:46.070991  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 85710.7us
I20260709 12:59:45.993921  4895 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:46.062212  4906 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:46.110134  4688 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:46.069226  4900 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.816s	user 0.000s	sys 0.005s
I20260709 12:59:46.111359  4688 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.112586  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 771) took 1854 ms. Trace:
I20260709 12:59:46.113441  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:46.112977  2302 rpcz_store.cc:276] 0709 12:59:44.257907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.262292 (+  4385us) service_pool.cc:224] Handling call
0709 12:59:44.288420 (+ 26128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.288859 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:44.724874 (+436015us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.384729 (+659855us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.441539 (+ 56810us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.441942 (+   403us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:45.442027 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.442141 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.859451 (+417310us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:46.112274 (+252823us) raft_consensus.cc:1685] finished
0709 12:59:46.112383 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.112529 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96473,"prepare.queue_time_us":515758,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":98715,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":94887,"spinlock_wait_cycles":220351872,"thread_start_us":840365,"threads_started":2,"wal-append.queue_time_us":776832}
I20260709 12:59:46.115182  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1697) took 1463 ms. Trace:
I20260709 12:59:46.115692  1539 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:46.116497  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:46.115533  1686 rpcz_store.cc:276] 0709 12:59:44.651406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.651564 (+   158us) service_pool.cc:224] Handling call
0709 12:59:44.651916 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.652389 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:44.730139 (+ 77750us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.808019 (+ 77880us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b180040b5e0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a 00007f8d58c55a2a
0709 12:59:44.835687 (+ 27668us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.839147 (+  3460us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.839585 (+   438us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.839693 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.839755 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.023826 (+1184071us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:46.114994 (+ 91168us) raft_consensus.cc:1685] finished
0709 12:59:46.115014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.115129 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224,"prepare.queue_time_us":77718,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3081,"raft.queue_time_us":2388,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":52785,"spinlock_wait_cycles":53380352,"thread_start_us":26833,"threads_started":1,"wal-append.queue_time_us":321034}
I20260709 12:59:46.118250  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 340) took 2932 ms. Trace:
I20260709 12:59:46.118640  1533 rpcz_store.cc:276] 0709 12:59:43.185698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.709063 (+523365us) service_pool.cc:224] Handling call
0709 12:59:43.722193 (+ 13130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.020417 (+2298224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.118023 (+ 97606us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54004358d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:46.118190 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5102936448}
I20260709 12:59:46.119740  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.069063  4877 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.076766  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:46.032241  1656 connection.cc:256] RPC call timeout handler was delayed by -1.5198091689999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 12:59:46.068892  4878 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.098819  1614 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 12:59:46.096021  1506 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.765s (SENT)
I20260709 12:59:46.093201  1534 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:46.097820  1653 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:46.071805  4745 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.104370  4393 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.104740  4847 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.104878  4914 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.105288  4846 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:46.106223  4680 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:46.132871  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.096308  4874 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:46.120991  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1583) took 2464 ms. Trace:
W20260709 12:59:46.121033  1656 connection.cc:256] RPC call timeout handler was delayed by -1.4487091689999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 12:59:46.150017  1656 connection.cc:256] RPC call timeout handler was delayed by -1.380309168999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23140000000000002s for a response
W20260709 12:59:46.150621  1656 connection.cc:256] RPC call timeout handler was delayed by -1.3164091689999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2385s for a response
W20260709 12:59:46.150964  1656 connection.cc:256] RPC call timeout handler was delayed by -1.3146091689999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23870000000000002s for a response
W20260709 12:59:46.151248  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2840091690000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24209999999999998s for a response
W20260709 12:59:46.151564  1656 connection.cc:256] RPC call timeout handler was delayed by -1.1427091689999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2578s for a response
I20260709 12:59:46.151360  4914 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:46.121147  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 44504.1us
I20260709 12:59:46.153126  4561 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:46.153453  4914 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.128039  4895 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:46.155189  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.154911  4561 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:46.135370  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.076130  4841 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.137734  1611 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:46.089321  1613 rpcz_store.cc:276] 0709 12:59:44.727285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.768086 (+ 40801us) service_pool.cc:224] Handling call
0709 12:59:44.784536 (+ 16450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.822580 (+ 38044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.822610 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.829943 (+  7333us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.678314 (+848371us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:45.678348 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.678406 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.006721 (+328315us) raft_consensus.cc:1685] finished
0709 12:59:46.006739 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.006850 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":481018,"raft.queue_time_us":58712,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":4537,"spinlock_wait_cycles":177920,"thread_start_us":823326,"threads_started":1,"wal-append.queue_time_us":831883}
I20260709 12:59:46.159263  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.140805  2309 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:46.159629  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.141839  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.089323  4879 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.143110  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.120859  4799 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:46.126106  4821 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.150076  1682 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.166096  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.167452  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.128187  4833 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:59:46.132570  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:46.135720  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 49658.2us
I20260709 12:59:46.124539  4866 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.121167  4089 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:46.088510  4716 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:46.158041  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.159953  2308 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:46.172147  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.160208  1681 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.159734  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.172412  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.141018  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.173180  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.173919  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.159353  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.174263  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.174423  2302 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.174738  1685 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.163192  1608 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 12:59:46.176131  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:46.159240  1426 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ff79ac342d91424db634ca7802846535 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:46.163542  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.177189  2304 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.122175  4612 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:46.157491  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.149031  4874 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:46.171087  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 75101.4us
I20260709 12:59:46.174417  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.162101  4590 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:46.139746  4886 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:59:46.149782  4892 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:46.177110  1690 raft_consensus.cc:2393] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:46.127601  4812 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:46.170691  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:46.234562  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 63951.4us
I20260709 12:59:46.235196  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:46.235944  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.236299  4821 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.181272  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.236536  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.237460  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.237646  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:46.238083  4716 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.238500  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.238696  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.239305  1609 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:46.239496  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.239643  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.151383  4813 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.240106  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:46.169734  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:46.212795  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.213927  1615 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:46.149087  1612 rpcz_store.cc:276] 0709 12:59:43.657048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.657376 (+   328us) service_pool.cc:224] Handling call
0709 12:59:43.710309 (+ 52933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.727986 (+2017677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.120782 (+392796us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400178ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:46.120939 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4519275392}
I20260709 12:59:46.120886  4877 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.214617  4696 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.247071  4696 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.240185  1682 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:46.221571  1688 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:46.241227  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 71583.5us
I20260709 12:59:46.217000  1653 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:46.249155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.249696  1688 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:46.250408  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.251016  1688 raft_consensus.cc:2368] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:46.241626  1614 raft_consensus.cc:2393] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:46.164368  4680 consensus_queue.cc:1243] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:46.120196  4783 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.255234  4878 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.255965  4799 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:46.256626  4783 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.179731  4895 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.169399  4858 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.257419  4858 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.240681  4826 raft_consensus.cc:2764] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:46.241983  4224 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:46.259827  4858 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.178578  4814 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.217343  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.260619  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.261209  4698 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:46.261719  4561 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:46.262123  4561 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.178956  4846 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.262467  4561 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.262724  4878 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.263188  4846 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.228503  4886 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:46.251147  2302 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:46.264384  4886 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:46.228966  4823 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.207897  4867 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.169953  4860 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.207849  4841 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:46.232381  4892 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.267954  4892 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.233533  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.221647  1686 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:46.236472  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:46.223182  1506 leader_election.cc:336] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.980s (SENT)
I20260709 12:59:46.270838  1611 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:46.271226  1685 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:46.271312  1687 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:46.271484  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 54566.4us
I20260709 12:59:46.250969  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.215970  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:46.271291  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 48161.3us
I20260709 12:59:46.272259  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.272545  1684 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:46.254972  1681 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:46.214288  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.252513  1613 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:46.219931  1689 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 5: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:46.272660  1506 leader_election.cc:336] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.030s (SENT)
W20260709 12:59:46.220682  1426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61499us
I20260709 12:59:46.217959  4885 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:59:46.214866  4874 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.274854  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.267782  4860 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.267798  4841 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:46.217689  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.294211  4841 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.294557  1616 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:46.274407  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.296669  4879 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:46.297526  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.219892  2304 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:46.232091  2308 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:46.276837  1506 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.032s (SENT)
I20260709 12:59:46.216519  4612 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:46.255163  4834 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:46.278450  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.278817  4746 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.279724  4745 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.280658  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.259845  4224 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.260648  4777 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.311306  4696 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.312506  4612 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.303671  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.283499  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.284142  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.284713  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.320075  1684 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:59:46.285996  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:46.321120  1611 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:46.218525  4590 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.324487  4795 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.324512  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.324908  4590 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.325999  1682 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:46.326236  4590 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.326898  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.327306  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.327492  1682 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.242651  4909 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.215885  4862 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.328646  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.329331  1689 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:46.299973  1612 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:46.330185  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.305891  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.307178  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.306298  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.308508  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.332249  1541 raft_consensus.cc:2410] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:46.301282  4889 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.301157  4813 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.318625  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.319977  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.334389  1535 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.285352  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:46.335587  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:46.335350  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 58539.3us
W20260709 12:59:46.337033  1506 leader_election.cc:336] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.078s (SENT)
I20260709 12:59:46.282618  4860 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.309360  4885 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:46.297174  4879 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.297901  4867 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:46.328701  4862 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.303799  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 413) took 1337 ms. Trace:
W20260709 12:59:46.308004  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 93804.8us
I20260709 12:59:46.399698  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.399325  1610 rpcz_store.cc:276] 0709 12:59:44.966297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.455587 (+489290us) service_pool.cc:224] Handling call
0709 12:59:45.455967 (+   380us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:59:45.647597 (+191630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.647625 (+    28us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:59:45.668724 (+ 21099us) log.cc:844] Serialized 104 byte log entry
0709 12:59:46.001314 (+332590us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:46.273277 (+271963us) log.cc:844] Serialized 14 byte log entry
0709 12:59:46.303402 (+ 30125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.303488 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.303597 (+   109us) raft_consensus.cc:1685] finished
0709 12:59:46.303607 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.303749 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225965,"prepare.queue_time_us":308936,"raft.queue_time_us":221789,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":18468,"spinlock_wait_cycles":23055744,"thread_start_us":481204,"threads_started":2,"wal-append.queue_time_us":372897}
I20260709 12:59:46.342603  1687 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:46.304024  4847 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:46.346470  1689 raft_consensus.cc:2393] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:46.347158  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 236277us
I20260709 12:59:46.360591  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.402586  1540 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.363353  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.403053  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.404057  1539 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:46.366256  1537 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:46.370462  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.402908  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.405965  1534 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.406322  1538 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:46.381795  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.382854  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.385365  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.407501  1681 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 4: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:46.407543  1541 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.393112  1535 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:46.395408  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.402806  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.409757  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.410142  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.411334  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.411747  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.396257  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.397750  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.401579  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.412598  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:46.413106  1533 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.416456  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.426000  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.381191  4696 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.432169  1682 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:46.432484  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:46.434880  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 198989us
I20260709 12:59:46.443181  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.451035  1533 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:46.454022  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.457808  4393 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.438197  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.459652  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.460194  1685 raft_consensus.cc:2410] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:46.409193  4878 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:46.468614  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.469234  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.396906  4860 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:46.471141  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.467130  1540 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:46.472311  1690 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 12:59:46.473172  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47251.9us
I20260709 12:59:46.299301  4892 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.416967  4867 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:46.395732  4895 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:59:46.402662  4812 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:59:46.468504  4909 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:46.436199  4783 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.515637  1582 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.470041  4819 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.437098  4847 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:46.530881  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.517952  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:46.471871  4795 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:46.484375  4496 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:46.484596  4476 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:46.544691  1582 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:46.549127  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 137863us
I20260709 12:59:46.475332  4814 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:46.555645  1688 raft_consensus.cc:2368] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12.
I20260709 12:59:46.575639  1507 leader_election.cc:400] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:46.575971  1507 leader_election.cc:403] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:46.483450  4889 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:46.514889  4804 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:46.475860  4878 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:46.566187  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.581096  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.581573  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.587800  2305 raft_consensus.cc:2410] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:59:46.585305  1540 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:46.571334  4688 raft_consensus.cc:2764] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:46.588258  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.588647  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.589274  2305 raft_consensus.cc:2368] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:46.589442  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.519217  4866 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:59:46.585880  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.540058  4911 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:46.593992  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.591638  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:46.594566  1540 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.592542  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.590159  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.594846  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.518064  4860 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.595438  2310 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:46.555899  4881 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:46.560129  4909 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:46.558547  4795 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:46.572300  4814 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:46.609134  1540 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:46.610092  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.599539  1507 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.567793  4476 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:46.590672  4878 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:46.605031  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.526903  4915 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:59:46.606140  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.617856  1533 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:46.607609  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.618407  2307 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:46.618914  2310 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:46.610656  1540 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:46.606813  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.585753  4819 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:46.612286  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.526618  4910 consensus_queue.cc:1059] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:59:46.613895  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 326352us
I20260709 12:59:46.586427  4496 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.615298  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.596560  4889 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:46.623189  1684 raft_consensus.cc:2410] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:59:46.623217  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 190816us
I20260709 12:59:46.609167  4795 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.593765  4804 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:46.630836  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:46.641836  4826 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:46.543740  4879 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.653920  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:46.590437  4917 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:46.573431  4874 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.657869  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:46.658365  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.763319  1533 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
W20260709 12:59:46.763701  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 105424us
I20260709 12:59:46.613195  4814 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.622998  4819 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.764524  4819 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:46.764600  4874 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.765224  4393 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:46.765748  4393 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:46.766579  4393 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:46.655846  4913 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:46.605470  4911 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.768428  4882 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.769760  1656 leader_election.cc:400] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:46.770061  4911 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:46.624737  4895 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:46.762018  4826 consensus_queue.cc:1243] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:46.770713  4895 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:46.771056  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.771688  4895 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.771792  4804 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.772375  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:46.772483  4819 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.774252  4833 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:46.656177  4886 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:46.708885  4924 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:59:46.709579  4932 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:46.710448  1611 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:46.592820  4877 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:59:46.710296  4841 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.710909  4934 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:46.592466  4858 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:59:46.572616  4224 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.710851  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:46.713748  4862 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.713850  4718 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.712159  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:46.714414  4812 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:46.714633  4561 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.841218  2307 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:46.713773  4910 consensus_queue.cc:1243] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:46.715579  4860 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:46.715449  4476 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.660817  4745 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.717730  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.721730  4698 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:46.726945  4927 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:59:46.668676  4496 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:46.657598  4867 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.665230  4889 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.712097  4892 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:46.700915  4847 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:46.731859  1506 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.744s (SENT)
I20260709 12:59:46.809551  4934 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:46.865097  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:46.866268  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 134455us
I20260709 12:59:46.733613  4863 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.735498  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.703019  4909 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:46.721807  4920 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:46.739173  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.751682  1534 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
W20260709 12:59:46.759565  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 105721us
W20260709 12:59:46.777222  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 177756us
I20260709 12:59:46.784049  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:46.820626  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:46.879288  1685 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:46.879596  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 95638.3us
I20260709 12:59:46.880510  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:46.817230  4819 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.841336  4812 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:46.808346  4932 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.853046  2310 raft_consensus.cc:2410] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:59:46.808120  4833 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:46.855872  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:46.861423  1615 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:46.863708  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:46.869515  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 134096us
I20260709 12:59:46.803618  4911 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:59:46.841895  4886 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.838045  4816 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:46.883797  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:46.989679  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.809019  4767 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:46.987288  1685 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:46.914055  4612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.006s	sys 0.006s
W20260709 12:59:47.001871  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 123463us
W20260709 12:59:47.050221  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 48731.1us
I20260709 12:59:47.052502  1687 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
W20260709 12:59:46.925539  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.896217  1506 leader_election.cc:336] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.806s (SENT)
I20260709 12:59:47.053855  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:47.048147  2307 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:47.001362  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:47.048945  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:47.055801  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 172086us
I20260709 12:59:47.072494  4874 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.059888  4696 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:47.073125  4874 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:47.073587  4938 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:59:47.075301  4841 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:47.075387  4874 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:47.000294  4942 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:47.072048  4767 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:47.078172  4767 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:47.078591  4767 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:47.081261  2302 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.000487  4860 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.001322  4882 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.073444  4696 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:47.083551  4696 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:47.058378  4612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.010s	sys 0.011s
I20260709 12:59:47.081815  4860 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:47.084488  4696 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:47.085300  4860 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.085889  4696 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.086449  4767 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:47.000716  4932 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:47.090446  1689 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:47.078503  2301 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:47.093227  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:47.093326  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:47.094686  2310 raft_consensus.cc:2393] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 12:59:47.095350  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 199182us
W20260709 12:59:47.095922  1506 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.576s (SENT)
I20260709 12:59:47.096308  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:47.062148  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.116878  4833 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:47.124917  4860 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:47.125327  4934 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:47.126377  1685 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.126739  4934 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.129786  4561 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:47.142701  4860 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:46.873697  4910 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.864567  4698 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:47.189738  1686 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.006s	sys 0.027s
W20260709 12:59:47.191148  1686 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.006s	sys 0.027s
I20260709 12:59:47.057964  4892 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:47.194948  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.004s	sys 0.024s
W20260709 12:59:47.228921  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.005s	sys 0.024s
I20260709 12:59:47.221953  4846 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:47.229759  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.025s	sys 0.149s
I20260709 12:59:47.170699  4702 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:47.175312  4895 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:47.178900  4885 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:47.194249  4783 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:47.171504  4874 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:59:47.180347  4814 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:47.235847  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.025s	sys 0.149s
I20260709 12:59:47.265734  4702 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:47.490094  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.238780  4911 consensus_queue.cc:1059] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:59:47.331777  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.052s	sys 0.082s
W20260709 12:59:47.493053  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.052s	sys 0.083s
W20260709 12:59:47.352789  2275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.023s	sys 0.015s
W20260709 12:59:47.493884  2275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.023s	sys 0.016s
I20260709 12:59:47.429309  4590 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:47.453171  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.237959  4860 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:59:47.507159  1687 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:47.245692  4846 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:47.523185  4949 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
W20260709 12:59:47.523770  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 427871us
W20260709 12:59:47.523914  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 917183us
I20260709 12:59:47.524185  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:47.524462  1506 leader_election.cc:336] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.641s (SENT)
I20260709 12:59:47.524883  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:47.525745  1504 leader_election.cc:400] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
W20260709 12:59:47.523783  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 430642us
I20260709 12:59:47.536727  4743 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.526168  1504 leader_election.cc:403] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:47.555249  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:47.284473  4783 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:47.284091  4812 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:47.559027  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:47.558766  1506 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.644s (SENT)
I20260709 12:59:47.562541  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:47.558023  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:47.566666  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:47.559533  4858 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:47.561105  4863 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.512004  4590 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:47.590687  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 494) took 1288 ms. Trace:
I20260709 12:59:47.595897  2308 rpcz_store.cc:276] 0709 12:59:46.301837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.301945 (+   108us) service_pool.cc:224] Handling call
0709 12:59:46.302216 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.306914 (+  4698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.306944 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.307345 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.669239 (+361894us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18003a0540. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 12:59:46.839746 (+170507us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:46.839786 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.840500 (+   714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.572422 (+731922us) raft_consensus.cc:1685] finished
0709 12:59:47.572445 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.590604 (+ 18159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4292,"raft.queue_time_us":4396,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":1623,"spinlock_wait_cycles":5260672,"thread_start_us":127257,"threads_started":1,"wal-append.queue_time_us":947963}
W20260709 12:59:47.584864  4827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.022s	sys 0.014s
I20260709 12:59:47.565547  4874 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:47.602921  4827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.022s	sys 0.014s
W20260709 12:59:47.600594  4878 consensus_meta.cc:287] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.000s
I20260709 12:59:47.599841  4858 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:47.604633  4895 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.610517  4885 raft_consensus.cc:3055] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:47.652586  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 94639us
I20260709 12:59:47.572973  4702 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:47.673808  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 107218us
I20260709 12:59:47.675945  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:47.631078  4945 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:47.655524  4911 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:47.689435  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 130713us
I20260709 12:59:47.614352  4874 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:47.691624  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 456) took 1418 ms. Trace:
I20260709 12:59:47.651885  4885 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:47.650628  4698 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:47.641685  4878 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:47.752363  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1730) took 1375 ms. Trace:
I20260709 12:59:47.690267  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:48.050072  1506 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.867s (SENT)
I20260709 12:59:48.051123  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:48.051232  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 360938us
W20260709 12:59:48.057355  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.837533  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 418) took 1552 ms (client timeout 1852 ms). Trace:
I20260709 12:59:48.050411  1539 rpcz_store.cc:276] 0709 12:59:46.377100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.404617 (+ 27517us) service_pool.cc:224] Handling call
0709 12:59:46.404874 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.410025 (+  5151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.410054 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.744484 (+334430us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b1800406f00. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b2c2a6 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a
0709 12:59:46.745174 (+   690us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b2c00000658. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 12:59:46.745630 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.177520 (+431890us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.237890 (+ 60370us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.246182 (+  8292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.246265 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.752072 (+505807us) raft_consensus.cc:1685] finished
0709 12:59:47.752096 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.752291 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26201,"prepare.queue_time_us":60230,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":13456,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":38652,"spinlock_wait_cycles":10139264,"thread_start_us":431535,"threads_started":1,"wal-append.queue_time_us":947481}
W20260709 12:59:48.060038  1608 rpcz_store.cc:269] 0709 12:59:46.285091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.285770 (+   679us) service_pool.cc:224] Handling call
0709 12:59:47.825234 (+1539464us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54001b1a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:47.837443 (+ 12209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103795456}
W20260709 12:59:47.925030  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 223310us
I20260709 12:59:47.908671  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:48.063582  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:48.066313  1684 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:59:47.844365  1610 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:59:48.068367  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 419) took 1416 ms. Trace:
I20260709 12:59:48.068883  1610 rpcz_store.cc:276] 0709 12:59:46.652267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.654510 (+  2243us) service_pool.cc:224] Handling call
0709 12:59:46.654914 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.844079 (+1189165us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540027cca0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc2dc0 00007f8d58c4d1c0 00007f8d58c4e231 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c
0709 12:59:48.067576 (+223497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.068067 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425127808}
I20260709 12:59:48.068789  1686 rpcz_store.cc:276] 0709 12:59:46.272952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.597369 (+324417us) service_pool.cc:224] Handling call
0709 12:59:46.597619 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.597804 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:47.192315 (+594511us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.691078 (+498763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.691174 (+    96us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:47.691242 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.691353 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.691539 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111917,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":76636,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":1092503,"threads_started":2,"wal-append.queue_time_us":599727}
I20260709 12:59:48.070969  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:48.073665  1506 connection.cc:256] RPC call timeout handler was delayed by -1.2730464359999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3093s for a response
I20260709 12:59:47.845036  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 460) took 1126 ms. Trace:
W20260709 12:59:48.074208  1506 connection.cc:256] RPC call timeout handler was delayed by -1.2388464359999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3131s for a response
I20260709 12:59:48.074847  1537 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:48.074537  1685 rpcz_store.cc:276] 0709 12:59:46.718223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.098530 (+380307us) service_pool.cc:224] Handling call
0709 12:59:47.098795 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.126996 (+ 28201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.844785 (+717789us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400198a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:47.844973 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62953856}
I20260709 12:59:48.077019  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.078022  1534 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:48.074882  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1740047449999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:59:48.080705  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1632464359999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3215s for a response
I20260709 12:59:48.080883  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:48.081359  1506 leader_election.cc:336] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.665s (SENT)
W20260709 12:59:48.083168  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1009495730000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24080000000000001s for a response
W20260709 12:59:48.083781  1506 leader_election.cc:336] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.495s (SENT)
I20260709 12:59:48.083664  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.085163  1537 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 5: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:48.085548  1506 leader_election.cc:336] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.922s (SENT)
I20260709 12:59:48.086012  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.095206  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.096318  1537 raft_consensus.cc:2368] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 12:59:48.097659  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.103073  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.099984  1582 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:47.922542  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 119173us
I20260709 12:59:48.115062  4867 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:48.115657  4867 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:47.756596  4696 consensus_meta.cc:287] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
I20260709 12:59:47.924293  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:47.939126  4832 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.753530  4746 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:47.889081  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:47.727103  4909 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.117820  2301 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:48.116189  4867 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:47.963197  4961 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 12:59:48.132470  4834 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:48.156445  4834 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:47.763327  4962 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.159574  1426 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ff79ac342d91424db634ca7802846535 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:48.160703  1682 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:48.158406  4834 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.161954  4696 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:48.162684  4834 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:47.934265  4960 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 12:59:48.163638  4696 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:48.165099  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.165936  4915 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.166843  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.166759  4915 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.168613  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.168864  4914 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:48.118846  4832 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.169623  4914 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.119858  4746 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.172497  4966 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:48.173069  4966 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:48.173244  4847 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.174219  4847 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.174716  1686 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:48.174497  4966 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.176556  4878 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:47.762820  4968 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.371s
W20260709 12:59:47.843313  4934 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.004s
I20260709 12:59:48.178346  4826 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:47.690639  4950 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:48.179672  4826 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:59:47.813495  4932 consensus_meta.cc:287] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.725s	user 0.005s	sys 0.004s
I20260709 12:59:48.159329  4962 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.181304  4932 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.183176  4962 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.184218  4874 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.184460  4698 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.185325  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 363) took 1579 ms. Trace:
I20260709 12:59:48.185261  4698 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.185956  1538 rpcz_store.cc:276] 0709 12:59:46.606067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.606555 (+   488us) service_pool.cc:224] Handling call
0709 12:59:46.614208 (+  7653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.876429 (+262221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.876472 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.011294 (+134822us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.577962 (+566668us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:47.622785 (+ 44823us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.623083 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.623184 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.962411 (+339227us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:48.184714 (+222303us) raft_consensus.cc:1685] finished
0709 12:59:48.184860 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.185094 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35578,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":6944,"raft.queue_time_us":115619,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":70239360,"thread_start_us":666006,"threads_started":2,"wal-append.queue_time_us":613013}
I20260709 12:59:48.188191  4698 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.172565  4746 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.183874  4826 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:48.138193  4885 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.214934  1683 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:59:47.800138  4795 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.083s	user 0.007s	sys 0.001s
I20260709 12:59:48.216946  4795 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.176136  4966 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.219916  2309 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:47.979720  4767 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:47.765996  4946 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:59:47.766925  4959 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:59:47.915038  4955 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.145s	user 0.001s	sys 0.001s
W20260709 12:59:47.763715  4943 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:59:47.767819  4957 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:59:48.143451  4858 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:48.229218  4858 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.230664  4476 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:48.236757  4958 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.474s	user 0.004s	sys 0.000s
W20260709 12:59:47.883283  4933 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 1.175s	user 0.030s	sys 0.049s
I20260709 12:59:47.752859  4814 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.145902  4743 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:48.239614  4743 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.241966  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:48.243371  4743 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.146400  4895 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.147435  1582 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:48.245957  4699 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.246603  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 99579us
I20260709 12:59:48.246767  4699 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:47.796726  4937 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.069s	user 0.014s	sys 0.006s
I20260709 12:59:48.148885  4496 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:47.820040  4882 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.330s
I20260709 12:59:48.139374  4702 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:48.150322  4862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.000s	sys 0.011s
I20260709 12:59:47.973757  4863 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7.
I20260709 12:59:47.690255  4783 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:47.814534  4718 consensus_meta.cc:287] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.976s	user 0.005s	sys 0.006s
I20260709 12:59:48.152535  4866 raft_consensus.cc:2764] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:47.812548  4846 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:47.934239  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.153927  4680 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.768216  4965 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:48.293258  4680 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.293825  4965 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:48.294988  4965 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.295828  4680 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:47.769065  4590 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.155072  4688 consensus_queue.cc:1059] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:48.176936  4847 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.297061  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:47.765172  4947 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 12:59:47.970979  4910 consensus_meta.cc:287] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.791s	user 0.009s	sys 0.001s
I20260709 12:59:48.173228  4909 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.322801  4910 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.138434  4877 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:48.195755  4915 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.148648  4911 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:48.325783  4911 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.200940  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:48.206197  4612 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:48.207201  4874 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:48.327109  1689 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:48.327231  2302 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:48.327600  4874 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.328004  4909 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.328267  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:48.328960  1689 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
I20260709 12:59:48.329916  4874 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:48.185146  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 417) took 1900 ms (client timeout 1949 ms). Trace:
W20260709 12:59:48.330603  1615 rpcz_store.cc:269] 0709 12:59:46.284814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.285141 (+   327us) service_pool.cc:224] Handling call
0709 12:59:48.184753 (+1899612us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54001793d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:48.184926 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105956608}
I20260709 12:59:48.331020  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.205313  4746 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:47.691296  4860 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.332779  4860 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:48.215838  4885 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.265349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.277923  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.249745  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1720) took 2008 ms. Trace:
I20260709 12:59:48.249691  4699 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.232088  4858 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.283447  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.283667  4743 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:48.285872  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 457) took 1568 ms (client timeout 1925 ms). Trace:
I20260709 12:59:48.286705  4942 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.287187  4799 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.286706  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.296020  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.249825  4745 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:48.304426  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.180068  4950 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:48.306558  1534 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:48.297945  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.298804  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.313589  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:48.197435  4934 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.332621  4746 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:48.279006  4862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.000s	sys 0.011s
I20260709 12:59:48.329998  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:48.315855  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:48.298525  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.327253  4612 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.338925  1610 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.299619  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.340123  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:48.340577  4943 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:59:48.341315  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.333410  4860 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.297055  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.347625  1684 raft_consensus.cc:2393] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:48.326433  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.334106  1681 rpcz_store.cc:276] 0709 12:59:46.241206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.476399 (+235193us) service_pool.cc:224] Handling call
0709 12:59:46.525522 (+ 49123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.525730 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.525753 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.536170 (+ 10417us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.585257 (+ 49087us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:46.585287 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.585347 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.603131 (+1017784us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:48.249255 (+646124us) raft_consensus.cc:1685] finished
0709 12:59:48.249289 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.249542 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36166400,"thread_start_us":34692,"threads_started":1,"wal-append.queue_time_us":125557}
W20260709 12:59:48.343959  1688 rpcz_store.cc:269] 0709 12:59:46.717386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.717483 (+    97us) service_pool.cc:224] Handling call
0709 12:59:48.285458 (+1567975us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400393354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:48.285650 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013172096}
I20260709 12:59:48.341081  2305 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:48.357378  1538 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:48.348209  4877 raft_consensus.cc:697] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:48.343644  4914 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.370182  1535 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:48.345570  4795 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.391806  1537 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.391664  4882 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:59:48.392638  4846 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.393360  4846 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.395605  4846 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.391705  1533 raft_consensus.cc:2393] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:48.392201  4920 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.376904  1686 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:48.401854  1689 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:48.402295  1613 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:48.406468  1506 leader_election.cc:336] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.634s (SENT)
I20260709 12:59:48.407039  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.406684  4877 consensus_queue.cc:237] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.407835  4920 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.410249  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:48.400065  1504 leader_election.cc:336] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 2.078s (SENT)
I20260709 12:59:48.422808  1608 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:48.427932  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.404292  4680 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.426961  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:48.432185  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.425833  1683 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:48.426435  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 176832us
I20260709 12:59:48.402666  4745 raft_consensus.cc:697] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:48.433746  1607 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:48.433959  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:48.368847  4867 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:48.431638  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 50546.9us
I20260709 12:59:48.436061  4745 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.436892  4612 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.437222  1616 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:48.437674  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.432292  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.443641  1537 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:48.403651  4743 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.397857  4934 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.370904  4942 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.412497  4826 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.432155  4799 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.576215  1535 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
W20260709 12:59:48.464195  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.567055  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 118492us
I20260709 12:59:48.475795  1534 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.559151  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.593119  1537 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.444669  4847 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.583290  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 184317us
I20260709 12:59:48.457059  2307 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:48.441193  4950 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.466951  4798 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:48.587817  4934 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.465219  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1732) took 2084 ms. Trace:
W20260709 12:59:48.598614  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 119740us
W20260709 12:59:48.600138  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.623481  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.576577  1533 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 4.
W20260709 12:59:48.609338  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 230663us
I20260709 12:59:48.610553  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:48.610937  1506 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.634s (SENT)
I20260709 12:59:48.624938  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.610603  4942 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.472784  4746 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.609339  4823 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.611617  4847 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.455700  1681 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:48.626006  1538 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 12:59:48.466045  4867 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:48.630729  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.632017  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.466156  4932 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.458663  4881 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.588591  4914 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:48.455289  4680 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.597790  4862 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:48.662390  4862 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.620801  4895 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:48.664850  1540 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:48.666714  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.644802  4089 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.632694  1539 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:48.455515  4983 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.650362  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.621038  1532 rpcz_store.cc:276] 0709 12:59:46.380687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.404790 (+ 24103us) service_pool.cc:224] Handling call
0709 12:59:46.405034 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.583947 (+178913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.583989 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.584438 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.331353 (+746915us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.506253 (+174900us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.506460 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.506536 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.944168 (+437632us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b1800161c20. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:48.442681 (+498513us) raft_consensus.cc:1685] finished
0709 12:59:48.464840 (+ 22159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.465034 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17707,"prepare.queue_time_us":175120,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":111327,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":16430,"spinlock_wait_cycles":13169920,"thread_start_us":870693,"threads_started":2,"wal-append.queue_time_us":1039533}
I20260709 12:59:48.659303  4881 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.627534  4826 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:48.661787  4680 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.666831  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.469316  4819 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 2 to 8, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:48.676559  4783 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.677949  4847 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.678390  1541 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.613922  4798 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:48.678797  4862 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.675601  4878 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:48.677269  4974 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:48.680433  4813 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.680873  4911 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:48.681723  4833 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.681864  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.677131  4963 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:48.684898  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.675491  4965 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:48.685626  1534 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:48.691206  1537 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:48.691797  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.692545  1610 raft_consensus.cc:2410] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:48.696653  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1718) took 2454 ms. Trace:
I20260709 12:59:48.699846  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.717494  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.701597  1683 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:48.706570  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.698048  4950 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.712947  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.698391  1582 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:48.721913  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55352.4us
I20260709 12:59:48.719189  1682 rpcz_store.cc:276] 0709 12:59:46.240629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.438970 (+198341us) service_pool.cc:224] Handling call
0709 12:59:46.486144 (+ 47174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.161292 (+1675148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.670750 (+509458us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540035b454. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:48.694708 (+ 23958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3850180352}
I20260709 12:59:48.723891  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.729007  1535 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 12:59:48.725992  2276 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:48.701705  4823 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:48.733719  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 88639.8us
I20260709 12:59:48.717130  4963 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:48.736084  1533 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:59:48.738674  1506 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.828s (SENT)
I20260709 12:59:48.740554  4743 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.723781  4813 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.745074  4798 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.748865  1534 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:48.735522  4834 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:48.746857  1581 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:48.752710  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:48.746246  4798 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.756762  1540 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:59:48.719527  4783 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.727856  4698 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:59:48.761042  1541 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:48.757244  1540 pending_rounds.cc:85] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 6
I20260709 12:59:48.762137  4590 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.765014  4590 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:48.765383  4590 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.765528  1534 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:59:48.766737  1534 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.767971  1534 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:48.768550  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.769165  1534 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:59:48.769708  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.770407  1614 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:48.771191  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.771816  1614 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:48.730978  4965 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.773289  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.774451  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.775228  1608 raft_consensus.cc:2393] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:48.777567  4799 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.727938  4878 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.781852  1537 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:59:48.764305  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 79454.8us
I20260709 12:59:48.728121  4974 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.784998  4973 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.785805  4973 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.786216  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.786235  4973 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.786813  1615 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:48.787148  4974 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.789443  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.790133  1614 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:48.791100  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.785864  1579 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:48.791841  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:48.792897  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54218.9us
I20260709 12:59:48.793905  4834 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.794633  4783 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.795315  4881 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.796367  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.785318  1582 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:48.797051  1608 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 12:59:48.803908  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 94486.8us
I20260709 12:59:48.763962  1540 pending_rounds.cc:107] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:59:48.806253  1540 raft_consensus.cc:2889] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:48.819581  1615 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 12:59:48.821091  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.821338  1534 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:48.826099  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:48.829547  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 104134us
I20260709 12:59:48.831673  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.832518  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.834893  1582 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:48.842482  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.836758  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.835610  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:48.836194  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:48.844647  2306 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:48.832541  4799 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:48.849411  1608 raft_consensus.cc:2376] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6. Re-sending same reply.
I20260709 12:59:48.853935  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:48.855949  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 120001us
I20260709 12:59:48.857748  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.859892  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.862351  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.859848  1582 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:48.849391  4833 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.864611  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.865428  1608 raft_consensus.cc:2410] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:59:48.865546  2306 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:48.867057  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:48.867854  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 48045.7us
I20260709 12:59:48.825834  4974 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:48.854691  4878 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.870639  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:48.871858  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.835579  4860 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.866643  4879 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.855777  4813 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.792840  4963 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.884752  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.889880  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.868482  4799 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:48.892774  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.894418  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.881117  4879 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.881268  4881 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:48.891986  4998 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:59:48.883882  4965 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.901476  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:48.906481  1608 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:48.908331  4804 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:48.908921  1608 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:59:48.902885  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.903246  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:48.904163  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44449.2us
I20260709 12:59:48.910143  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:48.911356  4393 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.911754  4393 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:48.912159  4393 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.900102  4590 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.914136  4590 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.914836  1607 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:48.916595  4561 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:48.916774  4885 consensus_meta.cc:287] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.007s
I20260709 12:59:48.917196  4561 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:48.918144  1540 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:48.918531  4860 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.905417  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:48.918143  4561 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.920174  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.920622  4832 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.922629  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:48.923602  2301 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:59:48.915807  1506 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.594s (SENT)
I20260709 12:59:48.925055  4910 raft_consensus.cc:3055] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.924727  4799 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.925468  4910 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:48.925591  1506 leader_election.cc:336] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.836s (SENT)
I20260709 12:59:48.926005  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:48.908870  4804 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.889503  4972 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:48.931317  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:48.931679  1615 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:48.924734  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.929623  2306 raft_consensus.cc:2410] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:48.926391  4910 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:48.936691  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:48.933981  4885 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.937458  4847 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.937740  4885 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:48.938185  4885 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.938091  4847 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:48.901516  4879 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.940325  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:48.940562  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.941237  1541 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:48.936617  4965 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.931124  4804 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:48.936884  4860 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:48.944944  4860 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.945377  4860 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.945870  4914 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:59:48.931586  4972 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.948635  4972 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:48.948971  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.949599  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.952351  4847 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.898082  4823 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:48.937052  4826 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.937280  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.935644  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:48.957245  1536 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:48.915773  4874 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:48.903716  4881 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.960964  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.927177  4963 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.963796  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.953509  4973 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:48.973265  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.973996  2303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 462) took 2407 ms (client timeout 2078 ms). Trace:
W20260709 12:59:48.986198  2303 rpcz_store.cc:269] 0709 12:59:46.566373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.566490 (+   117us) service_pool.cc:224] Handling call
0709 12:59:48.973583 (+2407093us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54001fb8d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:48.973780 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173196672}
I20260709 12:59:48.964620  4847 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.987424  4847 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:48.987746  4973 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:48.987879  4847 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:48.989476  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54890.3us
I20260709 12:59:48.990229  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:48.991135  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:48.992002  4974 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.992399  4974 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.992470  4783 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:48.992888  4974 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.993073  4783 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:48.993628  4783 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:48.987860  4999 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 12:59:48.977712  4932 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:48.997400  4823 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.960546  4826 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.998163  4826 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.978706  2310 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:59:48.992488  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 89344.8us
I20260709 12:59:48.969424  4881 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.984477  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 459) took 2266 ms. Trace:
I20260709 12:59:49.008371  1687 rpcz_store.cc:276] 0709 12:59:46.717943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.057491 (+339548us) service_pool.cc:224] Handling call
0709 12:59:47.060603 (+  3112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.507726 (+447123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.984063 (+1476337us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540012dc54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:48.984315 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026640768}
I20260709 12:59:49.011714  1616 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:48.984638  4920 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:48.984961  2309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 786) took 2464 ms. Trace:
I20260709 12:59:48.977202  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:49.012629  2309 rpcz_store.cc:276] 0709 12:59:46.520849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.521027 (+   178us) service_pool.cc:224] Handling call
0709 12:59:46.521484 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.220424 (+1698940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.984695 (+764271us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54005a0354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:48.984881 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3904959360}
I20260709 12:59:49.013940  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:49.014536  4920 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:49.015352  4920 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.995397  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:48.966684  4680 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:49.004343  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.016865  4804 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.018327  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:49.018535  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.019017  4804 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.019186  1684 raft_consensus.cc:2368] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
I20260709 12:59:48.979584  4879 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.021607  4879 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.022470  4911 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.023948  4911 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:49.024887  4911 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:49.025228  4911 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:49.025130  4393 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.026026  4812 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:48.967037  4089 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.026332  4911 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.036978  2304 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:49.007884  4823 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.042502  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:49.046150  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.046420  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.054693  1616 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:59:49.057191  1689 raft_consensus.cc:2410] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:49.059559  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:49.060381  1610 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:49.063812  4783 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:49.065002  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 195840us
I20260709 12:59:49.067498  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:49.067965  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:49.068384  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 68717.7us
I20260709 12:59:49.069104  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.069859  1682 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:49.075485  4965 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.078632  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.079843  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.080541  1683 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:49.080765  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.081292  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.081665  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.082020  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.082386  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.082650  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.082983  1683 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:49.084537  4826 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.085973  2301 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:49.087131  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.082535  1688 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.091454  1684 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:49.094800  1681 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:49.097993  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:49.098742  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 57278.5us
I20260709 12:59:49.100970  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:49.101579  1506 leader_election.cc:336] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.978s (SENT)
I20260709 12:59:49.077730  4885 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.102650  1689 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:49.113198  4885 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.058965  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:59:49.113837  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:49.114372  1687 raft_consensus.cc:606] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:49.115743  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:49.115953  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.116446  4089 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:49.116909  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.117040  4878 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:49.117472  4878 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:49.092644  4783 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.101941  4847 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.117962  4826 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.118363  4878 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.119791  4847 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.119717  4974 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.121876  4974 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:49.113785  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.125224  4566 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.125885  4566 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.126274  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.127370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.127880  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:49.128633  1612 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:49.130354  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:49.131386  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:49.132197  4745 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.131724  4847 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:49.133014  4847 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.133049  4680 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:49.133601  4847 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.133714  4680 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.135885  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:49.132043  4911 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.136685  4745 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.125312  1538 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:49.137483  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.138406  1689 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:49.139179  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.119825  4878 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.142050  4974 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:49.105599  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.142709  4974 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.094817  4393 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.108601  1685 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:49.109076  1611 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:49.127909  4566 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.158468  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.110612  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:49.165813  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55275.3us
I20260709 12:59:49.166517  1507 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:49.106647  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.168675  1684 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:49.168527  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.168040  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:49.137117  4745 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.170228  4745 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.170354  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:49.171124  4914 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.171864  4914 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:49.172202  4914 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.172549  4914 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.169754  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.168435  4812 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:49.109472  4860 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.176889  4812 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.177323  4812 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.161346  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:49.168977  4983 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:49.176724  1684 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:49.178025  1690 raft_consensus.cc:2368] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8.
I20260709 12:59:49.178629  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.179579  1684 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:49.094483  4874 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:59:49.176936  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.159451  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.181353  4834 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:49.181818  4834 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:49.181645  4917 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:49.182137  4874 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.182680  4917 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:49.183105  4917 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:49.182921  4834 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.181841  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.183816  4874 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:49.183988  4917 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.184769  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:49.180531  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.184962  4983 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:49.198526  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:49.186128  4804 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:49.186435  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 67338.8us
I20260709 12:59:49.186996  4841 consensus_queue.cc:1059] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:49.188014  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.203452  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.189541  1688 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:49.160283  4974 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:49.209239  1612 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:49.191533  1689 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 12:59:49.199611  1616 raft_consensus.cc:2410] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:49.204922  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.185609  1435 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 5, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.188397  4833 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.226704  1533 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:49.194682  4089 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.228089  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.228758  1684 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:49.229442  1506 leader_election.cc:336] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.132s (SENT)
I20260709 12:59:49.232172  4846 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:59:49.234520  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.235146  1537 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:49.235199  4881 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.236071  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.236828  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.237946  4889 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.238430  4889 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.238906  4860 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:49.234452  4917 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.240485  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.241187  1685 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:49.241065  4745 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.242002  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.243041  4745 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.244649  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.246961  1539 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:49.201550  4804 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.249399  1689 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:49.237193  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.203536  4962 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.194281  4847 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.617162  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:49.616446  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:49.386053  1684 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:49.624536  2306 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:49.596621  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 376013us
W20260709 12:59:49.437479  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.361716  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 112074us
I20260709 12:59:49.373401  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:49.599604  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 370205us
I20260709 12:59:49.368927  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.508126  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:49.599794  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 353602us
I20260709 12:59:49.337878  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.273370  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.636307  1688 raft_consensus.cc:2368] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 4. Current term is 5.
W20260709 12:59:49.396993  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.637199  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.637573  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.257488  1687 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.592840  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.231254  4590 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.243065  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:49.622668  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.639652  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.208061  4932 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.640259  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:49.494987  4972 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:59:49.651163  1681 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:49.658502  1581 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:49.666085  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:49.658241  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.259570  4804 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:49.656883  1532 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:49.661103  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:49.669536  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.253506  4881 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:49.680289  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 46674.9us
W20260709 12:59:49.682020  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 46291.5us
I20260709 12:59:49.683944  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:49.681555  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:49.273069  4846 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.394s
I20260709 12:59:49.687219  1685 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:49.233724  4826 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.432s
I20260709 12:59:49.684577  1689 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:49.509754  4983 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:49.668780  4920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.019s	sys 0.010s
I20260709 12:59:49.692584  1688 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:49.689280  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.729594  1541 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.665067  4889 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.246721  4089 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.522603  4812 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.698587  4877 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:49.699797  1579 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:49.700333  4996 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:59:49.701031  4819 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:49.694741  4987 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.704686  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:49.705847  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60918.7us
I20260709 12:59:49.705935  4804 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.793110  1537 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:49.712153  4566 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:49.666244  4974 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:49.715855  4914 consensus_meta.cc:287] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.002s
W20260709 12:59:49.718420  4878 consensus_meta.cc:287] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 12:59:49.720340  4746 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:49.763069  4877 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:49.725660  2306 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:49.727416  1687 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:49.650749  4932 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.815783  1684 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.655530  4962 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.728880  4841 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:59:49.739287  4911 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.603s	user 0.005s	sys 0.002s
I20260709 12:59:49.748270  4847 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:49.751272  4917 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
W20260709 12:59:49.748112  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.753474  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:49.762075  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 62381.6us
W20260709 12:59:49.765259  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.767495  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:49.708281  1681 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:59:49.795454  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:49.760998  4920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.019s	sys 0.010s
I20260709 12:59:49.855728  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:49.798296  1534 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:49.802337  1532 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
W20260709 12:59:49.803803  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.029s	sys 0.038s
W20260709 12:59:49.856751  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.029s	sys 0.038s
I20260709 12:59:49.725059  2275 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:49.806535  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.030s	sys 0.039s
W20260709 12:59:49.857846  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.030s	sys 0.039s
I20260709 12:59:49.678686  4972 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:49.796041  4698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.013s	sys 0.028s
W20260709 12:59:49.807968  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.018s	sys 0.024s
W20260709 12:59:49.858839  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.018s	sys 0.024s
W20260709 12:59:49.859242  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 613273us
I20260709 12:59:49.846689  1686 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:49.795626  4881 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:49.793664  4819 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:49.865993  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.815044  4877 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:49.870577  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 145645us
I20260709 12:59:49.868585  1536 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
W20260709 12:59:49.863621  4698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.013s	sys 0.028s
I20260709 12:59:49.876446  4496 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.887166  4496 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:49.888500  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.889127  1540 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.889312  4496 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.890759  4804 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:49.891042  4920 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.874120  4841 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.892148  4819 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:49.894049  5013 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:49.895630  4393 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:49.895421  5011 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:59:49.896160  4393 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:49.881059  5014 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:59:49.883148  4932 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.883796  4812 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:49.884168  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 116770us
I20260709 12:59:49.885778  4972 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:49.886343  1611 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:49.897058  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:49.904218  1541 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:49.905489  1684 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:49.804986  4914 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:49.906579  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 111251us
I20260709 12:59:49.909801  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.905258  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:49.912892  1681 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.916893  1540 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:49.917752  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:49.873806  4826 raft_consensus.cc:3055] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:49.891379  4804 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:49.920922  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:49.922940  1532 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.833110  4974 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.931627  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:49.932348  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 225620us
W20260709 12:59:49.933789  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 79245.9us
I20260709 12:59:49.941246  4910 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.943516  4879 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:49.944655  4879 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:49.945034  4879 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:49.945185  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.945820  1536 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:49.945905  4879 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:49.946617  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.947188  4879 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.936511  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:49.947197  1536 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:49.919164  4874 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:49.951200  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:49.924274  4826 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:49.960933  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.961694  1541 raft_consensus.cc:2368] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 12:59:49.953287  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:49.961107  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:49.911043  4561 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:59:49.936650  4972 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:49.950345  4680 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.001s
W20260709 12:59:49.986212  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.949163  4496 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:49.954337  4962 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:49.960502  4993 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:49.955648  4974 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:49.953883  4847 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:49.951402  4881 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:59:49.996973  4972 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:50.024363  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 63323.9us
I20260709 12:59:50.013463  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:49.950289  4393 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:50.041671  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.053474  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1480) took 1021 ms. Trace:
I20260709 12:59:49.957371  4874 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:50.054018  1690 rpcz_store.cc:276] 0709 12:59:49.032290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.032405 (+   115us) service_pool.cc:224] Handling call
0709 12:59:50.041118 (+1008713us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b540012d754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:50.053396 (+ 12278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182367616}
I20260709 12:59:50.005961  4496 consensus_queue.cc:1243] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:50.010046  4911 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:50.025516  4987 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.006780  4680 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.027098  4972 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.014385  4833 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:50.108867  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:50.109674  1690 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 12:59:50.027880  1536 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:50.067016  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 114741us
I20260709 12:59:50.138090  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:50.029765  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:50.088014  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.961374  4932 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:59:50.014542  4860 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.153213  2301 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:50.153396  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 123685us
I20260709 12:59:50.154392  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:50.158475  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:50.161818  1656 leader_election.cc:400] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 12:59:50.168498  1656 leader_election.cc:403] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:59:50.174201  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.163519  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 245862us
I20260709 12:59:50.176026  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:50.103057  4962 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:59:50.187237  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:50.190259  1690 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:50.164436  4698 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:50.175707  5016 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 12:59:50.216473  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 62226.4us
I20260709 12:59:50.181336  4804 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:50.224906  4874 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:50.225719  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49895.5us
I20260709 12:59:50.214881  4983 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:50.226445  4983 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.228417  5035 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:50.228792  5019 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:59:50.228860  5035 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:50.229461  5035 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.230609  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2293) took 1055 ms. Trace:
I20260709 12:59:50.231003  1538 rpcz_store.cc:276] 0709 12:59:49.174904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.175079 (+   175us) service_pool.cc:224] Handling call
0709 12:59:49.175479 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.176147 (+   668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.176189 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.177241 (+  1052us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.857250 (+680009us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:49.892512 (+ 35262us) log.cc:844] Serialized 14 byte log entry
0709 12:59:49.892771 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.892867 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.230392 (+337525us) raft_consensus.cc:1685] finished
0709 12:59:50.230415 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.230548 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25640,"prepare.queue_time_us":35573,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":18946,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":3989,"spinlock_wait_cycles":1728256,"thread_start_us":679547,"threads_started":1,"wal-append.queue_time_us":771587}
I20260709 12:59:50.221257  1435 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 4, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:50.234498  5018 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:59:50.105821  4826 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.233747  1538 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:50.224614  4804 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.221982  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1772) took 1009 ms. Trace:
I20260709 12:59:50.239488  1536 rpcz_store.cc:276] 0709 12:59:49.212254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.191412 (+979158us) service_pool.cc:224] Handling call
0709 12:59:50.221509 (+ 30097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.221686 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.221714 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.221754 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.221782 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.221831 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.221929 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.245604  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:50.214852  4698 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.191915  4914 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.248073  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1773) took 1025 ms. Trace:
I20260709 12:59:50.263480  1538 rpcz_store.cc:276] 0709 12:59:49.212528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.233110 (+1020582us) service_pool.cc:224] Handling call
0709 12:59:50.233423 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.238176 (+  4753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.238360 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.156416  4833 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.246320  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:50.215672  5028 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 12:59:50.283102  1690 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:50.281541  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 57825.3us
I20260709 12:59:50.283301  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.284312  1616 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:50.289209  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.288187  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.290310  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.239650  4878 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.293098  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1492) took 1166 ms. Trace:
I20260709 12:59:50.304757  1607 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:59:50.304540  1686 rpcz_store.cc:276] 0709 12:59:49.126241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.888281 (+762040us) service_pool.cc:224] Handling call
0709 12:59:49.888680 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.888969 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:50.137513 (+248544us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.292691 (+155178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.292745 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:50.292831 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.292900 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.293013 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":274987,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":230,"thread_start_us":323667,"threads_started":2,"wal-append.queue_time_us":109667}
I20260709 12:59:50.296244  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.288585  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.307030  1681 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:50.262770  4698 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.310675  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.309252  1608 raft_consensus.cc:2393] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 6: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:50.301291  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1774) took 1088 ms. Trace:
I20260709 12:59:50.310971  1686 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.312300  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:50.312072  1536 rpcz_store.cc:276] 0709 12:59:49.212821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.281960 (+1069139us) service_pool.cc:224] Handling call
0709 12:59:50.300634 (+ 18674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.300869 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.300907 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.300965 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.301010 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.301080 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.301221 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.302378  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.314206  1616 raft_consensus.cc:2368] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
W20260709 12:59:50.314625  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 87692us
I20260709 12:59:50.315531  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1775) took 1102 ms. Trace:
I20260709 12:59:50.316033  1538 rpcz_store.cc:276] 0709 12:59:49.213111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.280719 (+1067608us) service_pool.cc:224] Handling call
0709 12:59:50.308952 (+ 28233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.315088 (+  6136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.315123 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.315181 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:50.315229 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.315330 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.315465 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.282204  4911 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:50.322570  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.324360  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.326608  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1495) took 1193 ms. Trace:
I20260709 12:59:50.326987  1686 rpcz_store.cc:276] 0709 12:59:49.126995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.310527 (+1183532us) service_pool.cc:224] Handling call
0709 12:59:50.310802 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.319660 (+  8858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.319910 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.328123  1686 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:50.328688  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1508) took 1162 ms. Trace:
I20260709 12:59:50.329011  1686 rpcz_store.cc:276] 0709 12:59:49.166595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.327716 (+1161121us) service_pool.cc:224] Handling call
0709 12:59:50.327970 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.328491 (+   521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.328642 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.330287  1686 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:50.330847  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1763) took 1137 ms. Trace:
I20260709 12:59:50.331131  1686 rpcz_store.cc:276] 0709 12:59:49.193327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.329720 (+1136393us) service_pool.cc:224] Handling call
0709 12:59:50.329973 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.330654 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.330804 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.332261  1686 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.332796  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1764) took 1139 ms. Trace:
I20260709 12:59:50.333078  1686 rpcz_store.cc:276] 0709 12:59:49.193637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.331829 (+1138192us) service_pool.cc:224] Handling call
0709 12:59:50.332074 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.332601 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.332754 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.334504  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1765) took 1140 ms. Trace:
I20260709 12:59:50.334214  4972 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.334882  1686 rpcz_store.cc:276] 0709 12:59:49.193914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.333780 (+1139866us) service_pool.cc:224] Handling call
0709 12:59:50.334013 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.334235 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.334259 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.334299 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:50.334327 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.334376 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.334461 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.335494  1609 raft_consensus.cc:2368] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:50.336426  1686 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:50.336830  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.338675  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:50.339947  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.341332  1690 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:50.341840  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 469) took 1204 ms. Trace:
I20260709 12:59:50.342085  1690 rpcz_store.cc:276] 0709 12:59:49.137731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.314961 (+1177230us) service_pool.cc:224] Handling call
0709 12:59:50.339279 (+ 24318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.341671 (+  2392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.341801 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.342566  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.338349  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.314200  4983 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.321323  4826 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.345562  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.359182  1610 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.344497  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1767) took 1141 ms. Trace:
I20260709 12:59:50.359951  1686 rpcz_store.cc:276] 0709 12:59:49.202818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.335795 (+1132977us) service_pool.cc:224] Handling call
0709 12:59:50.336058 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.336742 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.344444 (+  7702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.346937  1681 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:50.344857  1426 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ff79ac342d91424db634ca7802846535 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:50.361941  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:50.351248  5009 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.757s	user 0.000s	sys 0.003s
I20260709 12:59:50.355899  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1627) took 1166 ms. Trace:
I20260709 12:59:50.363590  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:50.357082  4834 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.365018  4911 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:50.365600  4911 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:50.365721  4833 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:50.357326  5017 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:59:50.366474  4911 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.367301  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1754) took 1287 ms. Trace:
I20260709 12:59:50.367705  1683 rpcz_store.cc:276] 0709 12:59:49.079438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.083569 (+  4131us) service_pool.cc:224] Handling call
0709 12:59:49.083881 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.088629 (+  4748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.088662 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.133167 (+ 44505us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.858290 (+725123us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:49.858347 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.858435 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.356715 (+498280us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:50.366987 (+ 10272us) raft_consensus.cc:1685] finished
0709 12:59:50.367008 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.367228 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7189,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6396,"spinlock_wait_cycles":3169920,"thread_start_us":724652,"threads_started":1,"wal-append.queue_time_us":800813}
I20260709 12:59:50.369848  1683 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.370395  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1770) took 1112 ms. Trace:
I20260709 12:59:50.370710  1683 rpcz_store.cc:276] 0709 12:59:49.258321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.369356 (+1111035us) service_pool.cc:224] Handling call
0709 12:59:50.369675 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.370186 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.370347 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:50.357594  4590 consensus_meta.cc:287] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.000s
I20260709 12:59:50.357900  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:50.362967  1532 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:50.374413  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:50.376387  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1490) took 1234 ms. Trace:
I20260709 12:59:50.363554  1611 rpcz_store.cc:276] 0709 12:59:49.189422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.196731 (+  7309us) service_pool.cc:224] Handling call
0709 12:59:49.208461 (+ 11730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.911039 (+702578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.355631 (+444592us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54002b5554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:50.355838 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558490496}
I20260709 12:59:50.383927  1613 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:50.380975  4590 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:50.387593  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65694.4us
I20260709 12:59:50.388499  5042 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.388561  4590 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:50.389075  5042 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.391291  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.391980  1683 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:50.394327  4987 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.394722  1683 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.394807  4987 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:50.395941  5029 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:59:50.398734  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.397699  5033 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:50.422991  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:50.448556  1540 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:50.381170  4860 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.358914  5028 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:50.396801  5032 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:59:50.440394  4841 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.002s
I20260709 12:59:50.397626  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:50.407914  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:50.424611  4680 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.440873  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.453176  1536 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 12:59:50.441130  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:50.429402  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1496) took 1302 ms. Trace:
I20260709 12:59:50.462401  1681 rpcz_store.cc:276] 0709 12:59:49.127229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.308203 (+1180974us) service_pool.cc:224] Handling call
0709 12:59:50.329228 (+ 21025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.362133 (+ 32905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.429155 (+ 67022us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b540035af54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:50.429327 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39793024}
I20260709 12:59:50.377036  1685 rpcz_store.cc:276] 0709 12:59:49.125663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.695871 (+570208us) service_pool.cc:224] Handling call
0709 12:59:49.731075 (+ 35204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.761208 (+ 30133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.761251 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.809330 (+ 48079us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.238936 (+429606us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:50.238983 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.239063 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.359628 (+120565us) raft_consensus.cc:1685] finished
0709 12:59:50.359644 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.359760 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3562,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5177,"thread_start_us":368575,"threads_started":1,"wal-append.queue_time_us":432960}
W20260709 12:59:50.401538  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.804s (SENT) [suppressed 27 similar messages]
I20260709 12:59:50.463672  1615 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:50.415668  4745 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:50.443543  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.403162  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1773) took 1034 ms. Trace:
I20260709 12:59:50.435424  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2304) took 1199 ms. Trace:
I20260709 12:59:50.405272  1688 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:59:50.466378  1534 rpcz_store.cc:276] 0709 12:59:49.235910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.244579 (+  8669us) service_pool.cc:224] Handling call
0709 12:59:50.435225 (+1190646us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000c1a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:50.435334 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367758720}
I20260709 12:59:50.466778  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1491) took 1340 ms. Trace:
I20260709 12:59:50.467150  1688 rpcz_store.cc:276] 0709 12:59:49.125951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.729247 (+603296us) service_pool.cc:224] Handling call
0709 12:59:50.404877 (+675630us) spinlock_profiling.cc:243] Waited 884 us on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:50.405054 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.466496 (+ 61442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.466725 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032896}
I20260709 12:59:50.467938  1534 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:50.468504  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1777) took 1246 ms. Trace:
I20260709 12:59:50.435770  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:50.468791  1534 rpcz_store.cc:276] 0709 12:59:49.221618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.467331 (+1245713us) service_pool.cc:224] Handling call
0709 12:59:50.467625 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.468295 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.468459 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.469170  1532 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:50.470243  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:50.413166  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1769) took 1180 ms. Trace:
I20260709 12:59:50.465611  1684 rpcz_store.cc:276] 0709 12:59:49.369031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.645671 (+276640us) service_pool.cc:224] Handling call
0709 12:59:50.402994 (+757323us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400394254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:50.403095 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332811648}
I20260709 12:59:50.471735  1690 rpcz_store.cc:276] 0709 12:59:49.232791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.362998 (+1130207us) service_pool.cc:224] Handling call
0709 12:59:50.412633 (+ 49635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.412831 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.412856 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.412894 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:50.412933 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.413004 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.413113 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.425691  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:50.399132  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:50.473235  1538 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.473678  4680 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:50.460525  4860 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.474257  4680 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.400197  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:50.476480  1539 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.400740  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:50.477284  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 76643.2us
I20260709 12:59:50.477358  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1771) took 1265 ms. Trace:
I20260709 12:59:50.477793  1537 rpcz_store.cc:276] 0709 12:59:49.211942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.236961 (+ 25019us) service_pool.cc:224] Handling call
0709 12:59:50.477183 (+1240222us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002c6d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:50.477304 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382878080}
I20260709 12:59:50.478694  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:50.412575  4089 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.401139  1610 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:50.446671  1612 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:50.419592  5035 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.451648  5033 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:50.487977  4877 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.000s
I20260709 12:59:50.488302  4895 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.488451  4877 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.480758  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:50.488826  4895 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.489960  4224 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.491138  1540 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.491364  4895 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:50.491743  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1776) took 1270 ms. Trace:
I20260709 12:59:50.489351  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.492076  1540 rpcz_store.cc:276] 0709 12:59:49.221253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.471848 (+1250595us) service_pool.cc:224] Handling call
0709 12:59:50.490976 (+ 19128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.491524 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.491695 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.492692  1616 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:50.493362  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:50.493614  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.494056  1540 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:50.494580  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.497189  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1762) took 1394 ms. Trace:
I20260709 12:59:50.497565  1687 rpcz_store.cc:276] 0709 12:59:49.102340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.116660 (+ 14320us) service_pool.cc:224] Handling call
0709 12:59:50.497035 (+1380375us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540032e1d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:50.497134 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321964288}
I20260709 12:59:50.495266  1616 raft_consensus.cc:2393] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:50.488813  1611 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.481695  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:50.500425  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.501138  1615 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:50.501049  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:50.501720  4834 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.502337  4834 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:50.502746  1541 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:50.505714  1538 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:50.504195  1532 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 12:59:50.485354  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:50.509416  1534 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:50.510005  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2303) took 1274 ms. Trace:
I20260709 12:59:50.512823  1534 rpcz_store.cc:276] 0709 12:59:49.235630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.473225 (+1237595us) service_pool.cc:224] Handling call
0709 12:59:50.509124 (+ 35899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.509785 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.509959 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.513608  1612 raft_consensus.cc:2410] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:59:50.512257  1682 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:50.514268  4746 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:59:50.515733  4917 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:50.516078  4819 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:50.516670  4983 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:50.517326  5024 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:50.517992  5024 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:50.514393  4874 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:50.519459  4874 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:50.519826  4874 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:50.483053  4680 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.520759  4874 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.521876  4874 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.522955  4698 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.524103  1614 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:50.471474  4745 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:50.530828  4745 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.471660  4841 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.532313  4974 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.532671  4745 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.502759  4834 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:50.534090  4834 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.466482  4972 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.484364  5011 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:50.550405  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.485687  4799 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:59:50.529385  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1761) took 1428 ms. Trace:
W20260709 12:59:50.531581  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 106030us
I20260709 12:59:50.517436  4983 consensus_queue.cc:1243] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:50.533030  1681 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 12:59:50.537262  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 468) took 1399 ms (client timeout 1692 ms). Trace:
I20260709 12:59:50.483562  4860 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:50.536011  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:50.547039  1685 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:50.547238  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.511453  4804 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:50.569253  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:50.570432  1682 rpcz_store.cc:269] 0709 12:59:49.137421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.143812 (+  6391us) service_pool.cc:224] Handling call
0709 12:59:50.407749 (+1263937us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 12:59:50.537193 (+129444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38272896}
I20260709 12:59:50.554371  1689 rpcz_store.cc:276] 0709 12:59:49.101966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.709216 (+607250us) service_pool.cc:224] Handling call
0709 12:59:49.709673 (+   457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:49.966905 (+257232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:50.183259 (+216354us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.321240 (+137981us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.321686 (+   446us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:50.345235 (+ 23549us) log.cc:844] Serialized 52 byte log entry
0709 12:59:50.346363 (+  1128us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:50.347327 (+   964us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.528792 (+181465us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180044dc40. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 12:59:50.528961 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.529131 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.529176 (+    45us) raft_consensus.cc:1685] finished
0709 12:59:50.529192 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.529326 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37612,"prepare.queue_time_us":201342,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":186460,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":15988,"spinlock_wait_cycles":31354624,"thread_start_us":522400,"threads_started":3,"wal-append.queue_time_us":131289}
W20260709 12:59:50.583531  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47601.2us
I20260709 12:59:50.570143  1681 pending_rounds.cc:85] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 12:59:50.535753  4910 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:50.584327  1681 pending_rounds.cc:107] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:50.584645  1681 raft_consensus.cc:2889] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.540150  5028 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:50.539958  4566 raft_consensus.cc:2764] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:59:50.554054  5011 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.585511  1539 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 5.
I20260709 12:59:50.591531  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:50.585258  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.592211  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.589519  4881 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:50.554198  4962 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:59:50.588201  4972 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.594067  5028 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.594568  4990 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:59:50.604605  1537 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.605443  1612 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:50.595484  4993 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:50.600019  1539 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:59:50.583949  4804 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.610680  1685 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 12:59:50.610776  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 132152us
I20260709 12:59:50.612633  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:50.612876  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 211380us
I20260709 12:59:50.613724  1682 raft_consensus.cc:2393] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:50.591925  4833 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.611917  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:50.617635  2275 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:50.619536  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:50.568166  4393 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:50.600338  5011 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.621665  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:50.627188  1685 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
W20260709 12:59:50.627374  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.601233  4910 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:50.607012  4860 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.608851  4993 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:50.632138  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1768) took 1407 ms. Trace:
I20260709 12:59:50.631639  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:50.615842  4804 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.637141  2306 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:59:50.633955  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.612362  4881 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:50.618000  4911 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.639364  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:50.646554  1535 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:50.628099  5048 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:50.654734  2306 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:50.655077  2303 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.656769  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:50.657573  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:50.647717  1681 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:50.660318  1681 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:50.660249  2305 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:50.658179  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:50.612202  4972 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:50.666042  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.665557  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:50.669258  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:50.670493  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:50.622231  5025 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:59:50.671468  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:50.674934  2302 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.632923  4833 raft_consensus.cc:697] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:50.667387  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:50.677951  1615 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:50.639302  4819 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.648795  5035 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:50.675168  1681 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.675853  1535 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:50.673815  2301 raft_consensus.cc:2410] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:59:50.689424  1535 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:59:50.693101  4911 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.693989  4911 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.696596  4993 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.637133  4860 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.697129  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:50.668921  4841 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:50.702612  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66941.7us
I20260709 12:59:50.652932  4983 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:50.702695  1681 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:50.699167  1685 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:59:50.699376  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 58651.2us
I20260709 12:59:50.680877  4826 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.708083  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:50.719242  2275 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:50.701680  4819 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:50.724745  4932 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.725513  4972 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:50.725253  4819 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.667490  4878 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:59:50.681103  5046 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.698154  5051 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.701169  5048 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:50.725277  5047 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:59:50.772377  5052 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:50.775105  1681 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:59:50.778474  1681 pending_rounds.cc:85] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 12:59:50.778787  1681 pending_rounds.cc:107] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:59:50.779071  1681 raft_consensus.cc:2889] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.731189  4680 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.744135  4911 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:50.723589  5035 consensus_queue.cc:1059] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:59:50.730871  5036 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 12:59:50.783247  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 86013.2us
I20260709 12:59:50.864719  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:50.865792  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:50.762055  4566 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:50.849586  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 184194us
I20260709 12:59:50.867408  2302 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:50.869045  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:50.851194  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 143207us
W20260709 12:59:50.852695  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.800696  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.874236  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:50.730592  4910 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.732960  4826 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.850538  4680 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:50.812315  5052 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:50.867784  4911 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:50.871737  4993 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.774343  5051 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.942322  5051 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:50.942961  5051 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.905488  5030 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.905959  5063 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:59:50.872668  5059 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:59:50.896827  4911 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:50.894150  4680 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.909385  5028 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:50.761086  4881 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.921139  4932 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.924506  5048 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.875063  4566 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.864601  4833 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.883777  4393 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:50.957998  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89051.9us
I20260709 12:59:50.893358  4983 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:50.808822  5046 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:50.956789  5030 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.961158  4911 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.031850  2276 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.023679  5011 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.009307  4878 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:51.082974  2307 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:59:51.141284  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 109535us
I20260709 12:59:51.141449  5035 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.143360  2301 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.034941  4393 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:51.144603  4393 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.145465  4987 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:50.965342  5028 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:51.147101  5028 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.147902  4914 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:51.148293  4914 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:51.148509  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:51.149175  1614 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:51.149134  4914 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:51.033131  4932 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:50.632736  1686 rpcz_store.cc:276] 0709 12:59:49.224498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.360726 (+1136228us) service_pool.cc:224] Handling call
0709 12:59:50.360981 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.380489 (+ 19508us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:50.452126 (+ 71637us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.631766 (+179640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.631814 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:50.631853 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.631913 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.632054 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71328,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":1162,"thread_start_us":164833,"threads_started":1}
I20260709 12:59:51.153568  1609 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:51.155763  1611 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:59:51.035895  1506 leader_election.cc:336] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.650s (SENT)
I20260709 12:59:51.160046  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.163758  4910 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.171789  5028 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:51.172255  4566 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.172078  4910 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.164762  1435 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 7, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 12:59:51.025460  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 159748us
I20260709 12:59:51.177232  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:51.177389  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:51.133579  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.179371  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 143511us
I20260709 12:59:51.035063  4860 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:51.163962  4914 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.183471  1616 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.178013  1609 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:51.173707  1435 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:51.164114  4987 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:51.163823  4917 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:51.190038  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:51.190619  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.174013  4878 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:51.072746  4983 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.202498  1656 leader_election.cc:400] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 12:59:51.181125  4895 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.194188  5024 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:51.192034  4826 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.204054  4917 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.204365  5075 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:51.200646  4860 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.204180  4987 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:51.205840  5071 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:59:51.206238  5064 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:59:51.206810  5060 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:59:51.209184  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.226934  5063 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:51.227506  4878 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:51.237123  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:51.201754  1506 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.829s (SENT)
I20260709 12:59:51.262281  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.180480  5028 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:51.264500  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:51.265012  5030 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.264961  4680 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.265609  4914 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.266007  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.266606  1539 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 12:59:51.266734  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2307) took 1985 ms. Trace:
I20260709 12:59:51.267268  4680 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:51.268007  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.268639  1534 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:51.268646  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.270044  1539 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:51.267071  1537 rpcz_store.cc:276] 0709 12:59:49.281633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.478637 (+1197004us) service_pool.cc:224] Handling call
0709 12:59:50.604398 (+125761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.605088 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.266554 (+661466us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002c7c50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:51.266677 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288478592}
I20260709 12:59:51.082994  5052 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:51.241601  4804 consensus_meta.cc:287] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
W20260709 12:59:51.242019  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.264292  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 62569.8us
I20260709 12:59:51.250200  5075 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:51.268366  4698 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.240025  1656 leader_election.cc:403] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:51.278381  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:51.277558  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:51.260823  5024 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:51.280575  1506 leader_election.cc:336] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.897s (SENT)
I20260709 12:59:51.281086  4833 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.323019  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.329807  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.330340  1532 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:51.256837  4860 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.353163  4680 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:59:51.354982  4680 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:51.355307  4680 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:51.356107  4680 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.352038  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:51.357735  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:51.353951  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:51.359073  2301 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:59:51.345351  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.282717  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:51.261299  5063 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:51.326856  1681 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:51.328629  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:51.327996  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:51.329418  5060 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:51.323189  5075 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.289264  4804 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.340931  5033 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.344815  5070 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:51.345333  4987 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:51.346879  5046 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.347885  4910 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.348263  5011 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.354368  2304 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:59:51.369239  1537 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:51.323063  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 120684us
I20260709 12:59:51.374877  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:51.271852  4895 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:59:51.340553  5042 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.330986  5073 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
W20260709 12:59:51.381567  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 109411us
W20260709 12:59:51.384747  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 104207us
I20260709 12:59:51.377182  5063 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:51.387455  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:51.388203  2304 pending_rounds.cc:85] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 9
I20260709 12:59:51.377935  5072 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:51.390075  2305 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.398200  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:51.389055  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:51.334539  4833 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.397207  2304 pending_rounds.cc:107] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:59:51.397926  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:51.401664  2304 raft_consensus.cc:2889] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.401911  2301 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.401845  1688 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.404664  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:51.403252  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:51.411450  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:51.412312  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.391376  4680 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.411113  1690 raft_consensus.cc:2376] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8. Re-sending same reply.
I20260709 12:59:51.412182  1681 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:51.398233  5072 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:51.390770  5070 consensus_queue.cc:1243] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:51.450227  1609 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:51.397229  4895 consensus_queue.cc:1243] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:51.452557  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:51.448930  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:51.454211  1616 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:51.413359  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.413328  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.397015  5046 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:51.433517  4833 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.406366  4826 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:51.436483  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:51.436980  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.440510  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:51.460203  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1780) took 1269 ms. Trace:
W20260709 12:59:51.444746  5080 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:51.417321  5030 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:59:51.445214  5065 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:51.407200  5042 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:51.450083  1537 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:51.456965  1688 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:51.472901  1611 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:51.474064  5030 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:51.474433  5030 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:51.475183  5030 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.471904  5042 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.476776  5042 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.469835  5065 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:51.481357  5065 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.482692  5065 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.450711  5072 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.460711  1540 rpcz_store.cc:276] 0709 12:59:50.266043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.494639 (+228596us) service_pool.cc:224] Handling call
0709 12:59:50.494928 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.495309 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:50.643506 (+148197us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.732134 (+ 88628us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:50.777326 (+ 45192us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.777833 (+   507us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:50.777973 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.778223 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.459945 (+681722us) raft_consensus.cc:1685] finished
0709 12:59:51.459974 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.460136 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":228025,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":19602,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":27569,"thread_start_us":204610,"threads_started":2,"wal-append.queue_time_us":356558}
I20260709 12:59:51.469103  1608 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.457559  1534 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
W20260709 12:59:51.471220  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.457496  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 52907.9us
I20260709 12:59:51.451551  4877 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.486768  1682 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.496071  4895 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:51.496659  4895 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.502069  4877 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.504365  4590 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:51.507463  4917 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.508131  4561 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:51.509147  5036 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:51.509536  5036 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:51.509454  4561 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:51.510669  5036 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.511253  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:51.511664  5036 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.511971  2304 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:51.512334  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:51.512982  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:51.516269  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:51.503870  4877 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:59:51.517410  4804 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:51.520716  4983 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.545646  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.526913  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.528764  1541 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:59:51.528939  4914 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:59:51.531680  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.531903  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:51.550658  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:51.535143  1426 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ff79ac342d91424db634ca7802846535 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:51.535843  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:51.536343  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:51.553548  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:51.554124  1538 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.554697  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1781) took 1137 ms. Trace:
I20260709 12:59:51.551945  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:51.555773  2304 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:51.459343  5046 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.531257  1582 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:51.548851  1541 pending_rounds.cc:85] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 3
I20260709 12:59:51.560855  1541 pending_rounds.cc:107] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:59:51.550333  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:51.558900  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:51.561143  1541 raft_consensus.cc:2889] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.561764  1534 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:51.566682  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:51.555042  1683 rpcz_store.cc:276] 0709 12:59:50.417066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.449818 (+ 32752us) service_pool.cc:224] Handling call
0709 12:59:50.450250 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:50.530174 (+ 79924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.530207 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:50.530803 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 12:59:50.637470 (+106667us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:50.658703 (+ 21233us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.691664 (+ 32961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.691760 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.523333 (+831573us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b180044dd60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:51.530222 (+  6889us) raft_consensus.cc:1685] finished
0709 12:59:51.554497 (+ 24275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.554629 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112108,"prepare.queue_time_us":28314,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1300,"raft.queue_time_us":115203,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":211,"spinlock_wait_cycles":13150592,"thread_start_us":106324,"threads_started":1,"wal-append.queue_time_us":167871}
I20260709 12:59:51.570081  2276 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:51.573325  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:51.574361  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.558283  4987 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.577862  1536 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:51.580484  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:51.582940  1684 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:51.582448  1540 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:51.585289  1685 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.581914  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.572439  4804 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:51.587627  4804 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.588006  4804 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:51.558861  4393 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:51.588553  4393 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:51.588925  4393 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:51.583910  4590 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:51.552680  5051 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.549590  4833 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:59:51.563792  5033 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:51.616192  2301 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
W20260709 12:59:51.458366  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.583972  1653 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:51.549281  4914 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 12:59:51.642815  1506 leader_election.cc:336] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.094s (SENT)
I20260709 12:59:51.603626  1538 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:51.564762  5046 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:51.557588  4932 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:51.608122  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.457059  4993 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.569936  4910 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:59:51.574419  4881 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.550243  5070 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:59:51.649777  1435 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 6, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.655377  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:51.654181  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 70298.2us
I20260709 12:59:51.597574  5044 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:51.657112  1506 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.133s (SENT)
I20260709 12:59:51.652956  5074 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:51.674226  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.607507  4590 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:51.670778  4910 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:51.680301  4932 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.657940  5052 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.659107  5033 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:51.671180  5071 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:59:51.681375  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 288709us
I20260709 12:59:51.680910  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:51.683197  1506 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.408s (SENT)
I20260709 12:59:51.596906  4745 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 12:59:51.702826  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 129873us
I20260709 12:59:51.746134  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:51.705511  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.713259  4895 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:51.719117  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 166892us
I20260709 12:59:51.720217  4860 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:51.721812  4826 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.744995  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:51.680899  4910 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:51.767059  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.779270  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 197679us
W20260709 12:59:51.785104  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.763877  4566 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:51.772570  5093 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:59:51.814685  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 159455us
I20260709 12:59:51.768651  4826 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:51.822952  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1798) took 1383 ms. Trace:
I20260709 12:59:51.776636  4860 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:51.771463  4932 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.822914  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:51.837167  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.874502  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 51753.6us
I20260709 12:59:51.867107  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.832582  1533 rpcz_store.cc:276] 0709 12:59:50.439129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.630913 (+191784us) service_pool.cc:224] Handling call
0709 12:59:50.631213 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:50.658032 (+ 26819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.658061 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:50.675724 (+ 17663us) log.cc:844] Serialized 52 byte log entry
0709 12:59:50.835970 (+160246us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:50.871353 (+ 35383us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.157885 (+286532us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b180036aba0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 12:59:51.813488 (+655603us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b180036aba0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d5c6433c7 00007f8d58c559a7 00007f8d58c650bf 00007f8d58c65038
0709 12:59:51.822401 (+  8913us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.822638 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.822715 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.822754 (+    39us) raft_consensus.cc:1685] finished
0709 12:59:51.822767 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.822896 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":956045,"prepare.queue_time_us":38363,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":29098,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":10470,"spinlock_wait_cycles":25032320,"thread_start_us":118454,"threads_started":1,"wal-append.queue_time_us":230312}
I20260709 12:59:51.762488  5035 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:59:51.891966  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 118728us
W20260709 12:59:51.892835  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 114088us
I20260709 12:59:51.823199  5023 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:51.900820  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 217670us
I20260709 12:59:51.757272  4914 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.781886  4877 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:59:51.873865  5044 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.874393  4860 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.858489  4841 raft_consensus.cc:3055] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.898788  4566 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:51.887636  4089 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.945204  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:51.908524  5035 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:51.930701  4860 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.942239  4895 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.930398  4841 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:51.921108  4878 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:51.879990  4590 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:51.990281  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60292.4us
I20260709 12:59:51.906957  5108 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:59:51.959905  5035 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:51.911417  5023 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.997242  4089 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:51.997766  5092 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:59:51.997817  5024 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:51.933044  5044 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:52.007246  5085 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:59:52.011914  5098 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:59:52.013092  5090 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.015168  4566 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:51.993846  5042 consensus_meta.cc:287] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.013s
W20260709 12:59:52.059377  5110 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:59:52.059520  5042 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.033015  5024 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.064406  5046 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.065616  2308 raft_consensus.cc:2393] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:52.067626  5099 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.899302  5033 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:52.027319  4680 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.582s	user 0.015s	sys 0.027s
I20260709 12:59:52.025161  5035 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:52.027868  5036 consensus_meta.cc:287] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.017s
I20260709 12:59:51.986416  5059 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.968390  5065 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:59:52.057277  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.032701  4089 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.068293  5099 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:51.997766  1656 leader_election.cc:400] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 12:59:51.992952  5116 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 12:59:52.086236  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88622.7us
I20260709 12:59:51.992093  4895 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 12:59:52.075587  4911 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.010s
W20260709 12:59:52.080715  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.065639  5024 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.090242  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:52.102074  2306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.013s	sys 0.005s
W20260709 12:59:52.102517  2306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.013s	sys 0.005s
I20260709 12:59:52.105958  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:52.109417  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.005s
W20260709 12:59:52.110350  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.010s	sys 0.005s
I20260709 12:59:52.090440  4974 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:52.122002  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.123533  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:52.113178  5104 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:52.142287  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:52.142815  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.115803  5116 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:52.144200  1656 leader_election.cc:400] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:52.109716  5024 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.110296  4847 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:52.117558  5072 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.569s	user 0.002s	sys 0.016s
I20260709 12:59:52.156577  5072 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.097086  4911 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.120217  4974 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:52.141896  4878 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:52.074602  5090 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.126374  5065 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:52.131703  5059 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.169250  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:52.195031  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.091235  4841 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.148142  5102 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.203538  1539 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:52.203006  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.173385  5075 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.011s
I20260709 12:59:52.206274  5042 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.207455  5059 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:52.213694  5111 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:59:52.216274  5127 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.171823  5024 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.125690  5115 consensus_queue.cc:1059] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:59:52.194523  5105 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.203994  4878 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:52.200740  5124 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:52.278113  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.189538  4847 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.280490  1684 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:52.286221  1684 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:52.289402  1539 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:52.274204  4917 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.277719  5059 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:52.233630  5075 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.297320  5044 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:52.320174  5121 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.172s	user 0.001s	sys 0.002s
I20260709 12:59:52.324549  5072 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.324940  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.325666  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.325845  4972 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:52.326954  4847 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.348237  4860 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.348847  4847 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:52.350432  4860 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.351125  1689 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:52.342471  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.306023  4745 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.352061  4745 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:52.353588  4393 consensus_meta.cc:287] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.000s
I20260709 12:59:52.354001  4393 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.354435  4745 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.352409  4972 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:52.355054  4972 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:52.356323  5084 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:52.355945  4972 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.236624  5127 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.358457  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.358970  1611 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:52.359916  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.360984  1610 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:59:52.315245  4089 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.362681  1687 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.275935  4974 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:52.365679  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 472131us
I20260709 12:59:52.367317  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:52.367865  2307 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:52.369444  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:52.356096  4393 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.329661  5130 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:52.351796  4895 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.312065  4917 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.356850  5099 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.385354  1687 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:59:52.292544  5105 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.392328  5024 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.393160  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.379978  4972 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.370200  4799 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:52.395385  4799 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.395761  4799 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.374317  4745 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:52.370529  4089 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.400897  4089 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:52.401785  4804 consensus_meta.cc:287] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.000s
I20260709 12:59:52.402228  4804 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.403020  4089 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.403486  2301 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 12:59:52.403596  4826 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.001s
I20260709 12:59:52.405655  4804 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.408502  4974 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.409003  4745 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:52.410022  4745 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.412585  4911 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:52.384382  4878 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.411949  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.416356  5059 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.297885  5124 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.421710  5124 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:52.424057  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.428843  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.405754  4917 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.404146  4826 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.454612  5035 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.460397  4799 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:52.462549  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 293398us
I20260709 12:59:52.462764  1615 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:52.422976  5090 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.518587  1435 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 5, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.523471  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:52.534137  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.534746  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.536723  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:52.525079  5141 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:59:52.469661  5133 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.542039  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:52.539412  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.543268  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:52.545888  4881 consensus_meta.cc:287] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.884s	user 0.000s	sys 0.011s
I20260709 12:59:52.546325  4881 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:52.547132  5123 raft_consensus.cc:3055] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:52.547541  5123 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:52.525956  5095 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.541121  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.550411  1614 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:52.526499  4917 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.385303  5130 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.536926  5024 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.551311  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.557029  1612 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:52.549546  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:52.551764  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.552994  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.533811  4974 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.536690  5090 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.563463  2306 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:52.562251  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.562815  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.566973  2306 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:52.567603  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.567958  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:52.568691  1684 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:52.575620  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.536835  5099 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:52.582521  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.592783  5099 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:52.583207  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:52.593196  5099 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:52.593568  2310 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:52.593748  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:52.594007  5099 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.595023  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.562026  4917 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.597429  4917 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.597958  5137 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:52.598421  2308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 527) took 1088 ms. Trace:
I20260709 12:59:52.598948  2308 rpcz_store.cc:276] 0709 12:59:51.509982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.515798 (+  5816us) service_pool.cc:224] Handling call
0709 12:59:52.598154 (+1082356us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54005023d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:52.598321 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261730176}
I20260709 12:59:52.599570  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.586197  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:52.601516  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.561017  5088 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.602371  5088 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.604425  5088 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.605232  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.605609  4826 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.606056  1540 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:52.569622  5090 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.607440  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.608474  5090 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.609102  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 483) took 1083 ms. Trace:
I20260709 12:59:52.609439  5123 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.609659  2307 rpcz_store.cc:276] 0709 12:59:51.525904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.548105 (+ 22201us) service_pool.cc:224] Handling call
0709 12:59:52.608828 (+1060723us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54005b22d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:52.609027 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831893888}
I20260709 12:59:52.610538  5123 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.583730  5134 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.612854  5134 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.615859  2302 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:52.595798  1685 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:52.584826  5127 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.586633  5105 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.590385  5075 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:52.561496  4911 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.592903  1684 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:52.623833  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.623919  4911 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.625314  5035 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:52.569569  5136 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.626241  5136 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.626824  4911 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.589725  4799 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.549551  5133 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:52.631654  5113 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.633s	user 0.002s	sys 0.000s
I20260709 12:59:52.633229  5133 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.588244  5130 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.556564  5095 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.638947  5095 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.565653  5024 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.640405  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:52.641492  5024 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.618672  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:52.563352  5063 consensus_meta.cc:287] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.160s	user 0.012s	sys 0.000s
I20260709 12:59:52.620288  1608 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:52.624456  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.595170  5099 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.652396  5035 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:52.653134  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.615037  5134 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.654295  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.655046  1684 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:52.655786  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.656842  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:52.657115  5117 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.598s	user 0.000s	sys 0.002s
I20260709 12:59:52.659224  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.659857  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.636014  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.665011  1541 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:52.664863  5063 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.665987  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.666527  1541 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:52.666940  5063 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:52.667321  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.608137  1540 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.668566  1683 raft_consensus.cc:2410] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:52.670096  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.671277  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.642386  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:52.672505  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:52.672849  4826 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:52.673331  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:52.673517  5136 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.673689  5124 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.673854  2276 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:52.674165  2306 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:52.674216  5124 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.674751  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:52.660270  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:52.676949  5124 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:52.677594  5124 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:52.678093  5035 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:52.678509  5035 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.678859  5035 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.678719  5124 raft_consensus.cc:697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:52.628048  5112 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
I20260709 12:59:52.672516  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.680507  1536 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:52.681210  4834 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:52.643653  1610 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:52.683398  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.683684  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:52.684185  1541 raft_consensus.cc:2410] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:52.684566  1681 raft_consensus.cc:2393] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:52.684712  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.663344  1684 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 12:59:52.681269  5105 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:52.681015  1683 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:52.685467  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1803) took 1131 ms. Trace:
I20260709 12:59:52.660784  2305 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:52.661765  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.688093  1540 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:52.681447  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.690783  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.696105  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1804) took 1141 ms. Trace:
I20260709 12:59:52.696592  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.696481  1688 rpcz_store.cc:276] 0709 12:59:51.554350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.556327 (+  1977us) service_pool.cc:224] Handling call
0709 12:59:51.579781 (+ 23454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.759629 (+179848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.759658 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.760154 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.907177 (+147023us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:51.907273 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.907369 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.630777 (+723408us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:52.685008 (+ 54231us) raft_consensus.cc:1685] finished
0709 12:59:52.685028 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.696045 (+ 11017us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60909,"raft.queue_time_us":186663,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3451,"spinlock_wait_cycles":61876480,"thread_start_us":240842,"threads_started":2,"wal-append.queue_time_us":224417}
I20260709 12:59:52.698791  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.699910  1685 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:52.691375  1682 rpcz_store.cc:276] 0709 12:59:51.554057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.558377 (+  4320us) service_pool.cc:224] Handling call
0709 12:59:51.558733 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:51.559099 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:51.765225 (+206126us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.994301 (+229076us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.994721 (+   420us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:51.997812 (+  3091us) log.cc:844] Serialized 52 byte log entry
0709 12:59:51.998042 (+   230us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:51.999148 (+  1106us) log.cc:844] Serialized 14 byte log entry
0709 12:59:52.025941 (+ 26793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.026056 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.656478 (+630422us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:52.685295 (+ 28817us) raft_consensus.cc:1685] finished
0709 12:59:52.685316 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.685418 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131870,"prepare.queue_time_us":108399,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":87220,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":67931,"spinlock_wait_cycles":42076160,"thread_start_us":329498,"threads_started":2,"wal-append.queue_time_us":271350}
I20260709 12:59:52.702550  5134 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:52.702948  5134 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.703269  5134 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.709663  1507 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:52.710479  5136 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.673388  4826 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:52.710886  5136 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.711344  5136 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.711687  4826 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.713706  5134 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.716332  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.730597  1683 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:52.732751  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.733379  1541 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:52.734206  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.734552  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.734742  1541 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.735097  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.735769  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:52.736780  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.735502  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:52.742336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.746065  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.747910  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.749472  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:52.747067  1683 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:59:52.758960  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.770193  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.733928  5099 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:52.774896  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.775230  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.732577  5063 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.775581  1683 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:52.777522  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.775928  1688 raft_consensus.cc:2393] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:52.781160  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.782543  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.783740  1688 raft_consensus.cc:2410] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:59:52.784209  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.785285  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:52.772907  5088 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:52.773473  4911 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:52.771064  5075 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.807328  1688 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:52.815623  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.812549  1541 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 12:59:52.813750  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 12:59:52.774811  5099 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.816618  1684 raft_consensus.cc:606] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:52.815596  1688 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:52.817041  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.817210  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:52.819677  1541 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.789335  5074 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.741770  5124 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:52.806499  4878 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.812572  5088 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.821696  5099 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.843055  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:59:52.845036  5088 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.855201  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.862100  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.862737  1537 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:52.824890  5074 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.862920  1609 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:52.863626  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.866804  1537 raft_consensus.cc:2368] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:52.867147  1610 raft_consensus.cc:606] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:52.867528  1610 raft_consensus.cc:614] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:52.864619  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:52.867717  1541 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:52.824759  5140 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:52.870419  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:52.874291  1656 leader_election.cc:400] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:52.874631  1656 leader_election.cc:403] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:59:52.825377  4911 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:52.871497  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.877279  1537 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:52.878305  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:52.879225  1537 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.873344  4974 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:52.886787  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 130015us
I20260709 12:59:52.891091  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.892381  4974 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:52.892932  4974 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.893572  4911 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.895344  5023 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:52.885635  5138 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:52.897495  1688 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.897959  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:52.898433  1688 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:52.899773  5144 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:59:52.885998  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:52.902521  1541 raft_consensus.cc:2410] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:52.877918  5075 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8.
I20260709 12:59:52.886680  1537 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:52.855230  4878 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.913599  1688 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:59:52.914121  1688 pending_rounds.cc:85] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 12:59:52.869139  5136 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.945393  4878 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:52.901407  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:52.965698  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:52.970980  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69776us
W20260709 12:59:52.966785  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.903080  5130 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.986050  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.921075  1688 pending_rounds.cc:107] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:59:52.991303  1688 raft_consensus.cc:2889] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:52.991765  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.905237  5134 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:53.003331  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.004900  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:52.909444  5138 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:53.008793  1541 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:59:53.008960  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.007773  5127 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:53.011298  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.000049  5023 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:53.011847  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:53.013180  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.988005  4974 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:52.972747  5035 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.060668  2305 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:59:53.070065  2305 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:53.072943  2309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 519) took 2422 ms (client timeout 2074 ms). Trace:
W20260709 12:59:53.074915  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.077626  5138 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:53.078465  5145 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 12:59:53.080612  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.010088  5090 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:53.075793  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64035us
W20260709 12:59:53.041744  5146 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:59:53.043535  5148 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:53.039917  5028 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:53.081662  2309 rpcz_store.cc:269] 0709 12:59:50.650616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.657327 (+  6711us) service_pool.cc:224] Handling call
0709 12:59:53.072750 (+2415423us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400475754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:53.072874 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013464320}
I20260709 12:59:53.082219  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.086688  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.084268  1536 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:53.088174  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.010289  5137 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.014179  5130 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.085414  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.094347  1688 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:53.085835  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:53.012730  4826 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.065948  5023 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:53.090286  2308 raft_consensus.cc:2368] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 12:59:53.090047  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.084996  5024 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.091816  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:53.099362  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:53.092602  1684 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:53.095835  2305 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:53.096179  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.066164  5140 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:53.089094  5028 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:53.097877  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:53.102146  2305 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:53.103664  2310 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.102263  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:53.099980  2309 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:53.090061  5136 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:53.091720  5075 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.104272  1536 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:53.107112  1684 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:53.095424  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:53.108439  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.108959  1685 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:53.109097  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:53.097921  5023 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.110139  2306 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:53.097788  5079 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.114658  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.114831  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.117836  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.126173  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:53.126538  1506 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.127293  5024 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.129362  2305 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:59:53.099570  4826 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.131402  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.138180  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.141532  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:53.110729  5137 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:53.116477  5079 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.116781  5157 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.146370  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.124243  5136 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.146667  1653 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:53.150193  1684 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:53.150835  1653 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:53.140300  5024 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:53.113741  5075 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.144766  4878 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:53.145658  5090 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.144464  5130 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.169974  2310 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 12:59:53.148025  5079 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.174157  4911 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:53.175077  4911 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.175591  4911 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:53.176716  5138 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.177292  5138 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.179412  5138 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:53.180590  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.155915  5137 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:53.185449  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 44030.4us
I20260709 12:59:53.186233  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.149492  5155 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:59:53.160733  5154 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:53.162210  4878 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.148382  5063 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:59:53.205677  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:53.200556  5152 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:59:53.201900  4833 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:53.154230  5140 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.201661  4911 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.202530  4878 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.189580  5130 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.189327  5154 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:53.195649  5153 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:59:53.207888  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.187922  5124 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.188208  4974 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:53.220541  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.210834  5137 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:53.222622  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 71871.3us
I20260709 12:59:53.188270  5138 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.226437  1506 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.227479  1683 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:53.237537  5103 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:53.237572  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.244725  1653 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:53.211045  5035 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:53.209630  4833 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:53.247637  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.243221  5100 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:59:53.250244  5073 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.250715  5104 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.227133  5160 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:53.278636  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.223228  5154 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.238883  5124 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.239120  5137 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.247218  5103 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:53.258603  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:53.260802  1683 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.277529  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1812) took 1747 ms. Trace:
W20260709 12:59:53.283452  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57095.2us
I20260709 12:59:53.288412  5137 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.290836  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.265810  4974 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:53.292042  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.214612  5099 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.279068  5104 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.278522  5130 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.278177  5108 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:53.281405  4224 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.283865  5073 consensus_queue.cc:1243] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:53.284030  5100 consensus_queue.cc:1243] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:53.259871  5138 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.290540  5035 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.290469  1532 rpcz_store.cc:276] 0709 12:59:51.530282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.530386 (+   104us) service_pool.cc:224] Handling call
0709 12:59:51.552940 (+ 22554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.553127 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:53.255984 (+1702857us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.277068 (+ 21084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.277139 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:53.277200 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.277292 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.277456 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1708034,"prepare.queue_time_us":1706599,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":9325,"raft.run_wall_time_us":7230,"spinlock_wait_cycles":3721472,"thread_start_us":15140,"threads_started":1,"wal-append.queue_time_us":15431}
I20260709 12:59:53.297282  5024 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:53.300997  5011 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.300724  5160 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:53.305907  4974 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:53.331436  1685 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 12:59:53.336984  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:53.341193  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:53.342003  2310 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:53.347198  1683 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:53.348157  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.350090  1683 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:53.313282  4826 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:53.350241  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:53.354067  1532 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 12:59:53.356170  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61400us
W20260709 12:59:53.358668  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.361385  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.362020  1685 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:53.309386  4224 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.366238  5161 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:53.375236  5161 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.375640  5161 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:53.376250  1506 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.649s (SENT)
I20260709 12:59:53.376706  1506 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:53.312358  5108 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.381423  5130 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.382483  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.384601  1683 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:53.366458  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.367151  1535 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:53.323333  5075 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:53.382781  5130 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.385004  5161 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.396260  5130 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.315886  5074 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.409430  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.322644  5035 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.449543  1685 raft_consensus.cc:2393] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:53.338158  5011 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.349517  5162 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:59:53.409065  4932 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:53.572299  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 196087us
I20260709 12:59:53.410254  5130 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:53.574946  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 238084us
I20260709 12:59:53.577507  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1815) took 1138 ms. Trace:
I20260709 12:59:53.578069  1533 rpcz_store.cc:276] 0709 12:59:52.439426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.439543 (+   117us) service_pool.cc:224] Handling call
0709 12:59:52.439820 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.440009 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:53.332012 (+892003us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.577112 (+245100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.577172 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:53.577263 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.577336 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.577453 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":816723,"prepare.queue_time_us":829967,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":319584,"threads_started":3,"wal-append.queue_time_us":236060}
I20260709 12:59:53.577443  1683 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:53.580554  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.581348  1683 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:53.600765  1533 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:53.603770  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:53.604707  1683 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:53.605742  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:53.606731  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2317) took 1064 ms. Trace:
I20260709 12:59:53.607142  1533 rpcz_store.cc:276] 0709 12:59:52.542808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.581834 (+1039026us) service_pool.cc:224] Handling call
0709 12:59:53.582130 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.601229 (+ 19099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.606679 (+  5450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.608739  1533 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:53.609337  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2318) took 1060 ms. Trace:
I20260709 12:59:53.398586  5079 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.613382  5175 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.617204  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1652) took 1292 ms. Trace:
I20260709 12:59:53.502190  5170 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:53.576361  5162 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.614200  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.609649  1533 rpcz_store.cc:276] 0709 12:59:52.548973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.608254 (+1059281us) service_pool.cc:224] Handling call
0709 12:59:53.608533 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.609127 (+   594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.609289 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.611469  5104 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.617745  1611 rpcz_store.cc:276] 0709 12:59:52.325073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.326390 (+  1317us) service_pool.cc:224] Handling call
0709 12:59:52.326645 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.364378 (+ 37733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.613672 (+1249294us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54003b7254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:53.617120 (+  3448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70010240}
I20260709 12:59:53.623570  1685 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:53.628382  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 178962us
I20260709 12:59:53.633639  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:53.634389  2310 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.628851  1533 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:59:53.636675  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2319) took 1086 ms. Trace:
I20260709 12:59:53.637079  1533 rpcz_store.cc:276] 0709 12:59:52.550733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.628120 (+1077387us) service_pool.cc:224] Handling call
0709 12:59:53.628544 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.636430 (+  7886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.636625 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.637950  4878 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:53.638513  1533 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:53.639138  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1830) took 1085 ms. Trace:
I20260709 12:59:53.639525  1533 rpcz_store.cc:276] 0709 12:59:52.553760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.637907 (+1084147us) service_pool.cc:224] Handling call
0709 12:59:53.638196 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.638909 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.639086 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.366539  5103 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.586330  4974 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:53.658202  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.626339  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:53.671066  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.639953  5169 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:59:53.617413  5130 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.695084  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.640929  1533 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:53.621157  5161 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:53.641296  5023 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 12:59:53.749956  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:53.650636  5088 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.002s
I20260709 12:59:53.752362  2309 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:53.678792  5136 consensus_meta.cc:287] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.525s	user 0.003s	sys 0.007s
I20260709 12:59:53.750481  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2321) took 1185 ms. Trace:
I20260709 12:59:53.763273  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:53.632297  5124 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:53.645870  5104 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:53.766600  1533 rpcz_store.cc:276] 0709 12:59:52.565004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.640380 (+1075376us) service_pool.cc:224] Handling call
0709 12:59:53.640682 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.750136 (+109454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.750406 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.644863  5138 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:53.806927  1533 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:53.807710  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2322) took 1239 ms. Trace:
I20260709 12:59:53.731923  4932 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.642675  5157 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:53.630330  5170 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:53.644129  5074 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:53.645438  5079 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:53.808045  1533 rpcz_store.cc:276] 0709 12:59:52.568659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.806333 (+1237674us) service_pool.cc:224] Handling call
0709 12:59:53.806706 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.807451 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.807658 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.875185  1533 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:53.875906  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1831) took 1247 ms. Trace:
I20260709 12:59:53.752038  4911 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:53.809376  1685 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:53.860284  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.746985  5176 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:53.876310  1533 rpcz_store.cc:276] 0709 12:59:52.628730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.874577 (+1245847us) service_pool.cc:224] Handling call
0709 12:59:53.874960 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.875650 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.875835 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.640146  4878 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:53.893944  5011 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:53.908160  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.806808  5136 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:53.923215  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.011s
I20260709 12:59:53.625350  5175 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:53.894652  5169 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:59:53.849408  5124 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:53.954967  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.011s
I20260709 12:59:53.630940  5162 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.782557  5023 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:53.764897  5130 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.023062  1685 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:53.964028  5175 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:53.894035  5079 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.974186  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1829) took 1435 ms. Trace:
I20260709 12:59:53.782828  5088 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.056798  2310 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:54.062875  1532 rpcz_store.cc:276] 0709 12:59:52.539061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.375537 (+836476us) service_pool.cc:224] Handling call
0709 12:59:53.376182 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.376808 (+   626us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:53.377579 (+   771us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.973741 (+596162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.973813 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:53.973874 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.973962 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.974113 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23382,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"raft.queue_time_us":88025,"thread_start_us":591842,"threads_started":1}
I20260709 12:59:54.075620  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:54.061111  1685 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:54.090550  1684 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:54.096347  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2328) took 1219 ms. Trace:
I20260709 12:59:54.096966  1532 rpcz_store.cc:276] 0709 12:59:52.877043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.077550 (+1200507us) service_pool.cc:224] Handling call
0709 12:59:54.095493 (+ 17943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.095888 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.095928 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.095985 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:54.096030 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.096104 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.096272 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.877170  4932 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.108989  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1819) took 1668 ms. Trace:
I20260709 12:59:54.110495  1539 rpcz_store.cc:276] 0709 12:59:52.440756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.451312 (+ 10556us) service_pool.cc:224] Handling call
0709 12:59:52.525356 (+ 74044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.540590 (+ 15234us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:53.269999 (+729409us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.315878 (+ 45879us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.338651 (+ 22773us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.338777 (+   126us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.338799 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.338845 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.108731 (+769886us) raft_consensus.cc:1685] finished
0709 12:59:54.108763 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.108924 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":731541,"prepare.queue_time_us":729605,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":12562,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":27298,"thread_start_us":58020,"threads_started":2,"wal-append.queue_time_us":115948}
I20260709 12:59:54.114822  1539 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:54.086936  4878 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:54.115397  4878 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:54.115458  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2329) took 1042 ms. Trace:
I20260709 12:59:54.116068  1539 rpcz_store.cc:276] 0709 12:59:53.073271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.114258 (+1040987us) service_pool.cc:224] Handling call
0709 12:59:54.114669 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.115204 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.115406 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.080127  5124 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:54.070641  5079 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.116408  4878 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.117635  5124 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.118461  5079 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.121474  5088 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.084450  5035 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:54.122210  5162 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.100694  5184 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.094786  5099 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.122936  5184 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.124598  5130 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.125700  5184 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.121942  4932 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:53.932869  5176 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.086190  5170 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:54.142273  5137 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.000s
I20260709 12:59:54.142904  5137 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.145080  1532 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:54.145533  5023 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.146876  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2331) took 1020 ms. Trace:
I20260709 12:59:54.148372  5176 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.148658  1532 rpcz_store.cc:276] 0709 12:59:53.126175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.132313 (+1006138us) service_pool.cc:224] Handling call
0709 12:59:54.144669 (+ 12356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.145865 (+  1196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.146799 (+   934us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:54.135263  5127 consensus_meta.cc:287] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.121s	user 0.008s	sys 0.003s
I20260709 12:59:54.157048  5127 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.157824  1540 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:54.176383  5137 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:54.131247  5154 consensus_meta.cc:287] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.000s
I20260709 12:59:54.167054  2309 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:54.180950  5154 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.192111  1540 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:54.195842  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1820) took 1754 ms. Trace:
I20260709 12:59:54.196350  1538 rpcz_store.cc:276] 0709 12:59:52.441032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.463186 (+ 22154us) service_pool.cc:224] Handling call
0709 12:59:52.662584 (+199398us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800002a98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 12:59:52.662772 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.662974 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:53.456485 (+793511us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.195142 (+738657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.195221 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:54.195292 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.195603 (+   311us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.195757 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":594388,"prepare.queue_time_us":607416,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":146991,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"spinlock_wait_cycles":4502400,"thread_start_us":936945,"threads_started":3,"wal-append.queue_time_us":577019}
W20260709 12:59:54.199124  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 572893us
I20260709 12:59:54.204178  1683 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:54.185853  4910 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:54.208245  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1520) took 1638 ms (client timeout 1649 ms). Trace:
W20260709 12:59:54.208667  1681 rpcz_store.cc:269] 0709 12:59:52.570063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.575318 (+  5255us) service_pool.cc:224] Handling call
0709 12:59:54.208044 (+1632726us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400119254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.208169 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248278912}
W20260709 12:59:54.253217  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.255496  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.195489  5133 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:54.283301  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.302888  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1839) took 1053 ms. Trace:
I20260709 12:59:54.303493  1537 rpcz_store.cc:276] 0709 12:59:53.249243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.208131 (+958888us) service_pool.cc:224] Handling call
0709 12:59:54.302175 (+ 94044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.302446 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:54.302486 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.302541 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:54.302586 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.302655 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.302814 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.307587  1681 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:54.310693  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1840) took 1018 ms. Trace:
I20260709 12:59:54.311056  1537 rpcz_store.cc:276] 0709 12:59:53.292390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.305593 (+1013203us) service_pool.cc:224] Handling call
0709 12:59:54.310097 (+  4504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.310318 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.310352 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.310405 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:54.310445 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.310507 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.310624 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.306265  4910 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:54.323549  2308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 486) took 1650 ms (client timeout 1682 ms). Trace:
W20260709 12:59:54.324170  2308 rpcz_store.cc:269] 0709 12:59:52.673555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.695861 (+ 22306us) service_pool.cc:224] Handling call
0709 12:59:54.323290 (+1627429us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54005a0fd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.323468 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792341376}
I20260709 12:59:54.343303  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1838) took 1095 ms. Trace:
I20260709 12:59:54.345696  1538 rpcz_store.cc:276] 0709 12:59:53.248041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.198522 (+950481us) service_pool.cc:224] Handling call
0709 12:59:54.202172 (+  3650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.202411 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:54.202793 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.342976 (+140183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.343028 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:54.343068 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.343129 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.343245 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5473,"prepare.queue_time_us":2546,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6705,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":132867,"threads_started":1}
I20260709 12:59:54.361761  5046 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:54.378361  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1836) took 1131 ms. Trace:
I20260709 12:59:54.379009  1532 rpcz_store.cc:276] 0709 12:59:53.247401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.154125 (+906724us) service_pool.cc:224] Handling call
0709 12:59:54.156569 (+  2444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.158752 (+  2183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.158794 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.160138 (+  1344us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.306163 (+146025us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:54.318970 (+ 12807us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.319177 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.319244 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.378045 (+ 58801us) raft_consensus.cc:1685] finished
0709 12:59:54.378075 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.378277 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12656,"prepare.run_wall_time_us":854,"raft.queue_time_us":2888,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":8485,"spinlock_wait_cycles":3195136,"thread_start_us":145556,"threads_started":1,"wal-append.queue_time_us":162950}
I20260709 12:59:54.391270  4993 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 12:59:54.391427  5106 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.392268  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 809) took 2841 ms. Trace:
I20260709 12:59:54.391881  4993 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.392652  2302 rpcz_store.cc:276] 0709 12:59:51.550623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.550750 (+   127us) service_pool.cc:224] Handling call
0709 12:59:52.615620 (+1064870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.616421 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.392051 (+1775630us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54005b22d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.392180 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2392819968}
I20260709 12:59:54.394124  4993 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.396348  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:54.397063  2308 raft_consensus.cc:2393] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:54.397472  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.397910  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.398167  2309 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:54.399266  2310 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:54.400533  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1824) took 1958 ms. Trace:
I20260709 12:59:54.400975  1536 rpcz_store.cc:276] 0709 12:59:52.442094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.137963 (+695869us) service_pool.cc:224] Handling call
0709 12:59:53.147671 (+  9708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.185428 (+ 37757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.185457 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.185499 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:53.185528 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.400335 (+1214807us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400074754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.400378 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.400483 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86397312}
W20260709 12:59:54.402331  5193 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:54.402572  2306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 813) took 1342 ms. Trace:
I20260709 12:59:54.402945  2306 rpcz_store.cc:276] 0709 12:59:53.060088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.060269 (+   181us) service_pool.cc:224] Handling call
0709 12:59:53.060566 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.113394 (+ 52828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.402351 (+1288957us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b5400494b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.402503 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113599744}
I20260709 12:59:54.403447  5133 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:54.406257  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.408855  5011 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.409363  5011 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.411429  5011 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.411901  5011 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:54.414757  5114 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 2.352s	user 0.004s	sys 0.005s
I20260709 12:59:54.417277  5011 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:54.418933  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1821) took 1977 ms. Trace:
I20260709 12:59:54.419306  1541 rpcz_store.cc:276] 0709 12:59:52.441289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.944552 (+503263us) service_pool.cc:224] Handling call
0709 12:59:52.944860 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.010449 (+ 65589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.418706 (+1408257us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b5400308c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.418877 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146282368}
I20260709 12:59:54.421180  5011 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:54.423177  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.392249  5106 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.428481  5154 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:54.430051  5120 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.259s	user 0.015s	sys 0.009s
I20260709 12:59:54.431231  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1805) took 2876 ms. Trace:
I20260709 12:59:54.431612  1690 rpcz_store.cc:276] 0709 12:59:51.554626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.556399 (+  1773us) service_pool.cc:224] Handling call
0709 12:59:51.579247 (+ 22848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.825389 (+246142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.825413 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.832244 (+  6831us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.050778 (+218534us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:52.050819 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.050886 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.408270 (+357384us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4800190158. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5db6bb37 00007f8d5db6b9ca 00007f8d5dc6326f 00007f8d5dc62f37 00007f8d5dc7755c 00007f8d5dc77508 00007f8d5dc77488 00007f8d5dc77443 00007f8d5dc766ec 00007f8d5cba0a96
0709 12:59:54.429504 (+2021234us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:54.431024 (+  1520us) raft_consensus.cc:1685] finished
0709 12:59:54.431043 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.431176 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29249,"raft.queue_time_us":177680,"raft.run_cpu_time_us":2757,"raft.run_wall_time_us":647126,"spinlock_wait_cycles":22029824,"thread_start_us":365953,"threads_started":2,"wal-append.queue_time_us":209552}
I20260709 12:59:54.433522  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.434221  1690 raft_consensus.cc:2393] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 6: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:54.434260  4224 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.435169  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.435734  1690 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:54.436753  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.437860  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.438795  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.439302  1690 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:54.440404  1690 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:54.441206  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1841) took 1101 ms. Trace:
I20260709 12:59:54.441856  4841 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.441607  1690 rpcz_store.cc:276] 0709 12:59:53.340277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.439841 (+1099564us) service_pool.cc:224] Handling call
0709 12:59:54.440102 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.440725 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.441160 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.443457  1690 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:54.443902  1690 pending_rounds.cc:85] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 2
I20260709 12:59:54.444137  1690 pending_rounds.cc:107] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:54.444387  1690 raft_consensus.cc:2889] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:54.444967  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 487) took 1365 ms. Trace:
I20260709 12:59:54.445561  1684 rpcz_store.cc:276] 0709 12:59:53.079578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.151046 (+ 71468us) service_pool.cc:224] Handling call
0709 12:59:53.167488 (+ 16442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.091097 (+923609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.444663 (+353566us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54002a58d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.444891 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122460032}
I20260709 12:59:54.450980  1684 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:54.448436  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:54.452476  2305 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:54.454838  1686 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:59:54.455183  1686 pending_rounds.cc:85] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 12:59:54.455413  1686 pending_rounds.cc:107] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:59:54.455626  1686 raft_consensus.cc:2889] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:54.446903  4224 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:54.452602  5109 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 2.454s	user 0.012s	sys 0.034s
I20260709 12:59:54.403936  5133 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.456203  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1845) took 1079 ms. Trace:
I20260709 12:59:54.470199  1686 rpcz_store.cc:276] 0709 12:59:53.380883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.454272 (+1073389us) service_pool.cc:224] Handling call
0709 12:59:54.454532 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.455993 (+  1461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.456159 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.457331  4224 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.457389  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2312) took 1921 ms. Trace:
I20260709 12:59:54.472723  1535 rpcz_store.cc:276] 0709 12:59:52.535792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.143886 (+608094us) service_pool.cc:224] Handling call
0709 12:59:53.144115 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.394883 (+250768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.457155 (+1062272us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400309b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.457335 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512507648}
I20260709 12:59:54.458724  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 524) took 2949 ms. Trace:
I20260709 12:59:54.474098  2303 rpcz_store.cc:276] 0709 12:59:51.509069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.545374 (+ 36305us) service_pool.cc:224] Handling call
0709 12:59:51.545691 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.563759 (+ 18068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.563793 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.586295 (+ 22502us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.773823 (+187528us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:51.773872 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.773958 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.451834 (+2677876us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:54.458358 (+  6524us) raft_consensus.cc:1685] finished
0709 12:59:54.458391 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.458644 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3538,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":11155,"spinlock_wait_cycles":60731136,"thread_start_us":106745,"threads_started":1,"wal-append.queue_time_us":407391}
I20260709 12:59:54.475332  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1817) took 2194 ms. Trace:
I20260709 12:59:54.475684  1689 rpcz_store.cc:276] 0709 12:59:52.281099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.281214 (+   115us) service_pool.cc:224] Handling call
0709 12:59:52.299384 (+ 18170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.351554 (+ 52170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.475118 (+2123564us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b540032e1d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.475277 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118621824}
I20260709 12:59:54.477439  4224 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.459482  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1837) took 1211 ms. Trace:
W20260709 12:59:54.479991  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1657) took 2068 ms (client timeout 1995 ms). Trace:
I20260709 12:59:54.459246  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1844) took 1083 ms. Trace:
I20260709 12:59:54.481093  1684 rpcz_store.cc:276] 0709 12:59:53.376471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.450323 (+1073852us) service_pool.cc:224] Handling call
0709 12:59:54.450751 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.458947 (+  8196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.459183 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.461018  5133 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:54.482218  5125 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 2.201s	user 0.000s	sys 0.020s
W20260709 12:59:54.482388  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.461340  5028 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.483387  5028 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.445111  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1842) took 1104 ms. Trace:
I20260709 12:59:54.462015  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.485848  1690 rpcz_store.cc:276] 0709 12:59:53.340522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.442868 (+1102346us) service_pool.cc:224] Handling call
0709 12:59:54.443154 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.444914 (+  1760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.445067 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.463209  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1815) took 2183 ms. Trace:
I20260709 12:59:54.487192  1687 rpcz_store.cc:276] 0709 12:59:52.279536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.279799 (+   263us) service_pool.cc:224] Handling call
0709 12:59:52.299352 (+ 19553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.385999 (+ 86647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.463002 (+2077003us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b54001a5254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.463155 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145318912}
I20260709 12:59:54.486784  2302 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:54.463812  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1822) took 1180 ms. Trace:
I20260709 12:59:54.489260  1683 rpcz_store.cc:276] 0709 12:59:53.283391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.606720 (+323329us) service_pool.cc:224] Handling call
0709 12:59:53.607106 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.204611 (+597505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.463592 (+258981us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400394254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.463759 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372756224}
I20260709 12:59:54.466060  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:54.490947  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:54.491698  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:54.492759  5011 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:54.492817  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:54.493327  5011 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:54.493777  4224 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:54.494160  4224 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.494679  4224 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.494185  5011 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.467509  5063 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.462749  4833 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.496516  5063 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.497373  4833 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.498286  5095 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.468873  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:54.498718  5095 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.499012  2310 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.499091  5095 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:54.504724  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.507440  5070 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.510471  5103 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.513399  5106 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.514153  4393 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.514271  5106 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.514796  4393 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.515357  4393 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.469810  5154 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.516809  5154 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:54.467394  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.479092  5027 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:59:54.460016  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2272) took 1926 ms (client timeout 1949 ms). Trace:
W20260709 12:59:54.521461  1608 rpcz_store.cc:269] 0709 12:59:52.533413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.533632 (+   219us) service_pool.cc:224] Handling call
0709 12:59:54.459838 (+1926206us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b54002b5554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.459962 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166968064}
I20260709 12:59:54.469692  5030 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.529224  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.529835  1535 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:54.531410  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.531989  1690 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:54.535341  2307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 485) took 1862 ms (client timeout 1507 ms). Trace:
W20260709 12:59:54.535774  2307 rpcz_store.cc:269] 0709 12:59:52.673295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.535140 (+1861845us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:54.535263 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:54.536612  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.537238  1684 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:54.539011  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:54.539407  2307 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:59:54.539755  5074 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:54.540673  5074 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:54.541064  5074 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.541455  5074 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.468472  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:54.543371  4914 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.543644  4911 consensus_queue.cc:1059] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:54.544467  4911 consensus_queue.cc:1243] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:54.544883  4911 raft_consensus.cc:3055] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:54.545169  4911 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:54.545919  4911 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.546995  4911 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:54.547149  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2278) took 1998 ms (client timeout 2027 ms). Trace:
W20260709 12:59:54.547696  1609 rpcz_store.cc:269] 0709 12:59:52.549182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.549297 (+   115us) service_pool.cc:224] Handling call
0709 12:59:54.546954 (+1997657us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001b2954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.547081 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361403136}
I20260709 12:59:54.548499  5178 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:54.548875  5178 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:54.549825  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.549721  5178 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:54.550309  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.550899  5178 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.553257  1435 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 5, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.555202  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:54.555827  5163 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.486801  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51296 (request call id 15) took 1644 ms. Trace:
I20260709 12:59:54.556313  5163 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.556888  5155 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:54.557397  5155 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 12:59:54.556704  2301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 811) took 2890 ms (client timeout 1697 ms). Trace:
I20260709 12:59:54.558125  5155 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:54.558549  2301 rpcz_store.cc:269] 0709 12:59:51.667622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.667775 (+   153us) service_pool.cc:224] Handling call
0709 12:59:54.556505 (+2888730us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54006702d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.556633 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512109824}
I20260709 12:59:54.559154  5155 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:54.559347  1687 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:54.560771  5163 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.561280  5063 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:54.562235  5108 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.562709  1535 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.564137  5154 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:54.555352  1435 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.556793  1610 rpcz_store.cc:276] 0709 12:59:52.842791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.842921 (+   130us) service_pool.cc:224] Handling call
0709 12:59:54.486607 (+1643686us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54001b2954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c45853 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.486711 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24709888}
W20260709 12:59:54.480522  1615 rpcz_store.cc:269] 0709 12:59:52.411508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.411627 (+   119us) service_pool.cc:224] Handling call
0709 12:59:54.479821 (+2068194us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54002b5a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.479928 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110949632}
W20260709 12:59:54.467202  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.008s	sys 0.020s
W20260709 12:59:54.570444  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.008s	sys 0.020s
I20260709 12:59:54.571282  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:54.572576  1688 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:59:54.572937  1688 pending_rounds.cc:85] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 12:59:54.573153  1688 pending_rounds.cc:107] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:59:54.573382  1688 raft_consensus.cc:2889] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:54.575897  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 486) took 1496 ms. Trace:
I20260709 12:59:54.576279  1535 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:54.576339  1688 rpcz_store.cc:276] 0709 12:59:53.079346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.101174 (+ 21828us) service_pool.cc:224] Handling call
0709 12:59:53.101429 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.573811 (+1472382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.575654 (+  1843us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400393354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.575842 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3382697344}
I20260709 12:59:54.581095  4989 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:54.581887  4983 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.582544  4983 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.581840  4989 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:54.584088  4989 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.508090  5070 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.587760  5070 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:54.588668  5108 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:54.590550  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:54.591192  1539 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:54.598613  2305 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:54.599052  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.599435  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:54.600111  1536 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.601069  4846 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:54.604962  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:54.605122  4224 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.605566  1535 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:54.607074  4224 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:54.539414  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.609426  1532 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:54.609421  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:54.610162  1538 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:54.610517  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.610178  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:54.616005  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.617990  1538 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:54.479645  1540 rpcz_store.cc:276] 0709 12:59:53.247736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.258360 (+ 10624us) service_pool.cc:224] Handling call
0709 12:59:54.459329 (+1200969us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540040d3d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.459429 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996504320}
I20260709 12:59:54.623149  2310 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:54.632360  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.633198  1653 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:54.642463  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.652376  1435 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.633476  1688 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:54.657493  1690 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
W20260709 12:59:54.658555  5033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.587s	user 0.028s	sys 0.024s
I20260709 12:59:54.659098  5104 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.658360  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:54.662503  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.663981  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:54.661671  1534 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:54.666529  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.666810  1540 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:54.667621  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.667667  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.661302  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1832) took 1361 ms. Trace:
I20260709 12:59:54.668869  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:54.665664  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 62027.3us
I20260709 12:59:54.660807  1435 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 1 to 5, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.681442  1539 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:54.658725  5088 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.685442  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.730176  2305 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
W20260709 12:59:54.686484  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 53363.5us
W20260709 12:59:54.688031  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1825) took 2219 ms (client timeout 1784 ms). Trace:
W20260709 12:59:54.731397  1534 rpcz_store.cc:269] 0709 12:59:52.468870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.661549 (+192679us) service_pool.cc:224] Handling call
0709 12:59:54.687804 (+2026255us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400075654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:54.687947 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4525985024}
I20260709 12:59:54.732470  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.733101  1534 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:54.735304  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.689358  1535 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:54.690455  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.737011  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:54.737640  1687 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:54.728875  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.691272  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.738626  1540 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:54.660812  5033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.589s	user 0.028s	sys 0.024s
I20260709 12:59:54.659286  5059 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.695845  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.685874  5136 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.696264  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.697436  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.729424  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.742416  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:54.742727  2307 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:59:54.668952  1685 rpcz_store.cc:276] 0709 12:59:53.299923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.083312 (+783389us) service_pool.cc:224] Handling call
0709 12:59:54.083679 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.083950 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:54.317556 (+233606us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.660947 (+343391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.661019 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:54.661064 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.661127 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.661234 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257951,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":159,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2994,"thread_start_us":555367,"threads_started":2}
I20260709 12:59:54.698302  5154 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.717667  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.743834  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.744318  2310 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:54.671134  5070 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.720309  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:54.668416  5063 raft_consensus.cc:2764] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:54.676721  5180 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.669541  5157 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.514797  5106 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.786945  5106 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:54.787227  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 243) took 36607 ms (client timeout 15000 ms). Trace:
I20260709 12:59:54.787567  5100 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:54.722981  1536 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:54.676385  5176 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.684885  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.741253  1532 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 12:59:54.717955  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.747728  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:54.748974  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:54.795241  2302 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:54.668761  5163 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:59:54.699934  5028 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:54.754124  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.796037  1687 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.756368  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.757305  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.760841  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:54.748546  4804 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.771118  4917 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.740711  5088 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.668529  5104 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.808483  1532 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:54.752487  5136 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.775100  4393 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.753396  5154 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.778228  4983 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.750402  5059 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.751727  4826 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:54.759395  5155 consensus_queue.cc:1059] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:54.839191  1689 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:54.722957  1686 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:59:54.839861  1686 pending_rounds.cc:85] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 12:59:54.840098  1686 pending_rounds.cc:107] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:59:54.840355  1686 raft_consensus.cc:2889] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:54.809217  5070 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.809870  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:54.810407  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 272939us
I20260709 12:59:54.813443  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:54.847026  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 354288us
I20260709 12:59:54.806280  4804 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:54.835632  1579 connection.cc:256] RPC call timeout handler was delayed by -1.1673131370000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 12:59:54.812122  5028 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:54.830087  1687 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:54.797348  1685 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
W20260709 12:59:54.853555  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 43762.1us
I20260709 12:59:54.854246  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:54.818188  1681 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:54.854653  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:54.854521  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 497) took 1149 ms. Trace:
I20260709 12:59:54.855129  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.855551  1686 rpcz_store.cc:276] 0709 12:59:53.705246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.470928 (+765682us) service_pool.cc:224] Handling call
0709 12:59:54.471178 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.847493 (+376315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.854305 (+  6812us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001a5c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.854474 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578281344}
I20260709 12:59:54.856142  1612 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:54.847685  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.857098  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.857427  1690 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:54.858875  1690 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:54.858074  1687 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:54.860008  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.861279  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:54.861912  1611 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.863451  1688 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:54.863898  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:54.865181  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.806768  5157 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.809971  5063 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:54.866693  1614 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:54.867359  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1840) took 1527 ms. Trace:
I20260709 12:59:54.866715  1610 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:54.874523  1681 rpcz_store.cc:276] 0709 12:59:53.340010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.308349 (+968339us) service_pool.cc:224] Handling call
0709 12:59:54.308580 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.854987 (+546407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.867136 (+ 12149us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400119254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:54.867305 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171482880}
I20260709 12:59:54.813073  4833 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:54.876714  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.877887  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.878456  1609 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 5.
I20260709 12:59:54.809388  5176 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.844588  5070 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.867269  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.879206  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:54.880285  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:54.885730  1615 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:54.886073  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.880587  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:54.886756  1612 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:54.876245  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.881269  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.887209  1608 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:54.852607  4804 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.888926  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.889488  1613 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:54.812286  4917 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.884291  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:54.787631  1436 rpcz_store.cc:269] 0709 12:59:18.179727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.238381 (+ 58654us) service_pool.cc:224] Handling call
0709 12:59:20.485457 (+2247076us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5400190b90. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b270b2 00007f8d5eaa0a89 00007f8d5ea38da6 00007f8d5ea0a088 00007f8d5eb0837e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc
0709 12:59:54.787007 (+34301550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:44.596469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:44.609946 (+ 13477us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:44.609999 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:59:44.610017 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:44.611362 (+  1345us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:44.611439 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:44.611465 (+    26us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:59:44.807056 (+195591us) tablet.cc:701] Row locks acquired
0709 12:59:44.807112 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:59:44.807280 (+   168us) write_op.cc:270] Start()
0709 12:59:44.807445 (+   165us) write_op.cc:276] Timestamp: P: 1783601984807213 usec, L: 0
0709 12:59:44.807471 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:59:44.808245 (+   774us) log.cc:844] Serialized 5955 byte log entry
0709 12:59:44.814319 (+  6074us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d55b410ac 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b
0709 12:59:45.966177 (+1151858us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:46.571437 (+605260us) op_driver.cc:464] REPLICATION: finished
0709 12:59:47.691819 (+1120382us) write_op.cc:301] APPLY: starting
0709 12:59:47.753284 (+ 61465us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:47.800521 (+ 47237us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:47.800569 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:47.802413 (+  1844us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:47.802788 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:59:47.802848 (+    60us) write_op.cc:312] APPLY: finished
0709 12:59:47.803252 (+   404us) log.cc:844] Serialized 107 byte log entry
0709 12:59:47.923524 (+120272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:47.936071 (+ 12547us) write_op.cc:454] Released schema lock
0709 12:59:47.957617 (+ 21546us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:47.976710 (+ 19093us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:47.976761 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4796947,"reported_tablets":42,"spinlock_wait_cycles":5112576,"child_traces":[["op",{"apply.queue_time_us":1063274,"apply.run_cpu_time_us":10841,"apply.run_wall_time_us":303394,"num_ops":15,"prepare.queue_time_us":858266,"prepare.run_cpu_time_us":28076,"prepare.run_wall_time_us":621762,"raft.queue_time_us":359429,"raft.run_cpu_time_us":24784,"raft.run_wall_time_us":688764,"replication_time_us":1725500,"spinlock_wait_cycles":139807360,"thread_start_us":1259715,"threads_started":5,"wal-append.queue_time_us":1031818,"wal-append.run_cpu_time_us":19469,"wal-append.run_wall_time_us":2816573}]]}
I20260709 12:59:54.887929  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.848783  5030 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.804404  5180 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.883651  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.918735  1616 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 12:59:54.858506  5134 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.852905  4826 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:54.894603  1610 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:54.895378  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.924667  1614 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:59:54.898528  5200 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:59:54.899173  5208 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:59:54.901239  5136 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.902055  1611 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:54.902838  4990 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:54.947556  4990 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:54.947883  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1835) took 2263 ms. Trace:
I20260709 12:59:54.948050  4990 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:54.948417  1533 rpcz_store.cc:276] 0709 12:59:52.684913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.923672 (+1238759us) service_pool.cc:224] Handling call
0709 12:59:53.924008 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.924601 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:54.021765 (+ 97164us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.546390 (+524625us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b1800350740. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a 00007f8d58c55a2a
0709 12:59:54.677532 (+131142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.678076 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.678208 (+   132us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:54.678242 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.678307 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.947590 (+269283us) raft_consensus.cc:1685] finished
0709 12:59:54.947688 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.947825 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11684,"prepare.queue_time_us":87849,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4623,"raft.queue_time_us":109437,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":12412,"spinlock_wait_cycles":10648448,"thread_start_us":118943,"threads_started":1,"wal-append.queue_time_us":668378}
I20260709 12:59:54.949317  4990 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.903952  4224 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:54.952404  4224 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:54.952566  5157 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:54.904776  5197 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:54.952895  4224 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:54.848793  4983 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:59:54.877434  5065 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:54.877686  5155 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:54.868671  5042 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.909541  5075 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:54.909397  5074 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.866274  5171 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:54.922300  4846 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:54.926157  1683 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:59:54.928764  5104 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.928891  5033 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.930842  1607 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.932710  4826 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.933647   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:54.919607  4914 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.934010  5119 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:54.936046  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:54.938061  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:55.028957  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 90970.2us
I20260709 12:59:54.920979  5030 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:54.942612  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.943109  4804 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.944295  5134 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.905119  5105 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:54.950981  4990 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.036805  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.037420  1613 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:55.014038  5065 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:55.039414  4804 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.004719  4910 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:59:54.954422  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1834) took 1641 ms. Trace:
I20260709 12:59:54.953373  5108 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:59:55.007413  5051 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:55.040985  5108 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:55.041393  5108 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:54.890538  5070 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.031319  4914 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.995874  5163 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:59:55.044785  4914 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:54.958663  1539 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:55.017817  5155 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:55.045397   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:54.957811  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.046317  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:54.957865  5180 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.046870  1690 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.958528  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.048518  1540 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:54.959452  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:54.960106  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:54.961083  5176 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.962958  4917 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:54.963371  5028 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.967736  5059 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.008219  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:55.010813  2302 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:55.015668  1683 pending_rounds.cc:85] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 12:59:55.018956  2304 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:59:54.913252  5095 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:54.932049  1579 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:55.032563  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.007669  5075 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:55.035313  5077 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.039089  5065 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.017937  5042 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.045876  5155 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:54.975509  1538 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 12:59:54.977381  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.003790  1615 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 12:59:55.050348  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:55.061060  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 101698us
I20260709 12:59:55.040488  1682 rpcz_store.cc:276] 0709 12:59:53.313468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.203896 (+890428us) service_pool.cc:224] Handling call
0709 12:59:54.233285 (+ 29389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.233556 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:54.706858 (+473302us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.953990 (+247132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:54.954060 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:54.954119 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.954217 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.954356 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123037,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":91,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":646767,"threads_started":2}
I20260709 12:59:55.020929  5171 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:55.108897  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.198453  1610 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 12:59:55.120841  1506 leader_election.cc:336] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.743s (SENT)
I20260709 12:59:55.199812  1612 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:55.200404  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.200948  1537 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:55.198645  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:55.201565  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 80773.5us
W20260709 12:59:55.202055  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 300188us
I20260709 12:59:55.202818  1504 leader_election.cc:400] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 12:59:55.203591  1504 leader_election.cc:403] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:55.189795  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.204541  1611 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:55.198079  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:55.201514  1614 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:55.213683  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.224735  1685 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.140669  1607 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:55.214260  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 282310us
I20260709 12:59:55.205302  1683 pending_rounds.cc:107] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:55.227166  1683 raft_consensus.cc:2889] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.103372  1690 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:55.216683  2310 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 12:59:55.215039  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:55.220517  1506 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.842s (SENT)
I20260709 12:59:55.229336  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:55.222779  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.235241  1504 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.065740  5063 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.048209  5074 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.237783  1614 raft_consensus.cc:1217] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 12:59:55.249251  1614 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:59:55.204185  5077 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.246853  1685 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:55.247833  1609 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:55.165597  5088 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:55.136214  4914 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.189579  5154 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.203392  5136 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:55.250308  5063 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.264936  5063 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.155400  4224 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.266330  4224 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.266636  5042 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.238389  5123 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:55.224814  4846 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:55.269964  5136 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:55.270565  4846 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:55.270987  4846 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:55.271164  5096 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:55.245803  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 391629us
I20260709 12:59:55.212384  4983 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.272920  5134 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.274947  5095 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.250187  5163 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.277685  5163 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.280488  4983 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 12:59:55.256361  1607 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:55.250927  5157 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:55.282192  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:55.283094  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:55.283812  5063 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:55.284356  5063 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:55.028713  5033 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.231761  5160 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.233913  5011 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.232532  5180 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.260026  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.247848  4989 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.288172  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.292575  1537 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:55.289645  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.292675  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.293205  1540 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 5.
I20260709 12:59:55.256872  5077 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.290537  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.296411  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.089756  4917 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.285296  5063 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:55.301843  5212 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:55.308601  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.318101  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.329326  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.330725  1506 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.331950  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.291482  5103 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:55.289934  5163 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:55.386265  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54390.8us
I20260709 12:59:55.390339  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:55.391812  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:55.387270  5136 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.271811  4846 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.401302  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.292789  5070 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.295483  4989 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:55.417364  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:55.410753  1656 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 1.580s (SENT) [suppressed 20 similar messages]
I20260709 12:59:55.394940  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:55.389115  5160 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:55.388533  5030 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:55.411190  5202 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:59:55.298949  5180 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.262336  4914 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:55.429206  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 190680us
I20260709 12:59:55.431409  1613 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:55.419610  4846 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.403165  5103 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:55.420403  4989 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.435638  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:55.426332  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.425800  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 190687us
I20260709 12:59:55.440447  1612 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:55.428293  5030 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:55.512389  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:55.522300  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 170082us
I20260709 12:59:55.523275  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:55.511893  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 77664.4us
I20260709 12:59:55.441664  5157 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:55.545475  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 150012us
I20260709 12:59:55.550235  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:55.553351  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:55.434341  5106 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:59:55.524441  4983 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:55.513540  5160 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.533998  5136 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.576891  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:55.566354  5202 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:59:55.518133  5095 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:55.583503  1612 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:55.584987  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.594897  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:55.600829  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:55.598276  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.603058  1685 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:55.603137  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.577347  5030 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.606937  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:55.555812  5206 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:59:55.604085  1534 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:55.578212  4983 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:55.607705  2304 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:55.627452  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.572855  5160 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.618114  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:55.608882  5074 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.601830  5226 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:55.643813  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 233088us
I20260709 12:59:55.605296  5176 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.655828  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.656517  1685 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:55.649978  5226 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.639142  5227 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.616137  5206 consensus_queue.cc:1243] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:55.648077  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.648041  1612 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:55.616271  5155 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:55.605023  5028 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:59:55.675122  5070 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.675450  4914 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.676167  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:55.675930  4983 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.676501  5075 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.677977  5075 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.678643  5160 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.614725  5103 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.683363  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.653916  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.685025  1611 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:55.685093  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:55.616066  5042 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:55.607447  5220 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:59:55.646720  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 118673us
I20260709 12:59:55.658792  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.659283  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.660750  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:55.661866  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.662336  5226 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.662917  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.692051  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.692737  1686 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:55.692694  1685 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:55.666105  1536 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:55.664040  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:55.693986  5222 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:59:55.694348  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:55.694864  5106 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.695226  5163 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.695609  5163 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.695979  5163 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:55.696883  5223 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:59:55.698783  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:55.699337  1532 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:55.621378  5128 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.703593  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.616288  5065 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:55.684015  1607 raft_consensus.cc:2376] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7. Re-sending same reply.
I20260709 12:59:55.689487  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.639149  5216 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:55.696239  5231 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:59:55.695247  5246 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:55.696707  5106 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:55.617221  5030 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.700479  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.723619  1615 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.677214  5033 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:55.701601  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.724650  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.702121  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:55.725246  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.726631  1612 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:55.702224  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:55.684465  5224 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:59:55.656456  5074 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 12:59:55.718116  5234 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:59:55.715764  5240 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.713979  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.662855  5227 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:55.740319  5214 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.485s	user 0.004s	sys 0.000s
I20260709 12:59:55.740922  5227 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.715293  1532 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 12:59:55.666265  5180 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.722469  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:55.743134  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:55.744326  1538 raft_consensus.cc:2393] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:55.744486  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 12:59:55.730269  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.713034  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.704434  5242 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:55.745848  1534 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
W20260709 12:59:55.721350  5217 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:59:55.708149  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.716701  5063 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.735754  5095 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:55.738608  5235 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:55.720253  5070 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.746723  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:55.746712  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.748051  1615 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:55.754460  5104 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.754245  5028 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.754268  5063 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.760759  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.761624  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.762166  4833 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.762888  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1549) took 1096 ms. Trace:
I20260709 12:59:55.768325  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.770423  5077 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.718277  5216 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.687260  5155 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.873651  1684 rpcz_store.cc:276] 0709 12:59:54.666749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.667158 (+   409us) service_pool.cc:224] Handling call
0709 12:59:54.688883 (+ 21725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.718439 (+ 29556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.718475 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.718970 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.894149 (+175179us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:54.964360 (+ 70211us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.964827 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.964899 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.739763 (+774864us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 12:59:55.742045 (+  2282us) raft_consensus.cc:1685] finished
0709 12:59:55.762643 (+ 20598us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.762811 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8538,"prepare.queue_time_us":61535,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":30096,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9918,"spinlock_wait_cycles":5607296,"thread_start_us":164712,"threads_started":1,"wal-append.queue_time_us":453504}
I20260709 12:59:55.838155  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.884414  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.839859  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:55.872392  1685 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:55.852218  1611 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:59:55.873411  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 92745.6us
W20260709 12:59:55.871270  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.876144  1688 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 12:59:55.878087  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.889051  1539 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:55.715142  5128 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.771751  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.885316  1532 raft_consensus.cc:2410] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:55.745503  5240 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.744758  5106 consensus_queue.cc:1243] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:55.868759  5160 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.889110  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.910578  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:55.911669  2307 raft_consensus.cc:2410] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:55.908365  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 12:59:55.900708  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:55.902763  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.902906  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.890362  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:55.868588  5227 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.906482  1535 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:55.872859  5028 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.916093  1539 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:55.832465  4911 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.848798  5059 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.877861  5104 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.927074  5104 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.884032  4833 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.929097  4833 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.929761  1534 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:55.931113  1534 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:55.893095  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:55.868536  5242 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:55.897519  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:55.916478  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:55.871938  5095 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:55.921873  5160 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:55.925451  1539 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:55.925825  5103 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.904059  5042 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:55.926106  5128 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:55.837327  4989 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:55.883797  5070 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.932199  1534 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:55.934824  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:55.950114  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:55.926261  4911 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.935436  1539 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:55.951747  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:55.956275  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.926246  5063 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:55.965039  1611 raft_consensus.cc:2376] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9. Re-sending same reply.
I20260709 12:59:55.942842  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:55.968791  2307 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:55.909163  5240 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.912526  5252 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:55.943415  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.978046  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:55.962965  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.979691  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:55.933274  2306 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:55.969144  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:55.965297  1539 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:55.933271  5028 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.966424  4911 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.972951  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:55.917658  4983 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.945677  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:55.974709  5232 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:55.964730  1608 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:55.934983  5106 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:55.942647  5238 log.cc:927] Time spent T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 12:59:55.960306  5070 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:55.970575  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 276092us
I20260709 12:59:56.013361  4983 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.964358  5206 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.976833  1534 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:56.011757  1684 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 12:59:55.961287  5220 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:55.935976  5160 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.933683  5065 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:59:56.042702  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:56.082252  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 242463us
I20260709 12:59:55.936916  5128 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:59:55.935702  5103 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:56.049981  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 149408us
I20260709 12:59:55.935703  5059 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.912312  5245 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:59:56.051429  1608 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:55.938174  5104 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:55.940066  4989 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:55.913682  5074 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.013875  5030 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:56.017493  5244 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.974961  5096 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:59:56.083874  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:56.054260  5232 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.120987  5232 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:55.936823  5042 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.089726  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:56.125177  2276 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 12:59:56.090096  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.938795  5108 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.127573  5108 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.053563  5106 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.934262  5095 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.056954  5063 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.932986  5242 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.066869  4983 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.988863  5252 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.066377  5206 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:56.086824  5011 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.000s
I20260709 12:59:56.150701  1540 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:56.170972  1533 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:56.172438  1539 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:56.175511  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:56.131946  5243 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:59:56.183008  1611 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:56.132719  5229 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:59:56.166443  5063 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.132030  5106 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:56.116860  5244 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:56.216408  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1675) took 1350 ms (client timeout 1794 ms). Trace:
I20260709 12:59:56.152041  5128 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.194574  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:56.174052  5206 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:56.160993  5030 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:56.168525  4833 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:56.198181  5262 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:56.200634  5261 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:56.201102  5250 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:56.198297  5063 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:56.197522  5075 consensus_meta.cc:287] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.004s
I20260709 12:59:56.203433  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:56.206055  4917 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.887s	user 0.008s	sys 0.001s
W20260709 12:59:56.208150  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.189328  5077 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:56.209250  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 509) took 1167 ms. Trace:
I20260709 12:59:56.179726  5163 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.350989  1687 rpcz_store.cc:276] 0709 12:59:55.041668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.041819 (+   151us) service_pool.cc:224] Handling call
0709 12:59:55.042149 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.199018 (+156869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.199049 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.205180 (+  6131us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.436293 (+231113us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:55.436351 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.436450 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.209043 (+772593us) raft_consensus.cc:1685] finished
0709 12:59:56.209065 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.209191 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22426,"raft.queue_time_us":157002,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5963,"thread_start_us":185486,"threads_started":1,"wal-append.queue_time_us":644831}
I20260709 12:59:56.211701  5228 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:56.213219  4224 consensus_meta.cc:287] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.946s	user 0.012s	sys 0.000s
I20260709 12:59:56.213819  5119 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:56.182768  5011 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:56.224650  5244 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:56.216912  1609 rpcz_store.cc:269] 0709 12:59:54.866406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.879008 (+ 12602us) service_pool.cc:224] Handling call
0709 12:59:56.209316 (+1330308us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54002b5554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:56.216324 (+  7008us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819180928}
I20260709 12:59:56.226727  1611 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.232337  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.232520  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.362766  2301 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:56.233094  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.233999  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.364149  1613 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 12:59:56.364866  2305 raft_consensus.cc:2410] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:56.234905  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 12:59:56.237040  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 257471us
I20260709 12:59:56.236954  5266 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:56.237859  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 265171us
I20260709 12:59:56.238061  5278 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:56.239916  4914 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:56.239822  5157 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:56.241153  1538 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:56.244377  2303 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:56.245796  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:56.246361  2310 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:56.373874  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:56.246547  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 121494us
I20260709 12:59:56.248600  2308 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:56.374537  1538 raft_consensus.cc:2376] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10. Re-sending same reply.
I20260709 12:59:56.370638  1614 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:56.375479  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:56.251075  2309 pending_rounds.cc:85] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 7
I20260709 12:59:56.376567  2309 pending_rounds.cc:107] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:59:56.376905  2309 raft_consensus.cc:2889] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.265166  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:56.266230  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:56.378815  1681 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:56.379151  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:56.379837  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:56.380614  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:56.381311  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:56.381637  1686 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 12:59:56.289682  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 308478us
I20260709 12:59:56.384457  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:56.385471  1538 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 12:59:56.385702  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.291956  1533 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:56.295111  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.336592  1690 raft_consensus.cc:2410] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:56.353780  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2346) took 1021 ms. Trace:
I20260709 12:59:56.230789  5180 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.368584  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:56.423115  1609 raft_consensus.cc:2376] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8. Re-sending same reply.
I20260709 12:59:56.248169  5273 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.388986  1541 rpcz_store.cc:276] 0709 12:59:55.332589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.332730 (+   141us) service_pool.cc:224] Handling call
0709 12:59:55.397341 (+ 64611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.397559 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.397584 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.401537 (+  3953us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.578372 (+176835us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:55.578444 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.578573 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.353467 (+774894us) raft_consensus.cc:1685] finished
0709 12:59:56.353497 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.353701 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":149485,"threads_started":1,"wal-append.queue_time_us":542152}
I20260709 12:59:56.427724  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:56.304354  4833 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.310621  5262 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.392030  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.229975  5128 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.396287  1612 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:59:56.449517  1612 pending_rounds.cc:85] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 6
I20260709 12:59:56.449815  1612 pending_rounds.cc:107] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:56.396842  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.397274  2308 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:59:56.397884  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:56.400756  5103 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:56.401554  5106 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.405412  5252 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:56.408670  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:56.357452  5259 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:56.412606  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:56.413439  5155 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:56.414110  4846 consensus_meta.cc:287] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.969s	user 0.012s	sys 0.000s
I20260709 12:59:56.414588  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:56.414821  1507 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:56.540604  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 125890us
I20260709 12:59:56.541465  1507 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:56.415755  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2353) took 1012 ms. Trace:
I20260709 12:59:56.415940  5240 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.304724  5030 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.355492  4917 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:56.416986  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 498) took 1898 ms. Trace:
I20260709 12:59:56.437793  5136 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 12:59:56.418499  5213 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.165s	user 0.002s	sys 0.000s
I20260709 12:59:56.358017  5228 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:56.364527  5216 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:56.421343  2302 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:56.309728  5059 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:56.373608  1540 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:56.420192  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:56.428551  1611 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 12:59:56.372296  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:56.426659  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 232357us
I20260709 12:59:56.367551  5274 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:56.364071  5119 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:56.450055  1612 raft_consensus.cc:2889] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:56.454773  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.459363  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:56.461249  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.461760  2304 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:56.427120  5176 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.469960  1607 raft_consensus.cc:2410] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:56.542538  1536 rpcz_store.cc:276] 0709 12:59:55.403700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.435413 (+ 31713us) service_pool.cc:224] Handling call
0709 12:59:56.415542 (+980129us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540040bfd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:56.415678 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323605248}
I20260709 12:59:56.416004  4224 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:56.563853  1683 rpcz_store.cc:276] 0709 12:59:54.518816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.562804 (+ 43988us) service_pool.cc:224] Handling call
0709 12:59:54.563061 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.227825 (+664764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.416754 (+1188929us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400198a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:56.416927 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819204864}
I20260709 12:59:56.417543  5024 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:56.451196  5042 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:56.448906  5206 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:56.628703  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.426874  4914 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.469473  5259 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.778277  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.463220  5253 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 12:59:56.426796  5157 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.434798  5180 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:56.826365  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 411858us
I20260709 12:59:56.448258  5028 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.438017  5273 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.640686  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:56.779438  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 238089us
I20260709 12:59:56.817334  1609 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 12:59:56.798216  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 400412us
I20260709 12:59:56.869341  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:56.469643  5074 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.232s
W20260709 12:59:56.781303  4983 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.002s
W20260709 12:59:56.881759  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 461699us
I20260709 12:59:56.740068  1610 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
W20260709 12:59:56.538105  5239 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:59:56.828272  1688 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:56.829104  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:56.925800  1536 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
W20260709 12:59:56.925535  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 55359.4us
I20260709 12:59:56.600646  1682 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:56.926683  1688 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: [6.7-9.9]
W20260709 12:59:56.642539  5226 consensus_meta.cc:287] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.000s
I20260709 12:59:56.564685  5077 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:56.866317  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:56.927752  1688 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:59:56.822016  5218 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.026s
I20260709 12:59:56.641191  5257 raft_consensus.cc:2764] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:59:56.923061  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 106254us
I20260709 12:59:56.942250  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:56.463433  5265 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.316s
I20260709 12:59:56.818696  5024 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:56.823689  5042 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:56.936748  5218 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.005s	sys 0.026s
I20260709 12:59:56.820439  5104 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:56.699779  5011 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:56.825608  5259 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.835755  5176 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:56.862624  5204 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:56.945315  1689 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:56.637844  5136 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:56.947206  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64669.2us
I20260709 12:59:56.947834  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 12:59:57.023722  1506 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.737s (SENT)
I20260709 12:59:56.753175  5059 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:56.959199  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.961050  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:56.953418  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:56.972292  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 103057us
I20260709 12:59:56.928406  5270 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:56.937860  5077 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:56.951519  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 85334.7us
I20260709 12:59:56.932041  5220 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:59:56.949074  5155 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:59:57.050405  2310 raft_consensus.cc:2410] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:56.958073  5042 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.051506  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:56.969628  5108 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.929394  4983 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:56.962980  5065 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:57.048828  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 12:59:57.109617  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 60894us
I20260709 12:59:56.961481  5227 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:56.938330  5226 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:57.037233  5275 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:59:57.035629  5240 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:57.058398  4911 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.046s	user 0.011s	sys 0.001s
I20260709 12:59:57.096161  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:57.128120  2304 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:57.038110  5284 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:59:57.054533  5077 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.041030  5206 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:57.126736  2303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.009s
I20260709 12:59:57.036056  5070 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.117082  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 294854us
I20260709 12:59:57.020810  5204 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.025341  5104 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:57.034693  5123 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:56.979223  5163 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.034709  5157 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:56.981164  5268 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 12:59:56.944880  5228 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.093825  5108 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:57.067611  5059 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:57.131100   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:57.073074  5106 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.132525  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:57.133786  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2287) took 1829 ms. Trace:
W20260709 12:59:57.136909  5283 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.205s	user 0.003s	sys 0.000s
I20260709 12:59:57.137187  5298 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:57.139214  5063 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.787s	user 0.007s	sys 0.001s
W20260709 12:59:57.140008  5232 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.018s	user 0.007s	sys 0.001s
I20260709 12:59:57.036829  5252 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:59:57.141032  1537 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:59:57.055997  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:57.106124  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 150473us
W20260709 12:59:57.155990  5286 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
W20260709 12:59:57.208575  2303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.001s	sys 0.010s
W20260709 12:59:57.215677  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.236208  1614 rpcz_store.cc:276] 0709 12:59:55.304126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.308269 (+  4143us) service_pool.cc:224] Handling call
0709 12:59:57.133615 (+1825346us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540009bad4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:57.133722 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440727808}
I20260709 12:59:57.157056  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:57.279894  2310 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:57.127641  5171 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.127056  5270 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:57.252686  1684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.012s
I20260709 12:59:57.159150  5176 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.253201  5303 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.119666  5227 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:57.262179  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:57.156941  2304 raft_consensus.cc:2410] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:59:56.950381  5119 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:57.270133  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 214258us
I20260709 12:59:57.246284  5240 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.127911  5128 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.157280  5264 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.209306  5204 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.157384  4983 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.233925  5030 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.133818  5262 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:57.337231  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 409563us
I20260709 12:59:57.041119  5024 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.260620  5298 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:57.299719  1684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.003s	sys 0.016s
I20260709 12:59:57.348989  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:57.350507  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88449.5us
W20260709 12:59:57.305739  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.352748  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 320184us
I20260709 12:59:57.141376  4833 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 12:59:57.255759  5154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.000s	sys 0.012s
I20260709 12:59:57.157665  4911 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.235172  5104 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.270092  5157 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:57.269237  5063 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:57.279729  5232 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:57.697566  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.034s	sys 0.075s
I20260709 12:59:57.372159  2304 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:57.732488  2309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 551) took 1483 ms. Trace:
I20260709 12:59:57.735849  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 838) took 1344 ms. Trace:
I20260709 12:59:57.735790  2309 rpcz_store.cc:276] 0709 12:59:56.249224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.250500 (+  1276us) service_pool.cc:224] Handling call
0709 12:59:56.250861 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.377571 (+126710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.377618 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.423742 (+ 46124us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.880563 (+456821us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:56.880609 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.881110 (+   501us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.586237 (+705127us) raft_consensus.cc:1685] finished
0709 12:59:57.586270 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.732402 (+146132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80374,"thread_start_us":456477,"threads_started":1,"wal-append.queue_time_us":1014418}
W20260709 12:59:57.541586  1504 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.507s (SENT)
I20260709 12:59:57.737897  1504 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:57.738631  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 197117us
W20260709 12:59:57.737123  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.037s	sys 0.078s
I20260709 12:59:57.734604  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:57.739692  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 618801us
I20260709 12:59:57.736296  2304 rpcz_store.cc:276] 0709 12:59:56.391027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.371294 (+980267us) service_pool.cc:224] Handling call
0709 12:59:57.371710 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.735614 (+363904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.735797 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.398744  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.746539  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.298969  5228 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.723547  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 515) took 1336 ms. Trace:
I20260709 12:59:57.441159  5028 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:57.279949  5065 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.469s
I20260709 12:59:57.481760  4914 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.749558  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:57.374140  5155 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:57.751931  2309 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:57.362442  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 552) took 1110 ms. Trace:
I20260709 12:59:57.291616  5270 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 12:59:57.314198  5244 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.924s	user 0.007s	sys 0.003s
I20260709 12:59:57.768411  2304 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:57.800730  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 841) took 1408 ms. Trace:
I20260709 12:59:57.437740  5119 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.754673  1682 rpcz_store.cc:276] 0709 12:59:56.387311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.927134 (+539823us) service_pool.cc:224] Handling call
0709 12:59:56.941478 (+ 14344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.941678 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:57.253955 (+312277us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.723090 (+469135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.723165 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:57.723223 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.723314 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.723472 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203485,"prepare.queue_time_us":79543,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":26105,"raft.queue_time_us":203664,"thread_start_us":560642,"threads_started":2}
I20260709 12:59:57.844910  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:57.845693  1682 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 12:59:57.846585  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:57.851452  2302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 499) took 1313 ms (client timeout 1507 ms). Trace:
W20260709 12:59:57.851933  2302 rpcz_store.cc:269] 0709 12:59:56.537741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.639189 (+101448us) service_pool.cc:224] Handling call
0709 12:59:57.851121 (+1211932us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b540060ffa8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea28924 00007f8d5dc11227 00007f8d5dc10ab8 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:57.851394 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21163904}
W20260709 12:59:57.769915  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 421046us
I20260709 12:59:57.295096  5226 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.362396  4917 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:57.349712  5227 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.831284  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1862) took 1525 ms. Trace:
I20260709 12:59:57.853492  1687 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:57.751581  5262 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:57.797781  2309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 839) took 1406 ms. Trace:
W20260709 12:59:57.798235  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.282994  5273 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.465948  5176 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.801213  2304 rpcz_store.cc:276] 0709 12:59:56.391814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.753341 (+1361527us) service_pool.cc:224] Handling call
0709 12:59:57.753672 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.800434 (+ 46762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.800659 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.373114  2310 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:59:57.689138  5297 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.689721  5268 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.741182  5154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.000s	sys 0.055s
I20260709 12:59:57.798370  2303 rpcz_store.cc:276] 0709 12:59:56.251609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.395630 (+144021us) service_pool.cc:224] Handling call
0709 12:59:56.395904 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.396101 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:56.537554 (+141453us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.361829 (+824275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.361985 (+   156us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:57.362051 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.362144 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.362359 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63084,"prepare.queue_time_us":324203,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":7573,"raft.queue_time_us":135,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":55522,"thread_start_us":823505,"threads_started":1,"wal-append.queue_time_us":761103}
I20260709 12:59:57.731243  5254 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.561s
I20260709 12:59:57.732271  5171 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:59:57.355463  5303 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:57.742465  5298 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.800058  5270 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:57.373631  5240 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:57.806901  5244 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.772069  5030 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:57.773305  5157 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.467068  5180 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.732081  5260 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:57.777925  5310 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.312s	user 0.001s	sys 0.001s
I20260709 12:59:57.279752  5070 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.808204  5218 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:59:57.809523  5063 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.833376  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1865) took 1526 ms. Trace:
I20260709 12:59:57.839639  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2307) took 2121 ms. Trace:
I20260709 12:59:57.840785  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1873) took 1598 ms. Trace:
I20260709 12:59:57.481433  5163 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:57.859777  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:57.667558  5274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.015s	sys 0.035s
I20260709 12:59:57.824620  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1860) took 1556 ms. Trace:
I20260709 12:59:57.777215  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:57.820640  5296 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.771440  4833 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:57.826251  5134 consensus_queue.cc:1059] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:59:57.855808  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:57.772797  4983 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:57.869729  1684 rpcz_store.cc:276] 0709 12:59:56.306428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.430943 (+124515us) service_pool.cc:224] Handling call
0709 12:59:56.431374 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.438839 (+  7465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.438950 (+   111us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.451176 (+ 12226us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.734138 (+1282962us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:57.734181 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.734255 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.831026 (+ 96771us) raft_consensus.cc:1685] finished
0709 12:59:57.831063 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.831216 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5667,"raft.queue_time_us":130245,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":31787,"thread_start_us":1138118,"threads_started":1,"wal-append.queue_time_us":1290092}
I20260709 12:59:57.826292  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1869) took 1518 ms. Trace:
I20260709 12:59:57.881837  2310 pending_rounds.cc:85] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 7
I20260709 12:59:57.872359  2309 rpcz_store.cc:276] 0709 12:59:56.391309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.751260 (+1359951us) service_pool.cc:224] Handling call
0709 12:59:57.751584 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.797466 (+ 45882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.797722 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.868763  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1563) took 2200 ms (client timeout 1737 ms). Trace:
I20260709 12:59:57.879637  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1861) took 1611 ms. Trace:
W20260709 12:59:57.936981  1690 rpcz_store.cc:269] 0709 12:59:55.660335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.660474 (+   139us) service_pool.cc:224] Handling call
0709 12:59:57.859965 (+2199491us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400255b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:57.860149 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481259392}
I20260709 12:59:57.938277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 12:59:57.904451  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1859) took 2947 ms (client timeout 2011 ms). Trace:
W20260709 12:59:57.935688  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2293) took 2382 ms (client timeout 2000 ms). Trace:
I20260709 12:59:57.887290  5297 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 12:59:57.889792  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:57.943468  1615 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:59:57.943938  2304 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.809790  4826 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:57.938989  1690 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.822914  5108 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.939651  2310 pending_rounds.cc:107] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:59:57.958189  2310 raft_consensus.cc:2889] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:57.959040  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 837) took 1586 ms. Trace:
W20260709 12:59:57.883340  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.025s
I20260709 12:59:57.940821  1538 rpcz_store.cc:276] 0709 12:59:56.242514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.388312 (+145798us) service_pool.cc:224] Handling call
0709 12:59:56.388652 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.931967 (+543315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.932016 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:56.932070 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:56.932101 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.840502 (+908401us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400074754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:57.840562 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.840715 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249136896}
W20260709 12:59:57.959823  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.006s	sys 0.025s
W20260709 12:59:57.937597  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2300) took 2239 ms (client timeout 2102 ms). Trace:
W20260709 12:59:57.945362  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 174774us
W20260709 12:59:57.960274  1610 rpcz_store.cc:269] 0709 12:59:55.698445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.702012 (+  3567us) service_pool.cc:224] Handling call
0709 12:59:57.937422 (+2235410us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b540009c4d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:57.937532 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995200256}
I20260709 12:59:57.961136  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:57.954221  5155 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:57.823163  5312 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:57.938339  1689 rpcz_store.cc:276] 0709 12:59:56.307270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.433286 (+126016us) service_pool.cc:224] Handling call
0709 12:59:56.459685 (+ 26399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.194452 (+734767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.833067 (+638615us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540035c854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:57.833304 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109044480}
I20260709 12:59:57.965480  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:57.859020  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 109557us
I20260709 12:59:57.966503  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:57.825728  5220 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 12:59:57.827929  5232 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.940277  1681 rpcz_store.cc:276] 0709 12:59:56.267936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.404034 (+136098us) service_pool.cc:224] Handling call
0709 12:59:56.423170 (+ 19136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.423769 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.423807 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.424356 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.946903 (+522547us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:56.946963 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.962922 (+ 15959us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.824324 (+861402us) raft_consensus.cc:1685] finished
0709 12:59:57.824354 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.824547 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792,"thread_start_us":385455,"threads_started":1,"wal-append.queue_time_us":1302949}
I20260709 12:59:57.822302  5059 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:57.953907  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:57.939298  1612 rpcz_store.cc:276] 0709 12:59:55.718135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.727348 (+  9213us) service_pool.cc:224] Handling call
0709 12:59:55.727573 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.817964 (+1090391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.839310 (+1021346us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54002887d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:57.839539 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537264512}
I20260709 12:59:57.930738  5136 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:57.940071  1613 rpcz_store.cc:269] 0709 12:59:55.553171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.553380 (+   209us) service_pool.cc:224] Handling call
0709 12:59:57.935404 (+2382024us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001b1a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:57.935565 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808891264}
I20260709 12:59:57.939325  1683 rpcz_store.cc:276] 0709 12:59:56.308365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.822407 (+514042us) service_pool.cc:224] Handling call
0709 12:59:56.822748 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.923221 (+100473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.923254 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.940074 (+ 16820us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.064549 (+124475us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:57.064609 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.153632 (+ 89023us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.826036 (+672404us) raft_consensus.cc:1685] finished
0709 12:59:57.826074 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.826229 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107534,"raft.queue_time_us":105295,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8010,"thread_start_us":124100,"threads_started":1,"wal-append.queue_time_us":876324}
W20260709 12:59:57.939183  1535 rpcz_store.cc:269] 0709 12:59:54.957349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.957481 (+   132us) service_pool.cc:224] Handling call
0709 12:59:57.904179 (+2946698us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54002c6d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:57.904347 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978821376}
W20260709 12:59:57.940116  5274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.016s	sys 0.037s
I20260709 12:59:57.959285  2310 rpcz_store.cc:276] 0709 12:59:56.372910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.340247 (+967337us) service_pool.cc:224] Handling call
0709 12:59:57.372695 (+ 32448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.958825 (+586130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.958999 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.823143  4914 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:57.827554  5302 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 12:59:57.948619  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.015s	sys 0.015s
I20260709 12:59:57.885941  5226 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.950284  5254 consensus_queue.cc:1243] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:57.927687  5095 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.939388  1686 rpcz_store.cc:276] 0709 12:59:56.268246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.424720 (+156474us) service_pool.cc:224] Handling call
0709 12:59:56.425040 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.425327 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:56.778606 (+353279us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.838819 (+1060213us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b18003771a0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a
0709 12:59:57.879168 (+ 40349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.879241 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:57.879307 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.879397 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.879561 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46102,"prepare.queue_time_us":397192,"prepare.run_cpu_time_us":2605,"prepare.run_wall_time_us":58045,"raft.queue_time_us":41354,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":51347,"spinlock_wait_cycles":45324672,"thread_start_us":163468,"threads_started":1,"wal-append.queue_time_us":1049122}
W20260709 12:59:58.000126  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.000782  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1875) took 1563 ms. Trace:
I20260709 12:59:58.001231  1686 rpcz_store.cc:276] 0709 12:59:56.437287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.999963 (+1562676us) service_pool.cc:224] Handling call
0709 12:59:58.000284 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.000452 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.000476 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.000518 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:58.000567 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.000622 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.000731 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.980474  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 245769us
I20260709 12:59:57.982204  2304 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:57.871490  4917 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.904800  5316 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:58.005205  1686 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:57.903931  4911 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:57.968956  5105 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:57.994927  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1874) took 1558 ms. Trace:
I20260709 12:59:57.981225  4833 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:58.013751  1689 rpcz_store.cc:276] 0709 12:59:56.436979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.994100 (+1557121us) service_pool.cc:224] Handling call
0709 12:59:57.994420 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.994607 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.994632 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.994680 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:57.994716 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.994771 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.994874 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.940331  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 84629.1us
I20260709 12:59:58.015383  2276 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 12:59:57.958544  5259 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.929s	user 0.009s	sys 0.003s
W20260709 12:59:57.998121  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.015s	sys 0.015s
W20260709 12:59:58.018647  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 969062us
I20260709 12:59:57.958914  5030 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:57.992785  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:57.953573  5180 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.010808  1690 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:57.902520  5176 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.011968  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1876) took 1572 ms. Trace:
I20260709 12:59:57.889856  5262 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.073418  5297 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:57.985978  5155 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.954002  5163 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.019328  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:58.079128  5303 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:58.079203  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59960.4us
I20260709 12:59:57.889353  5028 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:59:58.080199  5070 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:58.081019  5157 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.020524  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 12:59:58.081606  5157 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:58.082379  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 61927.2us
I20260709 12:59:58.083274  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:57.957056  4983 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.084120  5176 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.084829  5254 raft_consensus.cc:2764] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:57.919906  5305 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:59:58.085604  5030 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.012269  5206 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.016s	sys 0.030s
I20260709 12:59:58.073490  5240 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:58.086274  5206 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.016s	sys 0.030s
I20260709 12:59:58.085634  5254 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:57.904258  5268 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.024955  1690 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:59:58.041435  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48771.7us
I20260709 12:59:58.015659  5263 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.997263  5232 consensus_queue.cc:1059] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:59:57.954020  5296 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.056835  1689 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:58.059208  5249 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:58.110767  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:58.024156  5309 raft_consensus.cc:2764] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:58.021502  5316 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.056054  1608 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.024454  5105 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:58.004793  5226 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.001431  4914 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.048465  5108 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:57.997042  5274 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:57.878365  5295 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 12:59:58.033828  5259 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.069972  1686 rpcz_store.cc:276] 0709 12:59:56.440029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.002260 (+1562231us) service_pool.cc:224] Handling call
0709 12:59:58.005039 (+  2779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.011697 (+  6658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.011894 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.003882  5302 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.078225  5104 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:58.080262  1507 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:58.108111  1690 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:58.061416  5244 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.177373  5318 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:59:58.177907  5274 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.178619  5226 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.179028  5297 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:58.179649  5297 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:58.180667  5297 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:58.121711  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.183406  5227 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.184736  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 411) took 2456 ms. Trace:
I20260709 12:59:58.185168  1539 rpcz_store.cc:276] 0709 12:59:55.728825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.982632 (+253807us) service_pool.cc:224] Handling call
0709 12:59:56.171914 (+189282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.172887 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.184491 (+2011604us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002260d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:58.184650 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434469120}
I20260709 12:59:58.081772  5262 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.122851  5242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.710s	user 0.017s	sys 0.024s
W20260709 12:59:58.186419  5242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.773s	user 0.017s	sys 0.025s
I20260709 12:59:58.187153  1616 raft_consensus.cc:2410] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:59:58.150918  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 403093us
I20260709 12:59:58.111362  5254 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:59:58.177908  5302 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.188037  5254 consensus_queue.cc:1243] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:59:58.188421  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2318) took 2244 ms (client timeout 1946 ms). Trace:
I20260709 12:59:58.188599  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:58.113682  5263 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:58.188835  1616 rpcz_store.cc:269] 0709 12:59:55.944200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.977783 (+ 33583us) service_pool.cc:224] Handling call
0709 12:59:58.188186 (+2210403us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54003f4154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:58.188355 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5078898048}
I20260709 12:59:58.190199  5024 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:58.190783  5263 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.150919  5180 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.192389  5246 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.193140  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 414) took 2303 ms (client timeout 2265 ms). Trace:
I20260709 12:59:58.192917  5246 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:58.193498  1532 rpcz_store.cc:269] 0709 12:59:55.890065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.902704 (+ 12639us) service_pool.cc:224] Handling call
0709 12:59:58.192932 (+2290228us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400073854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:58.193072 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5235988736}
W20260709 12:59:58.175174  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 95044.6us
I20260709 12:59:58.198992  1540 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:58.200115  1541 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:58.200695  1532 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:58.203270  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.209846  5227 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.212532  5302 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.213106  5302 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:58.171453  5042 consensus_meta.cc:287] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.057s	user 0.008s	sys 0.005s
I20260709 12:59:58.227834  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.216125  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 518) took 1816 ms. Trace:
I20260709 12:59:58.226801  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.199373  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:58.228937  1538 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:58.229267  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:58.229825  1614 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:58.230894  1504 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:58.231685  2306 raft_consensus.cc:2368] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:58.232314  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.232517  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:58.207384  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:58.233595  1534 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.205794  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:58.234334  1533 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:58.234436  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:58.235013  2304 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:58.226392  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.235906  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:58.208349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:58.237011  1539 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:58.205919  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 180523us
I20260709 12:59:58.164743  5108 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.228663  1682 rpcz_store.cc:276] 0709 12:59:56.399506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.847414 (+1447908us) service_pool.cc:224] Handling call
0709 12:59:57.847677 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.847872 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:57.848777 (+   905us) log.cc:844] Serialized 14 byte log entry
0709 12:59:58.206856 (+358079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.206922 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:58.206979 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.215956 (+  8977us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.216074 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":126,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":357249,"threads_started":1}
I20260709 12:59:58.228346  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 522) took 1038 ms. Trace:
I20260709 12:59:58.252339  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:58.253253  2310 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 8: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:58.257004  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.263170  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:58.263466  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.265378  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.267913  1538 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:58.169399  5295 consensus_queue.cc:1243] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:58.270129  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:58.270972  1538 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 12:59:58.268796  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:58.272125  1682 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 12:59:58.275571  1533 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 12:59:58.276429  1532 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: [9.8-12.9]
W20260709 12:59:58.278229  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 147021us
I20260709 12:59:58.282477  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:58.283316  1610 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.283989  1609 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:58.286232  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:58.288054  2310 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:58.289523  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:58.290295  2304 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.294023  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.297338  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.303689  1610 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
W20260709 12:59:58.306138  1582 connection.cc:256] RPC call timeout handler was delayed by -1.5119038369999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:59:58.293182  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:58.159649  5105 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.156384  5316 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.249099  5226 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:58.249328  5242 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.251624  5108 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:58.311352  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:58.314654  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.317791  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:58.265483  5244 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.337574  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:58.337669  2304 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:58.322069  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:58.325263  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:58.339138  1533 raft_consensus.cc:2368] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9.
I20260709 12:59:58.325482  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:58.363677  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 70620.5us
I20260709 12:59:58.369386  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:58.434703  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65404.2us
I20260709 12:59:58.449524  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:58.449954  1504 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:58.451335  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:58.452442  2304 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:58.310599  4983 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.311928  4917 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.463830  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.464708  1609 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:58.475471  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.268497  5042 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:58.460494  5077 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.186s	user 0.016s	sys 0.003s
I20260709 12:59:58.491349  1609 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:58.485112  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.430689  5011 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.458067  5262 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.465167  5308 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:59:58.456342  5274 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:58.463990  5273 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:58.461151  5309 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:58.581818  2305 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:58.519392  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.587656  1613 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:59:58.336637  5226 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.432796  5242 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:58.604305  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47439.6us
I20260709 12:59:58.521425  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.616897  1610 raft_consensus.cc:2410] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:58.463810  5240 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:59:58.455164  5254 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:59:58.625484  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:58.574219  5333 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:59:58.546615  5304 raft_consensus.cc:3055] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:58.577059  5316 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.593729  5274 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:58.592489  5309 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.591398  5163 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.634105  5204 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.870s	user 0.010s	sys 0.001s
I20260709 12:59:58.603586  5253 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.591131  5296 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.520424  5077 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.628646  5273 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:58.638886  5268 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.534528  5011 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.582306  5262 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:58.656183  5328 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:59:58.646332  5304 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:58.682695  5304 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:58.662362  5319 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.487s	user 0.000s	sys 0.001s
I20260709 12:59:58.658152  5274 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.668202  5253 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.657896  5309 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.703171  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:58.704288  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 517) took 2316 ms. Trace:
W20260709 12:59:58.708892  5024 consensus_meta.cc:287] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 12:59:58.710989  5246 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.712836  5163 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:58.714404  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1871) took 2376 ms. Trace:
I20260709 12:59:58.714866  1687 rpcz_store.cc:276] 0709 12:59:56.337849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.840321 (+502472us) service_pool.cc:224] Handling call
0709 12:59:56.875806 (+ 35485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.869907 (+994101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.714079 (+844172us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54001a5754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:58.714328 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248081792}
I20260709 12:59:58.681543  5259 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:58.704814  1688 rpcz_store.cc:276] 0709 12:59:56.387936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.932075 (+544139us) service_pool.cc:224] Handling call
0709 12:59:56.932384 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.299727 (+367343us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:57.363571 (+ 63844us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.964385 (+600814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.964440 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:57.964481 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.703990 (+739509us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54001a5c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:58.704053 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.704201 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5288,"prepare.queue_time_us":70983,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":5023,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14620,"spinlock_wait_cycles":844235648,"thread_start_us":596291,"threads_started":1,"wal-append.queue_time_us":768996}
I20260709 12:59:58.659204  5204 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:58.740857  5332 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.535s	user 0.002s	sys 0.002s
W20260709 12:59:58.742653  5330 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.540s	user 0.000s	sys 0.001s
W20260709 12:59:58.744326  5326 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.532s	user 0.002s	sys 0.000s
W20260709 12:59:58.745575  5281 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 2.348s	user 0.015s	sys 0.000s
I20260709 12:59:58.751348  4914 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 12:59:58.752177  2307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56280 (request call id 844) took 1630 ms (client timeout 1563 ms). Trace:
W20260709 12:59:58.753037  5287 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.272s	user 0.000s	sys 0.003s
W20260709 12:59:58.752744  2307 rpcz_store.cc:269] 0709 12:59:57.121896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.132239 (+ 10343us) service_pool.cc:224] Handling call
0709 12:59:58.751913 (+1619674us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001fb8d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:58.752077 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433191168}
W20260709 12:59:58.759677  5228 consensus_meta.cc:287] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.986s	user 0.004s	sys 0.004s
I20260709 12:59:58.761375  5011 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.763389  5253 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.763899  5270 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.008s
I20260709 12:59:58.764708  4846 raft_consensus.cc:3055] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:58.765538  4917 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:58.765954  5204 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.768673  5105 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.769784  5285 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.490s	user 0.000s	sys 0.003s
W20260709 12:59:58.773190  5339 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:59:58.732676  5302 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.777696  5262 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.683965  5304 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.790989  5274 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.793198  5274 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:58.798275  5134 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:58.798877  5134 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:58.800941  5226 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.799926  5134 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:58.789305  5119 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.000s
I20260709 12:59:58.802327  5242 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.804023  5134 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.809583  5077 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:58.811378  5157 consensus_meta.cc:287] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.000s
I20260709 12:59:58.811952  5157 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.774421  5273 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:58.817571  5298 consensus_meta.cc:287] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.001s
I20260709 12:59:58.818135  5298 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.820905  5298 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.821480  5270 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:58.824752  5270 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:58.850714  5309 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:58.836509  5327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.014s	sys 0.008s
W20260709 12:59:58.852816  5327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.014s	sys 0.008s
W20260709 12:59:58.894110  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 304400us
I20260709 12:59:58.595153  1534 raft_consensus.cc:2410] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:59:58.898458  1539 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 12:59:58.899868  1582 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.011s	sys 0.007s
W20260709 12:59:58.900403  1582 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.012s	sys 0.007s
W20260709 12:59:58.901000  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 585235us
I20260709 12:59:58.903206  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:58.904619  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.905055  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.906116  1607 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:58.907532  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:58.580284  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.903438  1611 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:59:58.909189  1611 pending_rounds.cc:85] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 8
I20260709 12:59:58.791236  5042 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:58.925335  1612 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 12:59:58.925585  1613 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:58.925521  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.909565  1611 pending_rounds.cc:107] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:59:58.933638  5226 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:58.941967  5157 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.937727  1611 raft_consensus.cc:2889] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:58.942341  1616 raft_consensus.cc:2410] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:58.946626  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 403) took 3296 ms. Trace:
I20260709 12:59:58.947324  1537 rpcz_store.cc:276] 0709 12:59:55.650569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.940274 (+289705us) service_pool.cc:224] Handling call
0709 12:59:55.940676 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.269449 (+1328773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.945826 (+1676377us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400073d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:58.946375 (+   549us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760283904}
W20260709 12:59:58.960218  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.781798  4917 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:58.780527  4846 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:58.987151  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:58.988557  5352 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:58.989635  5108 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.004s
I20260709 12:59:58.990262  5108 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:58.961794  5157 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:59.002017  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.006s	sys 0.012s
I20260709 12:59:59.002206  4983 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:59.005359  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 102414us
W20260709 12:59:59.007715  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.013s
I20260709 12:59:58.986578  5226 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.026436  5108 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:59.029247  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:59.022222  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 406701us
I20260709 12:59:59.037117  1537 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:59.042711  5309 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:59.047078  5354 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:59.048391  5354 consensus_queue.cc:1243] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:59.056099  5206 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:59.060504  4846 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.061981  4846 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.064021  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.064514  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.064914  1537 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 12:59:59.065503  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 842) took 2665 ms. Trace:
I20260709 12:59:59.065765  1536 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:59.067574  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.065886  2301 rpcz_store.cc:276] 0709 12:59:56.399842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.932136 (+1532294us) service_pool.cc:224] Handling call
0709 12:59:57.932557 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.115084 (+182527us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:58.328684 (+213600us) log.cc:844] Serialized 14 byte log entry
0709 12:59:58.718330 (+389646us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b1800379420. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a
0709 12:59:58.727082 (+  8752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.727149 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:58.727205 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.064867 (+337662us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400691754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:59.064934 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.065232 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":394253,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":9878,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6214,"spinlock_wait_cycles":450934912,"thread_start_us":496391,"threads_started":2,"wal-append.queue_time_us":500645}
I20260709 12:59:59.068346  1536 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.069027  4917 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:59.069867  5297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.012s	sys 0.030s
W20260709 12:59:59.074994  5297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.013s	sys 0.030s
W20260709 12:59:59.080097  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.000s	sys 0.034s
I20260709 12:59:59.050042  4983 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:59.094094  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.000s	sys 0.035s
I20260709 12:59:59.093772  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:58.248035  1685 rpcz_store.cc:276] 0709 12:59:57.190410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.048800 (+858390us) service_pool.cc:224] Handling call
0709 12:59:58.060580 (+ 11780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.060787 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:59:58.061069 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:59:58.228010 (+166941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.228070 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:58.228117 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.228178 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.228295 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":908,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":22584,"thread_start_us":165683,"threads_started":1,"wal-append.queue_time_us":144276}
I20260709 12:59:59.101267  1608 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.106326  5226 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:59.109112  5353 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:59:59.109730  5270 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:59.110256  5270 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.110639  5270 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.110802  5095 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:59.111282  5095 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 12:59:59.112330  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 57500.4us
I20260709 12:59:59.112545  5095 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.113556  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.114818  5353 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:59.115468  5353 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:59.116895  5353 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.108471  4917 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:59.121469  5355 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:59:59.109035  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:59.122526  2301 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 12:59:59.124480  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2311) took 3393 ms. Trace:
I20260709 12:59:59.124877  1615 rpcz_store.cc:276] 0709 12:59:55.730758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.872442 (+141684us) service_pool.cc:224] Handling call
0709 12:59:57.936790 (+2064348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.943943 (+  7153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.124025 (+1180082us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54001b1a50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:59.124279 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4747241856}
I20260709 12:59:59.120031  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.126956  5348 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.127764  5348 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 12:59:59.129930  5349 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.126s	user 0.003s	sys 0.000s
I20260709 12:59:59.131841  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:59.132441  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:59.100431  1507 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:59.133502  5095 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:59.134402  5226 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:59.134734  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 129262us
I20260709 12:59:59.142822  5157 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:59.143258  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 469) took 3053 ms. Trace:
I20260709 12:59:59.143641  1611 rpcz_store.cc:276] 0709 12:59:56.089575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.640727 (+551152us) service_pool.cc:224] Handling call
0709 12:59:56.641040 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.978772 (+2337732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.142984 (+164212us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b540020bf54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:59.143202 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5200703360}
I20260709 12:59:59.144886  5329 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:59.145586  5329 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:59.147029  5329 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.157189  1610 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:59.169191  1610 pending_rounds.cc:85] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 6
I20260709 12:59:59.169744  1610 pending_rounds.cc:107] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:59:59.170092  1610 raft_consensus.cc:2889] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:59.169948  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:59.174113  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.180536  5306 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:59.181762  5306 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.184072  4983 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 12:59:59.184842  2306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 545) took 2952 ms (client timeout 1849 ms). Trace:
W20260709 12:59:59.185307  2306 rpcz_store.cc:269] 0709 12:59:56.232489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.232820 (+   331us) service_pool.cc:224] Handling call
0709 12:59:59.184436 (+2951616us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000ee2d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 12:59:59.184635 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4296112000}
I20260709 12:59:59.186676  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.188774  5354 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:59.189582  5354 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:59.186663  5306 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:59.193600  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:59.194816  2308 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 12:59:59.195675  5254 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:59.196081  5309 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:59.197041  5254 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:59.197140  5309 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:59.197492  5254 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:59.198774  5254 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.197559  5309 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:59.201879  5309 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.200134  5254 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:59.205229  5042 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:59.208398  1614 consensus_meta.cc:287] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.953s	user 0.009s	sys 0.011s
I20260709 12:59:59.203621  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.210315  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.210685  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.211052  1535 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:59.211673  1537 raft_consensus.cc:2393] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 6: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:59.217149  2306 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:59:59.213279  1614 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 12:59:59.218372  1532 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.225776  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:59.227387  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.232473  1608 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:59:59.233230  5033 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:59:59.234457  1539 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:59.235980  1504 leader_election.cc:400] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 12:59:59.236305  1504 leader_election.cc:403] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:59.237000  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.237136  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.238000  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
W20260709 12:59:59.238395  5357 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 12:59:59.238771  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:59.239180  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.239516  1609 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:59.239773  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 12:59:59.238401  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 102492us
I20260709 12:59:59.240396  4224 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.240744  1615 raft_consensus.cc:2410] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:59.240862  4224 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.244870  1582 leader_election.cc:400] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9.
I20260709 12:59:59.246086  1582 leader_election.cc:403] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:59:59.244899  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1692) took 1018 ms. Trace:
I20260709 12:59:59.191284  5354 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.244653  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 12:59:59.246521  1614 rpcz_store.cc:276] 0709 12:59:58.226769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.229068 (+  2299us) service_pool.cc:224] Handling call
0709 12:59:59.234957 (+1005889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.252663  1615 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:59.259284  5042 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:59.260944  1616 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:59.261178  4224 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:59.254690  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2312) took 3405 ms. Trace:
I20260709 12:59:59.262826  1609 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 12:59:59.263132  1608 rpcz_store.cc:276] 0709 12:59:55.849733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.903594 (+ 53861us) service_pool.cc:224] Handling call
0709 12:59:55.921383 (+ 17789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.051736 (+2130353us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54001eec20. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc906f 00007f8d58c41f60 00007f8d58c437de 00007f8d58c4db49 00007f8d58c4e416 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62
0709 12:59:59.046583 (+994847us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5800325ad0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58ba70aa 00007f8d58c29447 00007f8d58c41fe7 00007f8d58c437de 00007f8d58c4db49 00007f8d58c4e416 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4
0709 12:59:59.232899 (+186316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.254614 (+ 21715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880267264}
I20260709 12:59:59.266142  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:59.244867  5348 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:59.273999  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.267397  5309 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.277396  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.276894  1439 catalog_manager.cc:5697] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 5 to 7, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:59.278415  4914 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:59.268034  4983 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:59.281754  1609 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
W20260709 12:59:59.284847  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 117071us
I20260709 12:59:59.265830  4917 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:59:59.313879  5302 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:59.314582  5302 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 12:59:59.315208  5302 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.318289  5354 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.320703  5305 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9.
I20260709 12:59:59.321228  4917 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:59.321697  4917 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 12:59:59.321609  4846 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:59.322211  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.323061  4917 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 12:59:59.323971  1613 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 12:59:59.324370  5263 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:59.324914  5263 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.325330  5263 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.329569  4983 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 12:59:59.331120  4917 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.330983  5033 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:59.332461  5348 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:59.332849  5348 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 12:59:59.333832  5348 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.293027  5042 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:59:59.311254  1439 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 7 to 8, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 8 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.365212  1439 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 6 to 8, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:59.371728  5348 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:59.394421  5361 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:59.401908  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:59.405043  1507 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:59.407435  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:59.410346  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:59.411489  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.417887  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.398948  5306 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 12:59:59.432338  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 136) took 21101 ms (client timeout 15000 ms). Trace:
I20260709 12:59:59.435479  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 418) took 1021 ms. Trace:
I20260709 12:59:59.436088  1439 catalog_manager.cc:5697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 6 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 10 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.442932  1532 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:59.422978  4914 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:59.462191  1688 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:59.433615  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.463714  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.463967  1533 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:59.464721  1681 raft_consensus.cc:2410] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:59.466984  5306 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.467406  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:59.437314  4846 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:59.468865  4846 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.469676  5306 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:59.469461  4846 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.470424  5306 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:59.492724  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:59.493184  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.505970  1536 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 12:59:59.474689  1614 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:59.474925  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.490533  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:59.513010  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 114372us
I20260709 12:59:59.490959  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.491308  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.489893  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.520582  1534 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 12:59:59.472127  4846 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:59.438585  1541 rpcz_store.cc:276] 0709 12:59:58.264310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.264419 (+   109us) service_pool.cc:224] Handling call
0709 12:59:58.264728 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.306836 (+ 42108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.306883 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.307466 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.031452 (+723986us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b1800373960. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 12:59:59.163755 (+132303us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:59.222679 (+ 58924us) log.cc:844] Serialized 14 byte log entry
0709 12:59:59.254995 (+ 32316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.267475 (+ 12480us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:59.270671 (+  3196us) raft_consensus.cc:1685] finished
0709 12:59:59.275121 (+  4450us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.286117 (+ 10996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57488,"prepare.queue_time_us":47635,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":51809,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":131714,"spinlock_wait_cycles":16778496,"thread_start_us":58671,"threads_started":1,"wal-append.queue_time_us":898397}
I20260709 12:59:59.525179  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 12:59:59.526669  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 160012us
I20260709 12:59:59.531024  1535 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:59.509446  5270 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.558744  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 12:59:59.563931  1536 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:59.566785  1614 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: [9.8-12.9]
I20260709 12:59:59.569077  1685 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 12:59:59.553632  5309 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:59.593622  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 67411.2us
I20260709 12:59:59.595055  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:59.596576  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 73891.9us
I20260709 12:59:59.597510  1613 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 8: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:59.557534  5302 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.578799  4914 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:59.597395  5309 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:59.610854  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:59.617456  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 52263.3us
I20260709 12:59:59.612018  1439 catalog_manager.cc:5697] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:59.609333  5254 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:59.629200  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.630735  1539 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:59.638674  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.629752  1613 raft_consensus.cc:2376] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7. Re-sending same reply.
W20260709 12:59:59.432763  1435 rpcz_store.cc:269] 0709 12:59:38.235177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.235517 (+   340us) service_pool.cc:224] Handling call
0709 12:59:38.440053 (+204536us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b5400190b90. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b27640 00007f8d5e9feb76 00007f8d5eb08c3e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc 00007f8d5cfc8392 00007f8d56f8648c 00007f8d56f858c6
0709 12:59:59.313171 (+20873118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:55.591628 (+     0us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54002c02a8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5f0079e1 00007f8d5f00664c 00007f8d5c695adc 00007f8d5c6810a6 00007f8d5c680d58 00007f8d5c6859f1 00007f8d5c6859a9 00007f8d5c685939 00007f8d5c685901 00007f8d5c684b2d 000000000038f354
0709 12:59:55.607030 (+ 15402us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:55.775977 (+168947us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:55.776032 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:59:55.776050 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:55.777313 (+  1263us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:55.777392 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:55.777435 (+    43us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:59:55.833472 (+ 56037us) tablet.cc:701] Row locks acquired
0709 12:59:55.833518 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:59:55.833683 (+   165us) write_op.cc:270] Start()
0709 12:59:55.833910 (+   227us) write_op.cc:276] Timestamp: P: 1783601995833619 usec, L: 0
0709 12:59:55.833929 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:56.017194 (+183265us) log.cc:844] Serialized 3980 byte log entry
0709 12:59:57.301642 (+1284448us) op_driver.cc:464] REPLICATION: finished
0709 12:59:57.814252 (+512610us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b1800418ae0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d5c681ef0 00007f8d5c682489 00007f8d5c68471a 00007f8d5c6846a8
0709 12:59:58.184556 (+370304us) write_op.cc:301] APPLY: starting
0709 12:59:58.184657 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:58.184882 (+   225us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:58.184918 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:58.186507 (+  1589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:58.186818 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:59:58.186864 (+    46us) write_op.cc:312] APPLY: finished
0709 12:59:58.187180 (+   316us) log.cc:844] Serialized 77 byte log entry
0709 12:59:58.562532 (+375352us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d55b410ac 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b
0709 12:59:58.853942 (+291410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:58.854125 (+   183us) write_op.cc:454] Released schema lock
0709 12:59:58.854211 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:58.854682 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:58.854725 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5577373,"reported_tablets":24,"spinlock_wait_cycles":9368832,"child_traces":[["op",{"apply.queue_time_us":838241,"apply.run_cpu_time_us":24793,"apply.run_wall_time_us":670100,"num_ops":10,"prepare.queue_time_us":367602,"prepare.run_cpu_time_us":11166,"prepare.run_wall_time_us":974683,"raft.queue_time_us":878383,"raft.run_cpu_time_us":45146,"raft.run_wall_time_us":1066292,"replication_time_us":1382435,"spinlock_wait_cycles":112318848,"thread_start_us":1785608,"threads_started":5,"wal-append.queue_time_us":839091,"wal-append.run_cpu_time_us":113080,"wal-append.run_wall_time_us":1440107}]]}
I20260709 12:59:59.644750  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:59.647565  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 192325us
I20260709 12:59:59.662137  1532 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:59:59.662036  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 252421us
I20260709 12:59:59.666730  1610 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 12:59:59.666484  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 12:59:59.674135  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.675012  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.677263  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.679548  1507 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.691871  1614 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:59.694630  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 12:59:59.697151  5370 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:59:59.692365  1439 catalog_manager.cc:5697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 3 to 4, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 4 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.696651  5254 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 12:59:59.715415  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.662247  4914 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:59:59.721340  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 12:59:59.719848  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 53532us
I20260709 12:59:59.679260  5263 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.716077  4983 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:59.676704  5309 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.744306  5387 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.733299  4983 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:59.743973  1685 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:59.745651  5254 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.746587  4917 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:59.748651  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:59.749969  5363 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260709 12:59:59.741103  5302 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 12:59:59.751001  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.751573  1683 pending_rounds.cc:85] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 12:59:59.783053  1683 pending_rounds.cc:107] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:59:59.783377  1683 raft_consensus.cc:2889] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:59.782231  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:59.773223  4983 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:59.755115  5367 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:59:59.758756  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.751835  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 12:59:59.774948  4917 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:59.734762  5270 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:59.792884  1538 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:59.797005  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.799000  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.801968  5270 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:59.802394  5270 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.802731  5270 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.804723  5353 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 12:59:59.805325  5353 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 12:59:59.772071  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 79314us
I20260709 12:59:59.809861  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 12:59:59.738634  5370 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:59.750219  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:59.752758  5374 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:59:59.818045  1688 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 12:59:59.788034  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.819099  1537 raft_consensus.cc:2410] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:59:59.742234  1439 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 2 to 7, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 7 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.790563  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.782521  5387 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.836095  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 12:59:59.808207  5033 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 12:59:59.841727  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.842532  1533 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.843998  2302 raft_consensus.cc:2368] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 12:59:59.845911  5387 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:59.846462  5370 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 12:59:59.847580  5370 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.848964  1540 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 12:59:59.810554  4917 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.854866  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.856194  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:59.851948  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.866696  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 12:59:59.866808  1538 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 12:59:59.837257  5302 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.871842  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.872573  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.872090  1540 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:59.875046  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 12:59:59.883395  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.884296  1540 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 12:59:59.873659  1439 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:59.832269  5297 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:59:59.890861  1681 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:59:59.898711  1681 pending_rounds.cc:85] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 9
I20260709 12:59:59.899015  1681 pending_rounds.cc:107] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:59:59.899266  1681 raft_consensus.cc:2889] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:59.907558  5304 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.908277  5304 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.910531  5304 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 12:59:59.920531  5387 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 12:59:59.923720  1541 raft_consensus.cc:2410] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:59:59.873078  5095 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.895818  1439 catalog_manager.cc:5697] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 3 to 7, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:59.938362  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.938408  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.942399  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 12:59:59.937285  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 258092us
I20260709 12:59:59.946672  1537 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:59.944453  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 12:59:59.957146  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 104991us
I20260709 12:59:59.959460  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.944816  1439 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 6 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 12:59:59.961881  1439 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.964133  2302 raft_consensus.cc:2410] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:59.964766  1534 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 12:59:59.965199  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 12:59:59.969226  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 12:59:59.933369  5387 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 12:59:59.968295  1540 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.972289  5392 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:59.980433  1534 pending_rounds.cc:85] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 7
I20260709 13:00:00.007791  1534 pending_rounds.cc:107] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:59:59.988572  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 12:59:59.990031  5387 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 12:59:59.993501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 12:59:59.995424  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 253031us
I20260709 12:59:59.997601  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 12:59:59.998361  5381 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:00:00.000837  1538 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:00.001204  5263 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.002054  2275 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 12:59:59.976465  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:00.003125  4983 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:00.004586  5354 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.003s
I20260709 13:00:00.005164  1507 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 12:59:59.943332  5095 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 12:59:59.988062  1537 raft_consensus.cc:2393] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:00.013008  1536 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
W20260709 13:00:00.025715  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47011.5us
W20260709 13:00:00.016696  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.020890  1533 raft_consensus.cc:2410] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:00.022993  1532 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:00.010275  1534 raft_consensus.cc:2889] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:00.028498  1540 raft_consensus.cc:2410] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:00.029521  2307 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:00.030094  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:00.030735  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:00.031193  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:00.031298  5095 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:00.005204  5383 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.196s	user 0.002s	sys 0.000s
I20260709 13:00:00.046036  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.046718  1688 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.048138  5309 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:00.048624  5379 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:00.048956  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:00.048949  5309 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:00.050150  5379 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:00.050463  2276 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.051301  5309 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:00.051774  5309 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:00.051952  5382 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:00.052213  5309 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.037436  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:00.052870  2310 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.053390  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.059547  5353 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.061662  4983 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:00.062393  5396 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:00:00.062422  5393 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:00:00.067535  5389 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.068174  5389 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.071786  1541 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:00.076246  5388 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:00.076812  5388 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:00.025059  5392 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:00.078369  5309 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.078970  5388 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:00.072415  5387 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:00.079480  2308 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:00.079805  5387 consensus_queue.cc:1243] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:00.080360  5387 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:00.080103  4917 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.080746  5387 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:00.080915  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2254474190000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:00:00.073575  4914 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.082343  4917 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.082717  4914 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.083089  4914 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.083254  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.084646  5390 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:00.085454  5390 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:00.085577  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.085816  5390 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:00.052115  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:00.081696  5387 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.089447  5387 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.086725  5390 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.094331  5390 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.094914  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:00.084203  5385 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:00.095537  1536 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.072470  2310 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:00.088567  5042 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:00.089774  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.095954  5385 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.096652  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.090227  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.043813  5302 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:00.098481  5302 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:00.087984  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45945.2us
I20260709 13:00:00.092447  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.075898  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:00.088136  1582 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:00.073096  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 68053us
I20260709 13:00:00.078658  5392 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.094262  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.106071  1439 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
W20260709 13:00:00.114400  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 183907us
I20260709 13:00:00.116010  1536 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:00.121620  5309 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.126806  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:00.127439  1540 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.129866  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.130003  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.135895  1613 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.099450  5302 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.137812  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.136451  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.139125  1608 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:00.139187  1610 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:00.141319  1439 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.128716  5382 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:00.087764  5270 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.137355  5108 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.152513  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 58327.6us
I20260709 13:00:00.152246  4224 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:00.156002  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 67949.4us
I20260709 13:00:00.136404  5385 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:00.164700  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.153517  1439 catalog_manager.cc:5697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.166589  1439 catalog_manager.cc:5697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.157514  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.158263  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.112460  5042 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:00.173929  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.177870  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.157022  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.181677  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.182407  1612 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:00.146412  5305 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.181031  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.184558  1614 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:00.184540  1439 catalog_manager.cc:5697] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.186275  1681 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:00.188112  1688 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:00.175932  5309 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:00.196092  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.196964  1608 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 13:00:00.192013  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.211928  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.187692  5297 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:00.210762  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.217689  1439 catalog_manager.cc:5697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 5 to 7, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.220108  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.210073  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.190562  5263 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.189360  5384 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:00.219748  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:00.224555  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.224772  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.225920  1439 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 7, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 7 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.183190  5108 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.227217  1608 raft_consensus.cc:2410] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:00.231648  2304 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:00.232329  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:00.234309  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.234927  1611 raft_consensus.cc:2376] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10. Re-sending same reply.
I20260709 13:00:00.239395  1540 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:00.240468  1439 catalog_manager.cc:5697] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.243185  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.243930  1686 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
W20260709 13:00:00.249140  5395 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:00.253028  5388 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.242847  1439 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 7 to 8, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.227675  1683 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
W20260709 13:00:00.257617  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47009.4us
I20260709 13:00:00.261006  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.261788  1608 raft_consensus.cc:2368] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9.
I20260709 13:00:00.261945  1613 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:00.263168  1615 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:00.237105  5354 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.270841  5270 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.204555  5309 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.188251  5305 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:00.272826  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 92063.6us
W20260709 13:00:00.277127  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.278443  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.229950  5033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46804 (request call id 82) took 5335 ms. Trace:
I20260709 13:00:00.293711  1607 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:00.282146  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.282621  1439 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.284718  5042 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.286456  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:00.287624  5404 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:00.296732  5042 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.298188  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:00.287529  5382 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:00.289150  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.302461  1439 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:00.309336  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.229283  5297 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.313948  1582 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.316082  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.316324  4224 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:00.315246  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:00.317699  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.318303  1613 raft_consensus.cc:2376] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8. Re-sending same reply.
I20260709 13:00:00.317135  5399 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:00.313544  1506 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.069s (SENT)
I20260709 13:00:00.307516  5382 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.321628  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:00.317339  5095 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:00.324579   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:00.324987  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.325901  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:00.322888  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:00.337155  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.299270  5270 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:00:00.336594  1690 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:00.333619  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:00.293457  5388 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.236946  5384 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.301913  5304 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:00.368167  1613 raft_consensus.cc:2368] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 9.
I20260709 13:00:00.368782  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.293022  5033 rpcz_store.cc:276] 0709 12:59:54.890853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.893925 (+  3072us) service_pool.cc:224] Handling call
0709 12:59:55.047364 (+153439us) log.cc:844] Serialized 501 byte log entry
0709 12:59:56.201147 (+1153783us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b18001a45e0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:00.220785 (+4019638us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31502,"raft.queue_time_us":14547,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":519,"spinlock_wait_cycles":76534016}
I20260709 13:00:00.372541  1612 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:00.333089  5263 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.367832  5254 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.380630  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:00.383414  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 66821.7us
W20260709 13:00:00.384435  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 105877us
W20260709 13:00:00.396988  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 88302.4us
I20260709 13:00:00.385310  5384 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:00.388653  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.389118  5309 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:00.389325  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.389667  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.390506  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.391156  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.391402  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:00.392620  5412 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.108s	user 0.004s	sys 0.000s
I20260709 13:00:00.392777  5389 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:00.435321  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 101793us
I20260709 13:00:00.389335  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.394482  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.394531  5108 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:00.398837  1615 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
W20260709 13:00:00.400786  5405 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.003s
I20260709 13:00:00.401315  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.401970  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.440834  1615 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:00.407035  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.369149  4917 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.408980  1611 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:00.447165  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.337880  5410 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:00:00.451467  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 60165.6us
I20260709 13:00:00.451920  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.452692  1685 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:00.410761  5353 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:00.415957  5305 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:00.417968  5388 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:00.419567  5297 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.421098  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.460839  1607 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:00.461674  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.454308  4917 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:00.463054  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.463214  4917 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.466111  1540 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:00.467432  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:00.444516  5389 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.421566  5042 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:00.378058  5354 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:00.424872  1690 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:00.376596  4983 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.405227  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.393241  4914 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.436293  1507 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:00.479873  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:00.430452  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.200s (SENT) [suppressed 41 similar messages]
I20260709 13:00:00.480803  1690 raft_consensus.cc:2410] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:00.480672  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44522.7us
W20260709 13:00:00.481284  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 83674.8us
I20260709 13:00:00.440726  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.404567  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.448534  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.447475  1611 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:00.447186  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.483539  1609 raft_consensus.cc:2368] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:00.450258  1613 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:00.454663  1608 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:00:00.483935  1613 pending_rounds.cc:85] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 7
I20260709 13:00:00.484238  1613 pending_rounds.cc:107] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:00.484467  1613 raft_consensus.cc:2889] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:00.454521  1612 raft_consensus.cc:1240] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:00.455233  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.445231  5108 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.456341  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.454583  5353 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:00.458472  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 61455.4us
I20260709 13:00:00.458763  4846 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:00.459079  5304 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.471130  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.498116  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.486617  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:00.450930  5263 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:00.487763  1682 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:00.455615  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.488852  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:00.491081  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.494660  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:00.503868  1690 raft_consensus.cc:2410] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:00.478639  1689 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:00.499222  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:00.503924  1607 raft_consensus.cc:2410] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:00.512120  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:00.514910  1681 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:00.478363  5389 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:00.525292  1609 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:00:00.527412  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.538643  2305 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 11 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:00:00.539745  1690 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:00.489367  5410 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.545692  1684 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:00.540148  1690 pending_rounds.cc:85] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 7
I20260709 13:00:00.542078  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.543428  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:00.547986  2310 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:00.492614  5380 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.548578  1690 pending_rounds.cc:107] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:00.561247  1690 raft_consensus.cc:2889] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:00.493294  4846 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:00.567226  1687 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
W20260709 13:00:00.549132  1506 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.210s (SENT)
I20260709 13:00:00.568148  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:00.513072  5300 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.576884  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.578966  2308 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:00.548663  5095 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:00.580955  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.580021  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.570150  4846 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:00.586975  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44717.1us
I20260709 13:00:00.500213  5108 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.593154  5108 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.594026  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:00.595072  1610 raft_consensus.cc:2410] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:00.596359  5305 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.597069  5305 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:00.598302  5305 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.583431  5095 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.601276  5095 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.571120  5354 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:00:00.579537  5300 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.604957  5274 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:00:00.605660  4917 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.606397  4917 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.608083  5263 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.582856  5380 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.613736  2304 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:00.614495  5389 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.574817  5410 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:00.660409  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64482.7us
I20260709 13:00:00.661726  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.544389  5304 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.584549  5297 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:00.691497  1687 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:00.692687  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.581154  5382 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.694213  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:00.601580  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:00.692955  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 128560us
I20260709 13:00:00.728344  2301 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:00.733258  1612 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:00.758241  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.695133  1609 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:00.676239  5354 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.732924  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 183792us
I20260709 13:00:00.764889  5418 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:00.766607  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:00.694486  5380 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:00.764444  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.698748  5419 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.696498  5425 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:00.763657  5382 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:00.783571  5354 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.661250  5353 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.828315  5297 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.926175  5413 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:00.849474  5382 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.697152  5410 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.949200  5297 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.949395  5382 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.804811  5419 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:00.926887  5418 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.911586  5095 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.927441  4846 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:00.929351  5390 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.234014  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.256496  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.953797  4914 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:01.155561  4983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.029s	sys 0.026s
I20260709 13:00:01.193809  5353 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:01.372699  4224 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.373549  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:01.197849  5300 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.070781  5304 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.187737  5354 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:01.377552  4983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.029s	sys 0.026s
I20260709 13:00:01.391968  4224 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:01.392259  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 198858us
I20260709 13:00:01.394734  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:01.388603  5389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.020s	sys 0.044s
I20260709 13:00:01.238408  5418 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.312124  5390 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:01.398149  5389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.022s	sys 0.045s
I20260709 13:00:01.389959  5386 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:01.436278  5263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.071s
I20260709 13:00:01.450687  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:01.465813  5440 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.466451  5440 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:01.451435  5263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.016s	sys 0.072s
I20260709 13:00:01.474740  5095 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.478703  5390 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:01.471081  5419 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.450934  5382 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.453579  5389 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.474716  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.475153  4846 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.475396  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.476506  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.469924  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.484014  1686 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:01.484686  1687 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:01.487135  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.488945  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:01.489429  1686 raft_consensus.cc:2376] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10. Re-sending same reply.
I20260709 13:00:01.490792  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.491179  1686 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:01.491709  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:01.492143  1686 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:01.488072  4917 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.495126  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:01.495683  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.496927  1687 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:01.497809  1682 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:01.468998  5386 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.501017  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.488569  5389 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.503371  5389 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.496852  5440 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:01.505295  1683 raft_consensus.cc:2410] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:01.508097  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.510273  1579 leader_election.cc:400] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 13:00:01.510703  1579 leader_election.cc:403] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:00:01.517977  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.518298  5033 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 13:00:01.519809  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:01.522243  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.535543  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2349) took 1094 ms. Trace:
I20260709 13:00:01.538568  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:01.539230  1534 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:01.543138  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.543782  1535 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:01.536007  1610 rpcz_store.cc:276] 0709 13:00:00.437936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.444395 (+  6459us) service_pool.cc:224] Handling call
0709 13:00:01.522623 (+1078228us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001798d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:01.532561 (+  9938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337436544}
I20260709 13:00:01.548019  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.548846  1536 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:01.548941  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.536980  5033 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:01.550485  1540 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:01.536659  5390 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:01.551880  5095 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:01.551504  5390 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:01.552469  5095 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.554661  5390 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:01.557121  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:01.540485  5440 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:01.554677  5095 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.569628  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:01.571096  2305 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:01.571453  1610 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:01.572376  5449 raft_consensus.cc:2764] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:01.572685  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:01.573225  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.574024  2305 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:01.564043  5418 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:01.571969  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:01.577167  2305 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:01.584474  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.585637  1536 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:01.580265  5386 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.580793  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.586794  2308 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:00:01.587450  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1602) took 1093 ms. Trace:
I20260709 13:00:01.587790  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.582289  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.588810  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:01.589121  1533 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:01.589480  1538 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:01.588850  2310 raft_consensus.cc:2410] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:00:01.569151  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:01.591830  1682 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:01.573294  1613 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.585060  2305 pending_rounds.cc:85] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 8
I20260709 13:00:01.607290  2305 pending_rounds.cc:107] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:01.608382  2305 raft_consensus.cc:2889] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:01.613381  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:01.701726  5390 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:01.591759  5444 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:01.707437  1534 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
W20260709 13:00:01.721591  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 108340us
I20260709 13:00:01.736284  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2354) took 1164 ms. Trace:
I20260709 13:00:01.736907  1612 rpcz_store.cc:276] 0709 13:00:00.571648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.571812 (+   164us) service_pool.cc:224] Handling call
0709 13:00:01.735972 (+1164160us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003f4654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:01.736169 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357643520}
I20260709 13:00:01.591406  5380 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:01.757718  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.758623  1532 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
W20260709 13:00:01.759081  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.594205  5440 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.760888  5447 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:01.788594  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 65958.4us
I20260709 13:00:01.787920  1538 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:01.789474  1613 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 13:00:01.791191  1504 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:01.793705  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 167893us
W20260709 13:00:01.794143  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 218800us
W20260709 13:00:01.795549  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 223661us
I20260709 13:00:01.796605  5419 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:01.797072  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:01.587826  1681 rpcz_store.cc:276] 0709 13:00:00.494210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.552379 (+ 58169us) service_pool.cc:224] Handling call
0709 13:00:01.582907 (+1030528us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 13:00:01.583093 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.583502 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:01.583529 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.587214 (+  3685us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:01.587249 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.587304 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.587401 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175,"spinlock_wait_cycles":19612928}
W20260709 13:00:01.800310  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.801402  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:01.793758  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.767169  5380 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.827649  2305 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:01.830341  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff79ac342d91424db634ca7802846535 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
W20260709 13:00:01.836925  1579 connection.cc:256] RPC call timeout handler was delayed by -2.0147093439999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:01.838703  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:01.821254  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:01.788663  5418 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:01.841075  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.843159  2310 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:00:01.812398  5392 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:01.847893  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47180us
I20260709 13:00:01.848722  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.854292  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.854807  5300 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:01.855285  5300 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.855646  5300 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:01.856333  1506 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.593s (SENT)
W20260709 13:00:01.857920  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.859772  1506 leader_election.cc:336] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.564s (SENT)
I20260709 13:00:01.840509  5443 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:01.864282  5300 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.864694  5443 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:01.866272  5440 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.866559  5300 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:01.867679  5443 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:01.869477  5380 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:01.821240  5369 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:01.870568  5369 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.855584  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.872157  2308 raft_consensus.cc:2368] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 13:00:01.860122  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:01.799165  4983 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:00:01.882923  5263 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.883576  5263 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:01.884018  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.885180  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.885731  5263 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.885916  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:01.798995  4917 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:00:01.848439  5042 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:01.879657  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:01.890781  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:01.871444  5392 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.870978  5369 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:01.903348  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:01.874349  5390 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:01.907043  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:01.907665  1614 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:01.899945  2310 raft_consensus.cc:2955] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:01.908480  1579 leader_election.cc:400] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8.
I20260709 13:00:01.908681  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:01.908463  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:01.908434  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:01.910395  1615 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:01.907035  5390 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:01.913039  5390 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:01.915149  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:01.909554  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 860) took 1422 ms. Trace:
I20260709 13:00:01.915984  1609 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:01.915916  2304 rpcz_store.cc:276] 0709 13:00:00.487443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.487629 (+   186us) service_pool.cc:224] Handling call
0709 13:00:00.502914 (+ 15285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.614088 (+111174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.904264 (+1290176us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540015e0d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:01.909473 (+  5209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254124288}
W20260709 13:00:01.924283  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64529.5us
W20260709 13:00:01.924964  1506 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.608s (SENT)
I20260709 13:00:01.896003  4983 consensus_queue.cc:1243] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:00:01.925689  1506 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.614s (SENT)
I20260709 13:00:01.895967  5042 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.930884  5042 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:01.904829  5443 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:01.905045  5392 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:01.850720  5418 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:01.948608  1506 leader_election.cc:336] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.658s (SENT)
I20260709 13:00:01.955201  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:01.901759  5263 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:00:01.967417  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 128797us
W20260709 13:00:01.967820  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 54312.6us
I20260709 13:00:01.924290  5304 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:01.969417  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:01.929025  5449 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:01.984642  5463 consensus_queue.cc:1059] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:01.986528  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:01.988631  1614 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:01.989887  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:01.992825  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:01.995026  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:01.998577  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:01.999224  1533 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.003310  5418 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:01.977041  5263 consensus_queue.cc:1243] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:02.013185  1615 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:02.014418  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:01.981012  5446 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:01.986018  5449 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:02.017685  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69121us
I20260709 13:00:01.980679  5436 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:02.024873  5458 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:02.018997  1614 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:02.020526  1506 leader_election.cc:336] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.672s (SENT)
I20260709 13:00:02.026146  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.013830  4917 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.027627  5449 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:02.045382  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 541) took 1594 ms. Trace:
I20260709 13:00:02.045274  5353 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:02.013689  5454 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:00:02.046737  1506 leader_election.cc:336] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.693s (SENT)
I20260709 13:00:02.052042  1533 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:02.045989  1685 rpcz_store.cc:276] 0709 13:00:00.448994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.540402 (+ 91408us) service_pool.cc:224] Handling call
0709 13:00:02.015873 (+1475471us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 13:00:02.016095 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.016339 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:02.030496 (+ 14157us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.043376 (+ 12880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.043433 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.043474 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.043544 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.043665 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13994,"prepare.run_cpu_time_us":6196,"prepare.run_wall_time_us":10049,"spinlock_wait_cycles":21720320,"thread_start_us":12239,"threads_started":1}
I20260709 13:00:02.031106  5459 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.044477  5302 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:02.057735  5455 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:02.049839  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:02.070856  5418 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 13:00:02.071597  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 76729.2us
I20260709 13:00:02.071508  5418 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.072794  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:02.075845  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 96646.9us
I20260709 13:00:02.068451  5353 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.028091  5446 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:02.089375  1506 leader_election.cc:336] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.746s (SENT)
I20260709 13:00:02.091287  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.074353  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.090760  5302 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.120728  4917 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.123343  5472 raft_consensus.cc:3055] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:02.132697  5472 raft_consensus.cc:740] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:02.134812  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45465.8us
W20260709 13:00:02.139505  1506 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.715s (SENT)
I20260709 13:00:02.140477  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 862) took 1639 ms. Trace:
I20260709 13:00:02.140923  2301 rpcz_store.cc:276] 0709 13:00:00.501361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.501754 (+   393us) service_pool.cc:224] Handling call
0709 13:00:00.538807 (+ 37053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.755336 (+216529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.140191 (+1384855us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540010b8d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:02.140411 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369806720}
I20260709 13:00:02.145617  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:02.135211  5437 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.665s	user 0.005s	sys 0.013s
I20260709 13:00:02.148777  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.140139  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:02.149493  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 75262.3us
I20260709 13:00:02.150949  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.149435  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1726) took 1986 ms. Trace:
I20260709 13:00:02.153316  1690 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.154024  1616 rpcz_store.cc:276] 0709 13:00:00.137965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.138395 (+   430us) service_pool.cc:224] Handling call
0709 13:00:00.173036 (+ 34641us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.211455 (+ 38419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.211501 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:00.225056 (+ 13555us) log.cc:844] Serialized 52 byte log entry
0709 13:00:00.444535 (+219479us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:00.444570 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.121856 (+1677286us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5400216954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:02.121905 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.121953 (+    48us) raft_consensus.cc:1685] finished
0709 13:00:02.121971 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.124519 (+  2548us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14549,"raft.queue_time_us":22077,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7502,"spinlock_wait_cycles":35349376,"thread_start_us":136156,"threads_started":1,"wal-append.queue_time_us":167518,"wal-append.run_cpu_time_us":1840,"wal-append.run_wall_time_us":1001892}
I20260709 13:00:02.163559  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.200133  1614 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:02.167196  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:02.163205  1506 leader_election.cc:336] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.752s (SENT)
I20260709 13:00:02.162930  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:02.163254  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.166890  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:02.156505  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.122308  5418 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.215154  5369 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.215548  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.207726  2307 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:02.205684  1535 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:02.203994  1613 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:02.205866  1682 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:02.179755  5379 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:02.200942  1612 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:02.204159  5095 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:02.204067  5436 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:02.204054  5304 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.224763  5095 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.225098  5304 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.202549  5263 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.214085  5390 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.195746  1690 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:02.218720  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:02.202359  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:02.220064  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 127568us
I20260709 13:00:02.162822  5302 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.223261  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 540) took 1774 ms. Trace:
I20260709 13:00:02.202272  5305 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:02.134042  5472 consensus_queue.cc:260] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.156895  5463 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 13:00:02.232126  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1606) took 1652 ms (client timeout 1658 ms). Trace:
I20260709 13:00:02.223059  5379 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:02.237151  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73997.5us
I20260709 13:00:02.168800  5042 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:02.238947  1506 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.761s (SENT)
I20260709 13:00:02.239305  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:02.236464  1690 rpcz_store.cc:269] 0709 13:00:00.577119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.577234 (+   115us) service_pool.cc:224] Handling call
0709 13:00:02.148635 (+1571401us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 13:00:02.229105 (+ 80470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6132608}
I20260709 13:00:02.232728  1688 rpcz_store.cc:276] 0709 13:00:00.448761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.520526 (+ 71765us) service_pool.cc:224] Handling call
0709 13:00:01.992720 (+1472194us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc24fc0 00007f8d5dc0f929 00007f8d5dc0f3d2 00007f8d57186bd4
0709 13:00:01.992902 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.993103 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:01.993393 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.222942 (+229549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.222996 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.223037 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.223106 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.223220 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1676,"prepare.queue_time_us":4924,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":1377,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":109,"spinlock_wait_cycles":12549504,"thread_start_us":228536,"threads_started":1}
W20260709 13:00:02.242319  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.237617  1684 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
W20260709 13:00:02.244786  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 536) took 2098 ms (client timeout 1866 ms). Trace:
I20260709 13:00:02.231892  5354 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.178843  5446 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:02.245221  1689 rpcz_store.cc:269] 0709 13:00:00.143024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.143118 (+    94us) service_pool.cc:224] Handling call
0709 13:00:02.240837 (+2097719us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540032e1d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:02.240947 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680249600}
I20260709 13:00:02.236377  5410 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.236073  5353 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.240453  5379 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:02.230826  5263 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.230216  5436 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.248441  5472 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.248481  5302 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:02.304991  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66084.6us
I20260709 13:00:02.303495  5475 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.309039  5095 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:02.310141  5474 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:02.310912  5263 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.313409  5304 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.315054  5042 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:02.317479  5471 log.cc:927] Time spent T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:00:02.320168  5390 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:02.322644  5369 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.322525  5392 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.324070  1536 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:02.324782  1506 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.955s (SENT)
I20260709 13:00:02.325405  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.328336  5410 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:02.240686  5305 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:02.329630  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.343257  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 97918us
W20260709 13:00:02.360972  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.329146  5297 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:02.366192  5439 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.911s	user 0.003s	sys 0.014s
I20260709 13:00:02.372612  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:02.376925  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1905) took 2439 ms (client timeout 2177 ms). Trace:
W20260709 13:00:02.377413  1539 rpcz_store.cc:269] 0709 12:59:59.937811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.937994 (+   183us) service_pool.cc:224] Handling call
0709 13:00:02.376683 (+2438689us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002c8154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:02.376825 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428596224}
I20260709 13:00:02.380577  5478 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:00:02.383013  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.388142  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.388870  5392 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.389463  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.403656  1612 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 13:00:02.389909  5305 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.390174  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.383612  5379 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.391261  1616 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:02.392282  1614 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:02.392932  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.394747  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.406870  1609 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
W20260709 13:00:02.395356  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65035.3us
I20260709 13:00:02.395509  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.407888  1615 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:02.388995  1610 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:02.409094  1506 leader_election.cc:336] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.974s (SENT)
I20260709 13:00:02.409633  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.383014  5436 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.410926  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.411293  5485 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:02.411659  1690 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 13:00:02.411856  5297 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.412474  5486 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:00:02.412441  5297 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.414378  5449 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.414880  5297 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.417441  5478 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:02.417783  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.418498  1682 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 13:00:02.419245  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.419966  1688 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:02.410146  5305 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.420683  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.421334  1689 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:02.421170  5305 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.423488  5305 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.424206  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.409575  5302 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:02.425590  5478 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.425705  5302 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.426172  5478 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.428607  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.433092  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:02.434160  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.434520  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:02.434839  1535 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:02.435916  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.436178  5392 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:02.436784  5392 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.437359  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.437562  5484 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:02.437979  1541 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.438362  5484 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:02.438733  5484 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:02.439038  5392 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.442332  1538 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:02.435760  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:02.445868  1689 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
W20260709 13:00:02.410775  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 179348us
I20260709 13:00:02.448185  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.439061  5484 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:02.452105  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:02.452350  5428 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.452575  1507 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.452893  5428 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.453866  1507 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.454418  5440 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:02.454788  5447 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:02.455034  5428 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.452764  1607 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:02.451668  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:02.455852  1507 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.419427  5483 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.458058  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:02.458385  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.428050  5302 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.443646  5454 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Committing config change with OpId 8.8: config changed from index 2 to 8, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:02.695124  2307 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:02.525856  5463 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:02.698176  5463 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:02.698674  5463 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.437908  5379 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:02.458808  5436 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.700729  5436 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.701184  5436 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:02.525323  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73730.3us
I20260709 13:00:02.704083  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.704203  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.682818  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 443) took 1053 ms. Trace:
I20260709 13:00:02.705416  1612 raft_consensus.cc:2376] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8. Re-sending same reply.
I20260709 13:00:02.705914  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.458607  5399 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.706544  1688 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:02.709559  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.555203  1607 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:02.713117  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:02.713773  2310 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:02.494359  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.704962  1536 rpcz_store.cc:276] 0709 13:00:01.601386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.602632 (+  1246us) service_pool.cc:224] Handling call
0709 13:00:02.640125 (+1037493us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400073854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:02.654648 (+ 14523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191667072}
W20260709 13:00:02.703930  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 268257us
I20260709 13:00:02.620005  1541 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:02.455371  5447 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:02.725559  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 231283us
W20260709 13:00:02.726536  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 270763us
I20260709 13:00:02.729943  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.731310  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.732717  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:02.733234  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 324183us
W20260709 13:00:02.585695  5435 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 1.115s	user 0.010s	sys 0.011s
W20260709 13:00:02.637748  5442 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 1.164s	user 0.003s	sys 0.011s
I20260709 13:00:02.457762  5478 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.735082  4224 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.735240  2304 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:02.736159  2305 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:02.736567  5305 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.728410  5399 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.682539  4917 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.728880  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.560662  5095 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.577580  5440 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.755359  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.644635  5390 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:02.735278  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:02.744940  2307 pending_rounds.cc:85] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 4
I20260709 13:00:02.525723  5392 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:02.577260  5410 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:02.756404  2301 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:02.734258  5389 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.524641  5304 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.747398  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:02.733909  1506 leader_election.cc:336] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.178s (SENT)
I20260709 13:00:02.542526  5449 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:02.749305  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.754663  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.721101  5300 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.745895  5380 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:02.756285  2307 pending_rounds.cc:107] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:02.786360  2307 raft_consensus.cc:2889] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:02.752843  5419 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:02.761967  5382 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.751617  5108 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:00:02.728353  5483 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.561614  5484 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.794231  5490 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:02.795748  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.795925  5483 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.796239  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.796619  1616 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:02.797107  1534 raft_consensus.cc:2410] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:02.786141  5410 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.797962  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.798557  1534 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:02.798996  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.799293  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.799600  1539 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:02.800515  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.801221  1614 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:02.801712  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.751310  5459 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.804584  5459 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.805263  5399 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:02.763958  5491 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:02.790431  5382 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:02.788110  5274 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.807024  5382 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.807071  5274 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:02.807617  5274 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.760954  4917 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.808727  5447 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.809401  1579 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.810173  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.764936  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:02.811333  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 46485.1us
I20260709 13:00:02.812121  5353 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:02.812559  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:02.811935  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:02.813460  4224 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:02.813719  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1604) took 2267 ms (client timeout 2230 ms). Trace:
I20260709 13:00:02.814272  5033 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:02.814208  1684 rpcz_store.cc:269] 0709 13:00:00.546530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.551206 (+  4676us) service_pool.cc:224] Handling call
0709 13:00:02.215340 (+1664134us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b580010fe98. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55b26b71 00007f8d55b26a22 00007f8d5ea3fc09 00007f8d5db99ee0 00007f8d5dc630ab 00007f8d5dc63131 00007f8d5dc110a0 00007f8d5dc10984 00007f8d5718b6d4 00007f8d5718b662
0709 13:00:02.813567 (+598227us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b5400440f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:02.813656 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57601024}
I20260709 13:00:02.814493  5444 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.787813  5380 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:02.759950  5390 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:02.818231  5390 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.819427  5390 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.783278  5095 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:02.826584  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.827627  1534 raft_consensus.cc:2410] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:02.744372  5430 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:00:02.832792  1613 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:02.764789  5389 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.833352  5389 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.833999  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.835294  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.784950  5304 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:02.786617  5428 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:02.781801  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.752147  5305 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.837380  5305 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.838310  5304 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:02.813074  5353 consensus_queue.cc:1243] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:02.813855  4224 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:02.841657  4224 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.842897  5491 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:02.843603  5491 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.844579  5419 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:02.845000  5419 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:02.816951  5444 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.785404  5300 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:02.795990  5484 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:02.782025  1536 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:02.849769  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.854967  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.844594  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.855644  1536 raft_consensus.cc:2368] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:02.856034  1532 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:02.851257  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.849299  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.859246  1537 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:00:02.845010  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:02.863477  1536 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:02.759619  5440 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.747395  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.887247  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.887584  1536 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:02.845242  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 111374us
I20260709 13:00:02.853349  2275 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.886336  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.867003  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.889082  1534 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:02.869839  1504 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.765358  5297 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:02.855391  1681 raft_consensus.cc:2376] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8. Re-sending same reply.
W20260709 13:00:02.893090  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81224.3us
W20260709 13:00:02.905951  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.892383  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.904786  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.907541  1534 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.907778  1536 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:02.908244  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.908797  1689 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.904786  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:02.894451  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.905246  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.912470  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:02.906781  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:02.914526  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.915169  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.915716  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.915964  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.916612  1615 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:02.910912  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:02.918305  1541 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:02.906747  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:02.920660  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67418.2us
I20260709 13:00:02.921891  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:02.920814  1537 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:00:02.845511  5444 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.847751  5300 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:02.925252  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.926923  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.927577  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.856638  5428 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:02.920508  1653 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:02.892338  5440 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.915099  4846 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:02.928604  1688 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:02.932960  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:02.927141  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:02.935259  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.935570  5309 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:02.936610  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.936743  2276 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:02.940109  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.958223  1682 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:02.892553  5491 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:02.945634  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:02.930758  1656 leader_election.cc:336] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 1.946s (SENT)
I20260709 13:00:02.946139  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.921373  5369 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:02.956120  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:02.845923  5443 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:00:02.956280  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.984243  1615 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
W20260709 13:00:02.985828  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.970810  1684 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:02.954643  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:02.928952  5095 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:02.967052  1536 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:02.939692  5446 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.931286  5418 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.959740  1681 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:02.960865  1685 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:02.955704  4846 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:02.993530  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 56900.7us
I20260709 13:00:02.930244  5353 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.845825  5419 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.027040  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:03.003131  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:03.028716  1612 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:02.960757  5491 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:02.953329  5484 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:02.941017  5475 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:03.007861  5386 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:03.009033  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54502.6us
I20260709 13:00:03.009166  5108 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:03.014418  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:03.002676  5443 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:02.992959  4224 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.001046  1689 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:02.930004  5485 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:00:03.006099  5095 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:03.060176  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:03.061760  5493 log.cc:927] Time spent T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:03.062129  5502 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:03.066839  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.080988  1534 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:03.086066  1614 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:03.088805  1615 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:03.092494  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:03.095098  2275 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:03.096383  4224 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:03.027711  4846 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:03.055536  5484 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.056326  5475 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.078668  5491 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:03.107077  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 199462us
I20260709 13:00:03.064729  5386 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:03.077783  5108 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:03.138593  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:03.120481  4224 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:03.032009  4917 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:03.002839  5482 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.182s
I20260709 13:00:03.150374  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:02.997817  5380 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.152041  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:03.129528  5449 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:03.131143  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:03.159893  1609 raft_consensus.cc:2410] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:03.159637  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:03.007040  5446 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.055776  5353 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.083889  5443 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:03.150893  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 127661us
I20260709 13:00:03.118665  5484 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:03.135466  5459 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:03.160902  1683 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:00:03.162954  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.161806  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 369780us
W20260709 13:00:03.165038  1656 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 2.027s (SENT)
I20260709 13:00:03.119804  5502 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:03.136986  5386 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:03.122514  5475 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:03.173316  2304 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:03.174314  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:03.155824  5419 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:03.201018  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:03.142333  5510 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:03.159154  5449 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:03.204936  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45415.5us
I20260709 13:00:03.245669  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:03.168082  5270 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:03.218824  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:03.219738  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:03.223785  1540 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: [10.8-13.9]
I20260709 13:00:03.223788  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:03.172514  4917 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:03.155345  5302 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:03.176841  5354 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:03.234820  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:03.237970  5506 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:03.238353  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:03.239840  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:03.240984  2303 pending_rounds.cc:85] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 6
I20260709 13:00:03.230820  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:03.243371  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 92927us
W20260709 13:00:03.243880  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 111324us
I20260709 13:00:03.198437  5309 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:03.238469  5391 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.175s
I20260709 13:00:03.148553  5428 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.373723  1532 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:03.376585  2303 pending_rounds.cc:107] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:03.377061  2303 raft_consensus.cc:2889] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:03.247157  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:03.404318  1656 connection.cc:256] RPC call timeout handler was delayed by -3.4311400299999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:00:03.186029  5463 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:03.406281  1656 connection.cc:256] RPC call timeout handler was delayed by -3.375340030000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:00:03.410748  1656 connection.cc:256] RPC call timeout handler was delayed by -3.3384400300000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:00:03.411100  1656 connection.cc:256] RPC call timeout handler was delayed by -3.322240029999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:00:03.411425  1656 connection.cc:256] RPC call timeout handler was delayed by -3.3105400300000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:00:03.411733  1656 connection.cc:256] RPC call timeout handler was delayed by -3.2727400300000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:00:03.412011  1656 connection.cc:256] RPC call timeout handler was delayed by -3.2601400300000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:00:03.412320  1656 connection.cc:256] RPC call timeout handler was delayed by -3.2511400299999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 13:00:03.235200  5436 consensus_meta.cc:287] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.533s	user 0.000s	sys 0.009s
I20260709 13:00:03.375538  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:03.374121  2306 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
W20260709 13:00:03.404503  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 158902us
I20260709 13:00:03.203924  5095 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:03.412669  1656 connection.cc:256] RPC call timeout handler was delayed by -3.198940030000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 13:00:03.415357  1506 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:03.372641  5465 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:00:03.376283  5382 consensus_meta.cc:287] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
W20260709 13:00:03.358162  5274 consensus_meta.cc:287] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.008s
W20260709 13:00:03.457793  1656 connection.cc:256] RPC call timeout handler was delayed by -3.1782400299999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:00:03.356796  5489 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:03.373652  5270 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.461555  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 226802us
I20260709 13:00:03.462057  5302 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:03.462551  4917 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:03.481094  1656 connection.cc:256] RPC call timeout handler was delayed by -3.1746400300000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:00:03.494834  1656 connection.cc:256] RPC call timeout handler was delayed by -3.1116400299999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:00:03.495189  1656 connection.cc:256] RPC call timeout handler was delayed by -3.0648400300000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:00:03.495476  1656 connection.cc:256] RPC call timeout handler was delayed by -3.0441400299999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:00:03.495760  1656 connection.cc:256] RPC call timeout handler was delayed by -3.0099400299999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:00:03.496048  1656 connection.cc:256] RPC call timeout handler was delayed by -2.9946400300000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:00:03.496356  1656 connection.cc:256] RPC call timeout handler was delayed by -2.9703400299999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:00:03.496636  1656 connection.cc:256] RPC call timeout handler was delayed by -2.9343400299999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:00:03.496904  1656 connection.cc:256] RPC call timeout handler was delayed by -2.9181400300000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 13:00:03.497190  1656 connection.cc:256] RPC call timeout handler was delayed by -2.8866400300000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
I20260709 13:00:03.330780  5510 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 13:00:03.435055  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.244072  5108 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:03.272641  5495 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:00:03.405678  5354 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:03.484655  1689 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:03.418582  5454 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:00:03.490361  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:03.641229  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 150938us
I20260709 13:00:03.483743  5382 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.493813  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:03.652004  1540 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:03.278220  5353 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:03.462077  5379 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:03.483261  5305 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
W20260709 13:00:03.414196  5474 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.161s	user 0.004s	sys 0.000s
W20260709 13:00:03.514227  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 98949us
I20260709 13:00:03.358647  4846 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.497763  4917 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.590116  5392 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:03.582376  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.463477  5436 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.243790  5443 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.536538  5108 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:03.658631  5390 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.839s	user 0.013s	sys 0.001s
I20260709 13:00:03.486675  5274 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.494272  5270 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:03.483580  5449 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.688048  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:03.364730  5502 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.693650  2310 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:03.497465  1656 connection.cc:256] RPC call timeout handler was delayed by -2.8119400300000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 13:00:03.508204  5489 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:03.696101  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 320651us
I20260709 13:00:03.660071  4917 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:03.665607  5379 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:03.782649  5519 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:03.787226  5522 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:03.658103  5305 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.886088  5436 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:03.754485  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.886541  1610 raft_consensus.cc:2368] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 13:00:03.886864  5447 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:03.780797  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 548) took 1287 ms. Trace:
I20260709 13:00:03.588934  5309 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:03.833662  5503 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:00:03.764600  5354 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:03.781893  5518 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.317s	user 0.000s	sys 0.000s
W20260709 13:00:03.768347  5302 consensus_queue.cc:1175] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c445b7b7d94f48f99a3599ddfc92f462" responder_term: 11 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:00:03.696385  5389 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
I20260709 13:00:03.698442  5510 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:03.854490  1656 connection.cc:256] RPC call timeout handler was delayed by -2.8047400300000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:00:03.882889  5463 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:03.883636  5379 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.878402  5519 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:03.884508  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:03.884835  5522 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:03.887441  1690 rpcz_store.cc:276] 0709 13:00:02.493767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.494273 (+   506us) service_pool.cc:224] Handling call
0709 13:00:02.494626 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.796859 (+302233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.796887 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.797289 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.914789 (+117500us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:02.914825 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.140936 (+226111us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002a58d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:03.140999 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.780377 (+639378us) raft_consensus.cc:1685] finished
0709 13:00:03.780407 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.780712 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5022,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":694342912,"thread_start_us":117134,"threads_started":1,"wal-append.queue_time_us":158345}
W20260709 13:00:03.836179  5521 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:00:03.887410  5447 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.919015  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2364) took 1056 ms. Trace:
I20260709 13:00:03.942536  1610 rpcz_store.cc:276] 0709 13:00:02.862602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.068397 (+205795us) service_pool.cc:224] Handling call
0709 13:00:03.887866 (+819469us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b540009b0d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:03.918945 (+ 31079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818386688}
I20260709 13:00:03.893754  2302 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:03.842859  5390 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.878583  5507 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
W20260709 13:00:03.928673  1656 connection.cc:256] RPC call timeout handler was delayed by -2.7705400300000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22660000000000002s for a response
W20260709 13:00:03.949724  1656 connection.cc:256] RPC call timeout handler was delayed by -2.4870400300000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2581s for a response
W20260709 13:00:03.950201  1656 connection.cc:256] RPC call timeout handler was delayed by -2.0379400300000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30800000000000005s for a response
W20260709 13:00:03.950528  1656 connection.cc:256] RPC call timeout handler was delayed by -1.940740030000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31880000000000003s for a response
I20260709 13:00:03.840423  4846 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:03.932297  1506 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.553s (SENT)
W20260709 13:00:03.899835  5440 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.939s	user 0.011s	sys 0.000s
I20260709 13:00:03.887534  5305 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:03.881692  5443 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:03.956651  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.939548  5519 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:03.968464  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:00:03.969472  1690 raft_consensus.cc:606] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:03.969859  1690 raft_consensus.cc:614] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:03.970935  5527 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:03.971534  5499 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.747s	user 0.005s	sys 0.002s
I20260709 13:00:03.971737  5527 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:03.973457  5515 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.617s	user 0.006s	sys 0.000s
W20260709 13:00:03.975333  5513 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.618s	user 0.000s	sys 0.006s
I20260709 13:00:03.961714  5440 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:03.989171  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1956) took 1058 ms. Trace:
I20260709 13:00:03.990777  5440 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:03.989715  1684 rpcz_store.cc:276] 0709 13:00:02.931225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.997380 (+ 66155us) service_pool.cc:224] Handling call
0709 13:00:02.997729 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:03.005739 (+  8010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.005771 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:03.026996 (+ 21225us) log.cc:844] Serialized 52 byte log entry
0709 13:00:03.143465 (+116469us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.143524 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.143622 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.974450 (+830828us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:03.988759 (+ 14309us) raft_consensus.cc:1685] finished
0709 13:00:03.988792 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.989071 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1182,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10683,"spinlock_wait_cycles":44423424,"thread_start_us":84132,"threads_started":1,"wal-append.queue_time_us":184528}
I20260709 13:00:03.991460  5440 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:03.992870  1533 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:03.977270  5514 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.441s	user 0.000s	sys 0.006s
W20260709 13:00:03.979197  5504 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.800s	user 0.000s	sys 0.007s
I20260709 13:00:03.952091  5390 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.011195  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 581) took 1299 ms. Trace:
I20260709 13:00:03.930703  5389 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:04.008579  5485 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:04.008910  5527 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.011288  5390 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:03.951364  5484 consensus_meta.cc:287] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.001s
I20260709 13:00:03.957125  5354 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:03.962332  5491 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.001s
I20260709 13:00:04.011866  2307 rpcz_store.cc:276] 0709 13:00:02.711598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.711742 (+   144us) service_pool.cc:224] Handling call
0709 13:00:02.734260 (+ 22518us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:02.815714 (+ 81454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.815748 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:02.816279 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:00:03.047742 (+231463us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.047797 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.047892 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.978301 (+930409us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:04.010785 (+ 32484us) raft_consensus.cc:1685] finished
0709 13:00:04.010815 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.011115 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1152,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":20024064,"thread_start_us":230965,"threads_started":1,"wal-append.queue_time_us":288889}
W20260709 13:00:04.033628  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.003s	sys 0.033s
W20260709 13:00:04.034166  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.003s	sys 0.033s
I20260709 13:00:04.035573  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 587) took 1018 ms. Trace:
I20260709 13:00:04.036031  2301 rpcz_store.cc:276] 0709 13:00:03.017107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.017268 (+   161us) service_pool.cc:224] Handling call
0709 13:00:03.017593 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.017942 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.017970 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.018464 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.112433 (+ 93969us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:03.112474 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.112540 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.035361 (+922821us) raft_consensus.cc:1685] finished
0709 13:00:04.035382 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.035515 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4603,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":29348,"thread_start_us":93567,"threads_started":1,"wal-append.queue_time_us":396175}
I20260709 13:00:04.038228  2304 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:04.040630  1539 raft_consensus.cc:2368] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 13:00:03.992053  5440 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.037417  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.051977  5532 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.052731  5532 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:04.042876  5518 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:00:04.036703  4914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.041s
I20260709 13:00:04.055722  5532 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:04.180701  5489 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:04.033267  5484 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.187496  5484 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:04.071215  5382 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.044658  5491 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.191437  5491 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:04.192813  1541 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:04.196914  5487 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:04.197335  5487 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:04.197818  5487 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.202853  5472 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:04.203424  5472 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:04.188160  5484 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.037753  5390 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:00:04.206097  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.206653  5440 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.209618  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 504) took 1356 ms. Trace:
I20260709 13:00:04.209975  5389 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:04.210041  1607 rpcz_store.cc:276] 0709 13:00:02.854223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.854370 (+   147us) service_pool.cc:224] Handling call
0709 13:00:02.854715 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.854949 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:03.124295 (+269346us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.209305 (+1085010us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.209354 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:04.209397 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.209460 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.209564 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174769,"prepare.queue_time_us":153413,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":174991,"thread_start_us":1142216,"threads_started":2,"wal-append.queue_time_us":1015017}
W20260709 13:00:04.221140  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.222384  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:04.166319  4914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.009s	sys 0.041s
I20260709 13:00:04.236071  1607 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:04.224334  5270 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:04.234360  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:04.259290  5386 consensus_meta.cc:287] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.014s	user 0.003s	sys 0.004s
I20260709 13:00:04.259953  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:04.236600  5444 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.289s	user 0.013s	sys 0.000s
W20260709 13:00:04.264735  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48956.5us
I20260709 13:00:04.220903  5532 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:04.266603  5522 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:04.350551  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:04.352042  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:04.267632  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 561) took 1173 ms. Trace:
I20260709 13:00:04.268184  5520 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.244509  5274 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:04.272073  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.278853  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.290201  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 871) took 1113 ms. Trace:
I20260709 13:00:04.311444  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1753) took 1465 ms. Trace:
I20260709 13:00:04.357096  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 506) took 1492 ms. Trace:
I20260709 13:00:04.359135  1614 rpcz_store.cc:276] 0709 13:00:02.846376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.849527 (+  3151us) service_pool.cc:224] Handling call
0709 13:00:02.907888 (+ 58361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.095080 (+187192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.311184 (+1216104us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003f4b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:04.311378 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409308416}
I20260709 13:00:04.358403  2310 rpcz_store.cc:276] 0709 13:00:03.176649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.176804 (+   155us) service_pool.cc:224] Handling call
0709 13:00:03.177076 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.854383 (+677307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.289896 (+435513us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400650254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:04.290119 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187691392}
I20260709 13:00:04.315346  5449 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:04.323462  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1941) took 1891 ms (client timeout 1727 ms). Trace:
I20260709 13:00:04.323522  5524 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:04.326172  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 872) took 1091 ms. Trace:
I20260709 13:00:04.365806  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:04.292090  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2400) took 1397 ms. Trace:
I20260709 13:00:04.367089  1541 rpcz_store.cc:276] 0709 13:00:02.894942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.918969 (+ 24027us) service_pool.cc:224] Handling call
0709 13:00:02.919145 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.193231 (+1274086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.291843 (+ 98612us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002d78d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:04.291995 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929025280}
I20260709 13:00:04.264353  5463 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:04.365365  1533 rpcz_store.cc:269] 0709 13:00:02.431900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.833718 (+401818us) service_pool.cc:224] Handling call
0709 13:00:04.323200 (+1489482us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002c7c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:04.323363 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663437696}
I20260709 13:00:04.332067  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2388) took 1539 ms. Trace:
W20260709 13:00:04.329922  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 373270us
I20260709 13:00:04.337725  4224 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:04.373322  1539 rpcz_store.cc:276] 0709 13:00:02.800397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.801492 (+  1095us) service_pool.cc:224] Handling call
0709 13:00:04.288108 (+1486616us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002256d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:04.332003 (+ 43895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844043008}
I20260709 13:00:04.265973  5506 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:04.340252  5270 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.329285  5472 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:04.271610  5475 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.024s	user 0.004s	sys 0.004s
I20260709 13:00:04.352696  1608 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:04.352710  1689 rpcz_store.cc:276] 0709 13:00:03.094027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.094201 (+   174us) service_pool.cc:224] Handling call
0709 13:00:03.094582 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.635970 (+541388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.267367 (+631397us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54001a5c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:04.267553 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896714112}
W20260709 13:00:04.330879  5108 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.629s	user 0.005s	sys 0.004s
I20260709 13:00:04.269767  5446 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:04.355860  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:04.394147  1607 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:04.354964  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 213278us
I20260709 13:00:04.353917  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:04.366094  2302 rpcz_store.cc:276] 0709 13:00:03.234513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.409845 (+175332us) service_pool.cc:224] Handling call
0709 13:00:03.487831 (+ 77986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.943722 (+455891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.280123 (+336401us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001342d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:04.326086 (+ 45963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929630592}
W20260709 13:00:04.373623  1506 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.759s (SENT)
I20260709 13:00:04.398203  1506 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.338243  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:04.355082  4917 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:04.381384  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 367649us
I20260709 13:00:04.400206  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.359380  1616 rpcz_store.cc:276] 0709 13:00:02.864753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.171400 (+306647us) service_pool.cc:224] Handling call
0709 13:00:03.199838 (+ 28438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.200031 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:03.229759 (+ 29728us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.195397 (+965638us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b18003de460. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 13:00:04.356626 (+161229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.356701 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:04.356770 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.356864 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.357012 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6995,"prepare.queue_time_us":35213,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":966591,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"spinlock_wait_cycles":169551104,"thread_start_us":160904,"threads_started":1}
I20260709 13:00:04.389668  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:04.405105  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:04.405696  1607 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:04.407325  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 53503.6us
I20260709 13:00:04.407599  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:04.415683  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.409026  1582 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:04.418218  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 378381us
W20260709 13:00:04.420022  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.380522  5506 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.420118  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:04.428239  4224 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:04.421741  1539 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:04.337456  5386 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.428159  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:04.427692  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:04.344002  5519 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:04.423228  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 1.24901e+06us
I20260709 13:00:04.430261  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:04.433393  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:04.437335  1609 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.442808  1581 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:04.442893  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69297.9us
I20260709 13:00:04.443630  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:04.445113  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44978.9us
I20260709 13:00:04.446203  1538 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:04.436244  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:04.445165  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:04.443828  1506 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.785s (SENT)
W20260709 13:00:04.450129  1506 leader_election.cc:336] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.786s (SENT)
I20260709 13:00:04.358256  5532 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.451617  4224 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:04.372525  5443 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:00:04.446130  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:04.353307  5444 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.453233  4224 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.374998  5463 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.470659  4224 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:04.455523  1582 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:04.412191  5270 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:04.472751  2305 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:04.473003  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:04.430078  5390 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.387408  4914 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:00:04.430226  5274 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:04.432825  5440 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.403867  5305 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:04.475538  1616 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:04.387646  5478 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:00:04.434026  5369 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:04.500630  1613 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:04.476140  1506 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.739s (SENT)
I20260709 13:00:04.434299  5447 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.444386  5522 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.362731  5520 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.490697  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:04.391074  5475 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.470520  5353 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:04.375380  5524 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.479626  1607 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
W20260709 13:00:04.523538  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47438.3us
W20260709 13:00:04.521337  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69188.8us
W20260709 13:00:04.521752  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 97636us
I20260709 13:00:04.526983  4224 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.518241  1609 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:04.447060  5485 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:04.533308  2305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 870) took 1439 ms. Trace:
I20260709 13:00:04.533573  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:04.493448  5512 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:04.489445  5540 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.539865  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:04.561707  1690 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.506222  1608 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:04.470036  5436 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:00:04.544955  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 244) took 18375 ms (client timeout 15000 ms). Trace:
I20260709 13:00:04.544854  1614 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:04.550482  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:04.550864  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:04.573374  1689 raft_consensus.cc:2410] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:04.549158  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.447578  5484 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:00:04.556192  1686 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.555691  2305 rpcz_store.cc:276] 0709 13:00:03.094027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.094190 (+   163us) service_pool.cc:224] Handling call
0709 13:00:03.097920 (+  3730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.473170 (+1375250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.533073 (+ 59903us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54008502d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:04.533247 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3161696128}
I20260709 13:00:04.498734  4983 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.558689  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 68175.7us
I20260709 13:00:04.537916  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:04.584005  1681 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.553332  1436 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 12. New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.585227  2309 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:04.489770  5274 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:04.576288  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 95492.7us
I20260709 13:00:04.551584  5478 consensus_queue.cc:1243] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:04.589443  4224 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.545109  5399 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:04.595039  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.585460  1436 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 7, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:04.554309  4914 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:04.547910  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.190s	user 0.023s	sys 0.045s
I20260709 13:00:04.616247  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.555017  5491 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:04.547405  5390 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.499354  5440 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.523306  5305 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.554831  5297 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.632004  1506 leader_election.cc:336] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.746s (SENT)
I20260709 13:00:04.657045  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.637521  1687 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:04.638343  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57230.2us
I20260709 13:00:04.635946  1690 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:04.620792  1436 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 7, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 7 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:04.646147  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:04.595386  5534 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:00:04.644912  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:04.589468  5489 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:04.651247  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:04.579479  5353 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:04.570744  1439 rpcz_store.cc:269] 0709 12:59:46.158914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.161933 (+  3019us) service_pool.cc:224] Handling call
0709 13:00:04.534358 (+18372425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:00.837484 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:00.954937 (+117453us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:00.954992 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:00:00.955015 (+    23us) tablet.cc:662] Decoding operations
0709 13:00:00.956828 (+  1813us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:00.956899 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:00.956926 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:00:00.958528 (+  1602us) tablet.cc:701] Row locks acquired
0709 13:00:00.958578 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:00:00.958746 (+   168us) write_op.cc:270] Start()
0709 13:00:00.958904 (+   158us) write_op.cc:276] Timestamp: P: 1783602000958683 usec, L: 0
0709 13:00:00.958924 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:00:01.133938 (+175014us) log.cc:844] Serialized 8666 byte log entry
0709 13:00:02.064326 (+930388us) op_driver.cc:464] REPLICATION: finished
0709 13:00:02.392761 (+328435us) write_op.cc:301] APPLY: starting
0709 13:00:02.392870 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:02.393343 (+   473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:02.393486 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:02.537700 (+144214us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:02.538119 (+   419us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:00:02.538191 (+    72us) write_op.cc:312] APPLY: finished
0709 13:00:02.538719 (+   528us) log.cc:844] Serialized 152 byte log entry
0709 13:00:02.538937 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:02.539156 (+   219us) write_op.cc:454] Released schema lock
0709 13:00:02.539237 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:02.747494 (+208257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:02.749778 (+  2284us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":327107,"apply.run_cpu_time_us":13423,"apply.run_wall_time_us":332805,"num_ops":22,"prepare.queue_time_us":301812,"prepare.run_cpu_time_us":15248,"prepare.run_wall_time_us":793052,"raft.queue_time_us":156738,"raft.run_cpu_time_us":44645,"raft.run_wall_time_us":322923,"replication_time_us":1086059,"thread_start_us":611864,"threads_started":4,"wal-append.queue_time_us":673918,"wal-append.run_cpu_time_us":54666,"wal-append.run_wall_time_us":1741818}]]}
I20260709 13:00:04.595923  5274 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:04.655972  2309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 527) took 1451 ms (client timeout 1926 ms). Trace:
I20260709 13:00:04.666752  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:04.591034  5485 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:04.624812  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.024s	sys 0.045s
I20260709 13:00:04.615676  5399 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:04.669402  2276 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:04.697007  1506 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.005s (SENT)
I20260709 13:00:04.677114  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:04.702557  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:04.703210  1538 raft_consensus.cc:2410] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:04.677327  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:04.638473  5390 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:04.678859  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:04.680162  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:04.710654  1539 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.688071  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:04.711772  1537 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:04.648465  5443 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:04.692816  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:04.688396  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 98685.6us
W20260709 13:00:04.674381  2309 rpcz_store.cc:269] 0709 13:00:03.194289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.196956 (+  2667us) service_pool.cc:224] Handling call
0709 13:00:04.645680 (+1448724us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005b22d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:04.645803 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759761664}
I20260709 13:00:04.661281  1436 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 8, term changed from 5 to 10, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to <none>, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193), VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194), VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195), VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:04.673460  5410 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.664996  5430 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:04.654915  5509 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.615088  4983 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.647028  5491 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:04.719368  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 50067.4us
I20260709 13:00:04.705727  5399 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.642494  5380 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:00:04.667585  4224 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:04.741420  4224 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:04.741832  4224 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.724123  1436 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.698201  5485 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:04.731631  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 145124us
I20260709 13:00:04.722493  1540 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:04.666059  5484 consensus_queue.cc:1059] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:00:04.737681  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:04.618660  5540 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.717315  5390 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.664085  4914 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:04.743544  5550 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:00:04.744395  5305 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:04.744930  5538 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:00:04.745286  5542 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:04.745618  5508 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:04.745757  5552 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:04.653424  5487 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.746385  5438 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:04.748461  5548 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.753736  5440 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.725778  5489 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:04.757125  5549 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:00:04.757304  5386 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.757755  5444 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.758648  5475 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.758844  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:04.759546  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:04.760242  5524 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:04.762030  5502 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:04.721602  5263 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:04.770062  1681 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
W20260709 13:00:04.781456  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 84500.2us
I20260709 13:00:04.783452  1687 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:00:04.701447  5297 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.803555  5270 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:04.819458  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.764853  1436 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:04.824362  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:04.734086  4917 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:04.838752  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:04.762876  5454 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:04.853163  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89353.6us
I20260709 13:00:04.855969  2301 raft_consensus.cc:1217] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Deduplicated request from leader. Original: 6.6->[8.7-13.9]   Dedup: 8.7->[10.8-13.9]
I20260709 13:00:04.857393  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:04.801331  5512 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:04.733654  5443 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:04.867393  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:04.799777  5519 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:04.842321  5463 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.007692  1610 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:05.320086  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:05.083758  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.320641  1533 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:04.983026  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:05.323097  1616 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:05.324443  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:05.325145  1683 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:04.919000  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.933136  4224 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.933480  1540 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
W20260709 13:00:05.328925  1506 leader_election.cc:336] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.230s (SENT)
I20260709 13:00:05.329416  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:05.005414  5440 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.330488  5440 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.005642  5485 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.844630  5542 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:05.323766  1436 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 10, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.338826  1436 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 8, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:05.314442  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.005s	sys 0.005s
W20260709 13:00:05.342217  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.005s	sys 0.005s
I20260709 13:00:05.327476  2301 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: [8.7-13.9]
I20260709 13:00:05.343518  1436 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 2 to 9, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.345299  4224 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.349287  1436 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.350821  1436 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.354264  1436 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.929881  5532 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.232515  5410 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.111020  5305 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.359949  1506 leader_election.cc:336] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.428s (SENT)
W20260709 13:00:05.359781  1686 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.000s
I20260709 13:00:05.362457  4224 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.980948  5552 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:05.363071  4224 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.370537  1436 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.362493  1686 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:05.344725  4917 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:05.361515  5544 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:05.373508  4917 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.373956  5544 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.306020  5380 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:05.341904  5447 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:04.982331  5508 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:05.327672  5520 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.271319  5522 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:05.387409  2276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.006s	sys 0.007s
I20260709 13:00:05.380739  1436 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:05.393254  2276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.007s	sys 0.007s
W20260709 13:00:05.396703  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 661326us
I20260709 13:00:05.361742  5485 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:05.391049  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:05.395685  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.003s	sys 0.011s
I20260709 13:00:05.332053  5446 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:00:05.380239  5559 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:00:05.359215  5524 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:04.868726  5438 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:05.356266  5459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.012s
I20260709 13:00:05.413915  4224 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:05.423029  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.012s
W20260709 13:00:05.378417  5490 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.007s
I20260709 13:00:05.431030  1581 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:05.379877  5532 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.425314  1540 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:00:05.433470  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 98676.3us
I20260709 13:00:05.447988  1656 leader_election.cc:400] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9.
I20260709 13:00:05.448414  1656 leader_election.cc:403] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:00:05.441939  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 702234us
W20260709 13:00:05.436918  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 77163.3us
I20260709 13:00:05.440021  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:05.441527  4224 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:05.443774  1616 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:05.444860  1613 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:05.332194  5512 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.453732  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:05.486447  1533 raft_consensus.cc:2376] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11. Re-sending same reply.
I20260709 13:00:05.492431  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:05.444356  5459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.001s	sys 0.012s
W20260709 13:00:05.508096  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 57293.5us
W20260709 13:00:05.509004  1539 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.000s
I20260709 13:00:05.509577  1539 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:05.398021  4917 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.402676  5491 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.485188  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:05.514349  1532 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:05.482117  1506 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.543s (SENT)
I20260709 13:00:05.493260  1615 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:05.380016  5410 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.493204  5560 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9.
I20260709 13:00:05.520910  5410 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:05.466943  5490 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.008s	sys 0.007s
I20260709 13:00:05.379768  5305 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.496555  4846 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:05.523103  5274 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.818s	user 0.005s	sys 0.001s
I20260709 13:00:05.525275  5274 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:05.477124  5419 consensus_meta.cc:287] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 2.236s	user 0.007s	sys 0.006s
W20260709 13:00:05.530175  5399 consensus_meta.cc:287] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.000s
W20260709 13:00:05.487244  5354 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.448s	user 0.005s	sys 0.006s
I20260709 13:00:05.530920  5389 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.531426  5389 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.532037  5274 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:05.401829  5380 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.534662  5380 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.507499  5540 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:05.536449  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54383.7us
I20260709 13:00:05.523928  5443 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.524456  5487 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.503894  4914 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:05.529888  5489 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.000s
I20260709 13:00:05.553094  5489 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:05.483769  1534 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:05.506282  1540 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:05.554900  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1755) took 1344 ms. Trace:
I20260709 13:00:05.555394  1610 rpcz_store.cc:276] 0709 13:00:04.210964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.212319 (+  1355us) service_pool.cc:224] Handling call
0709 13:00:04.212717 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.325731 (+1113014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.554650 (+228919us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b540020ba54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:05.554841 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827793280}
I20260709 13:00:05.557500  5512 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:05.497668  5500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.048s	sys 0.070s
W20260709 13:00:05.558364  5500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.048s	sys 0.070s
I20260709 13:00:05.405337  5569 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:00:05.483516  5542 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.559921  5542 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:05.554989  1540 pending_rounds.cc:85] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 8
I20260709 13:00:05.575165  1540 pending_rounds.cc:107] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:05.575518  1540 raft_consensus.cc:2889] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:05.506258  5353 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:05.562512  5399 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.538250  5552 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.568464  5438 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.404700  5522 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:04.992511  5548 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:05.569018  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.112s (SENT) [suppressed 28 similar messages]
I20260709 13:00:05.569470  4846 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:05.441008  5270 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.443928  5524 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.571650  5302 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:05.538722  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 90866.8us
W20260709 13:00:05.540701  5449 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 1.166s	user 0.005s	sys 0.006s
W20260709 13:00:05.583370  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.601979  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:05.602193  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.604564  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:05.605065  1506 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.827s (SENT)
I20260709 13:00:05.489562  5532 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.605204  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:05.605535  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:05.607016  1686 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:05.608059  5438 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:05.602216  5302 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:05.609529  4846 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.609879  5302 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.610941  5302 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:05.612183  1506 leader_election.cc:336] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.897s (SENT)
I20260709 13:00:05.612620  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.613853  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:05.612852  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:05.614403  1686 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.615072  5438 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.584368  1683 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:05.616955  1541 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:05.618254  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.618465  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.617399  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:05.618876  1682 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 13:00:05.619141  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.625255  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:05.625799  1682 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:05.586417  5508 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.629140  5353 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:05.629693  5353 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:05.629918  5548 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.630426  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.632616  1683 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:05.630577  5353 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:05.630893  5522 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.633781  1681 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:05.634356  1541 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
W20260709 13:00:05.631457  1506 leader_election.cc:336] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 3.059s (SENT)
I20260709 13:00:05.636451  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:05.606364  5463 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.643739  1540 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:05.648582  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 141778us
I20260709 13:00:05.663435  1681 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:05.665306  1686 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 13:00:05.591997  5274 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:05.635635  5108 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:05.675678  1683 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:00:05.668555  5506 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.198s	user 0.010s	sys 0.000s
I20260709 13:00:05.654088  5548 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:05.684662  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 80459.7us
I20260709 13:00:05.671741  5297 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.694227  1688 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:05.693005  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:05.699858  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:05.701545  4224 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:05.701670  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:05.702086  4224 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:05.702463  4224 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:05.691274  5108 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:05.666584  5463 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.703507  1682 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:05.708355  5487 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:05.704404  5436 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:05.710144  5436 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:05.711031  5436 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.712719  5399 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.700258  5512 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:05.713557  5512 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:05.713934  5512 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.714704  5524 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.684391  5506 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:05.716779  5571 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:00:05.716924  5108 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.717921  1611 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:05.718376  5506 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:05.684417  5520 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:05.719496  5520 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:05.698802  5532 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:05.726666  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:05.727730  1532 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:05.732705  1656 leader_election.cc:400] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 7. Current term is 9.
W20260709 13:00:05.737911  5583 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:05.742470  5463 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.746241  4224 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.719877  5520 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:05.763041  5592 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:00:05.765372  5390 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.914s	user 0.005s	sys 0.005s
I20260709 13:00:05.765846  5390 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.769301  1690 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 6.
I20260709 13:00:05.769928  4224 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.774528  1532 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:00:05.777796  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:05.780021  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54336.8us
I20260709 13:00:05.768141  5390 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:05.782612  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:05.783414  1539 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:05.784420  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:05.785213  1540 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:05.783896  1532 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:05.792600  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:05.793682  1532 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.801591  4224 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.802191  4224 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.805502  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:05.807271  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:05.807979  1540 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:05.808542  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:05.809271  1532 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:05.813712  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.815171  1608 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:05.816542  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.817129  5512 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:05.817708  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.817986  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.817708  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.819631  1682 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:05.817699  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:05.819978  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.821081  1682 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:05.821098  1686 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:05.826215  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.827031  1607 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:05.828718  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.833878  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.835736  1609 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
W20260709 13:00:05.858808  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 50328.6us
I20260709 13:00:05.860978  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.831457  5508 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:05.869603  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.874742  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 590) took 1566 ms. Trace:
I20260709 13:00:05.875175  2301 rpcz_store.cc:276] 0709 13:00:04.357800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.365280 (+  7480us) service_pool.cc:224] Handling call
0709 13:00:04.387699 (+ 22419us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:05.346441 (+958742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.874464 (+528023us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400475754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:05.874683 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069158144}
I20260709 13:00:05.855072  5542 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.878335  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:05.855480  5512 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:05.917464  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:05.917377  1506 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.228s (SENT)
I20260709 13:00:05.855432  5569 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:00:05.853431  5578 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:05.877338  5475 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:05.868757  5463 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:00:05.930594  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.931051  5510 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:05.919075  5532 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.931638  5510 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.929739  5475 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.934593  5475 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:05.916814  5478 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:05.952484  5472 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:05.953054  5510 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:05.957928  5572 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.460s	user 0.002s	sys 0.000s
W20260709 13:00:05.960551  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 82308.1us
I20260709 13:00:05.961169  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 570) took 1094 ms. Trace:
I20260709 13:00:05.961553  1688 rpcz_store.cc:276] 0709 13:00:04.866887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.867029 (+   142us) service_pool.cc:224] Handling call
0709 13:00:05.960960 (+1093931us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400394254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:05.961085 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737184512}
I20260709 13:00:05.962093  5463 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:05.964185  1656 leader_election.cc:400] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:05.968950  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.968837  5463 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:00:05.960448  5508 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:05.970079  5463 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:05.970536  5463 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:05.970744  5508 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.970948  2276 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:05.971503  5463 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:05.978967  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.981550  1607 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:05.981618  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.976058  5510 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:05.983305  1616 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:05.983925  1610 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:05.980587  5270 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:05.984500  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:05.984635  5270 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:05.990006  5369 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:05.990343  1610 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:05.990528  5369 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:05.991853  5270 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:05.992070  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.987727  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.988919  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:05.994699  4983 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:05.991669  5369 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:05.996187  5369 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:05.999961  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.009935  5478 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.010968  5478 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.011615  5478 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:06.011953  5478 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:06.012997  5382 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:06.012797  5478 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.013543  5382 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.013963  5478 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.015695  5382 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:06.016460  5463 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.017161  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.020852  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:05.978577  5603 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.027333  5532 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:06.032153  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.029660  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.032764  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.034633  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.028618  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:06.037510  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.040375  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.040899  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.041934  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.044791  2301 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:06.045930  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.022258  5446 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:00:06.031432  5510 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:06.048527  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:06.053695  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.035445  5554 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:00:06.055684  5542 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.063882  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:06.057694  5510 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.066078  5510 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:06.067273  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:06.069182  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.047681  5263 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.040558  5532 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.040967  5603 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.048498  5578 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.076051  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.032364  5418 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:06.077137  5558 raft_consensus.cc:3055] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:06.084153  1684 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:06.085588  1688 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:06.095644  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:06.101570  2307 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:06.104823  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.107642  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.097528  5418 consensus_queue.cc:1243] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:06.097381  5558 raft_consensus.cc:740] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:06.098552  5390 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.112273  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:06.107079  5463 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:06.118402  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.102679  5472 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:06.120465  5542 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:06.116334  5603 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:06.105532  5532 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.124372  2303 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:06.125568  5542 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.136900  5542 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.139364  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.120823  5463 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:06.140450  5463 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.125756  5390 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.145659  1656 leader_election.cc:400] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 13:00:06.145884  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.146219  1656 leader_election.cc:403] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:06.157495  5542 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.159857  5542 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:06.165789  2303 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:06.084198  5520 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.171468  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.179046  1686 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:06.144438  5485 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.140771  5558 consensus_queue.cc:260] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.180404  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.144454  5449 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.183250  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.186748  1683 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.184059  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.184650  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.187688  1686 raft_consensus.cc:2368] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:06.187858  1689 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:06.185261  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.188642  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.193130  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.193876  1682 raft_consensus.cc:2368] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:06.171867  5532 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 13:00:06.200693  5558 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:06.141835  5472 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.201911  5545 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:06.202733  1687 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:00:06.191699  5520 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:06.204541  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.182976  5389 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:06.197332  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:06.201375  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.209744  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.210382  1683 raft_consensus.cc:1813] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Handling vote request from an unknown peer 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:06.211467  1683 raft_consensus.cc:2410] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:06.209231  2303 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:06.212530  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.212846  1686 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:06.213249  1688 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 11.
I20260709 13:00:06.213759  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.214255  5463 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.214879  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.215930  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.217008  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.218001  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.218504  5472 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:06.220091  1689 raft_consensus.cc:2410] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:06.224829  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:06.226017  1683 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:06.228652  5557 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:06.229199  5509 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:06.229641  5509 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:06.230412  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.233065  1613 pending_rounds.cc:85] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 7
I20260709 13:00:06.233358  1613 pending_rounds.cc:107] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:00:06.233618  1613 raft_consensus.cc:2889] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.233968  1613 pending_rounds.cc:107] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:00:06.234205  1613 raft_consensus.cc:2889] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.235343  5463 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:06.237605  5574 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.968s	user 0.000s	sys 0.003s
I20260709 13:00:06.237751  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:06.239447  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 1969) took 1549 ms. Trace:
I20260709 13:00:06.231634  5478 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:06.240137  5478 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.241087  1616 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:06.241127  5544 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:06.239969  1535 rpcz_store.cc:276] 0709 13:00:04.690134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.690309 (+   175us) service_pool.cc:224] Handling call
0709 13:00:04.690702 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.804249 (+113547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.804281 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.804918 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.820620 (+ 15702us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:04.820653 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.820715 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.237050 (+1416335us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:06.239101 (+  2051us) raft_consensus.cc:1685] finished
0709 13:00:06.239127 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.239378 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14421,"raft.queue_time_us":18777,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10379,"spinlock_wait_cycles":61554048,"thread_start_us":113847,"threads_started":2,"wal-append.queue_time_us":46599}
W20260709 13:00:06.242393  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.246688  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.248142  1688 raft_consensus.cc:1275] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:06.250394  5274 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:06.250737  1683 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:06.252317  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 443448us
I20260709 13:00:06.240612  5478 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:06.254504  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.256819  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:06.257354  1682 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.254597  5382 consensus_queue.cc:1048] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:00:06.258901  5475 consensus_queue.cc:1059] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:06.264755  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.265763  1539 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:06.270256  1532 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:06.259052  5447 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:06.274878  1616 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:06.285249  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.275079  5297 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.286610  5447 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.288895  5297 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.290613  5447 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:06.290894  5297 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:06.294970  4224 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:06.303326  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.307241  1682 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:06.302325  1507 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:06.300278  5603 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:00:06.312505  5524 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:06.313060  5524 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.313484  5524 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.319442  1612 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:06.320959  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.287803  5440 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:06.328675  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:06.418959  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 90403.9us
I20260709 13:00:06.415182  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.287830  5519 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:06.428503  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.430328  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.433244  1614 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:06.431876  5447 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:06.325173  5603 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:00:06.441027  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.441973  1608 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:06.443930  1686 raft_consensus.cc:2410] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:00:06.444770  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.447090  1688 raft_consensus.cc:2393] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:06.447073  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.452359  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.453578  1507 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:06.435003  5447 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:06.445798  4983 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:06.439925  5475 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:06.466267  1534 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:06.461257  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.467584  1688 raft_consensus.cc:2368] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:06.468750  1682 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:06.462421  1507 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:06.481623  5302 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:06.482167  5302 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:06.482589  5302 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:06.475191  5305 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:06.489356  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 1964) took 1811 ms (client timeout 1573 ms). Trace:
W20260709 13:00:06.489799  1541 rpcz_store.cc:269] 0709 13:00:04.678417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.678556 (+   139us) service_pool.cc:224] Handling call
0709 13:00:06.489188 (+1810632us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b540030a054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:06.489285 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085145344}
W20260709 13:00:06.493256  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.493803  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.495231  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.498162  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.499534  1688 raft_consensus.cc:2410] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:06.500662  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.501466  1688 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 13:00:06.502557  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:06.506138  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.503896  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.508777  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.465161  5519 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:06.464150  5447 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:06.518254  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.463809  4983 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:06.509585  1688 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 5.
I20260709 13:00:06.524957  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.537892  1613 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:06.539076  5263 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:06.539522  5263 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:06.540357  5263 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.540736  4983 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.541857  5263 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.542403  4983 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.547753  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.549628  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.522348  5519 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.477367  5475 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.564378  1688 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.567924  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.569479  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:06.570354  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:06.576079  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.545238  5602 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:06.579728  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.582223  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.585526  1688 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:06.586598  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.565446  5519 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.600956  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:06.602604  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.603609  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.610113  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.619076  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.620018  2304 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:06.623296  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.628180  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:06.631378  5369 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:06.632148  5524 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.634370  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:06.635738  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.636706  1688 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.632964  5575 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:06.637521  5575 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:06.638247  5369 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:06.638376  5575 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.639736  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.641330  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.642189  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.644888  1688 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:06.645347  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.645779  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.646477  1688 raft_consensus.cc:1813] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Handling vote request from an unknown peer 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:06.647054  1688 raft_consensus.cc:2410] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:06.649552  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.658494  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.661283  1688 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.667738  5508 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.658644  5573 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.647558  5502 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:06.648058  5603 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.676338  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.672183  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.671947  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1774) took 1870 ms. Trace:
I20260709 13:00:06.678802  1611 rpcz_store.cc:276] 0709 13:00:04.802036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.802225 (+   189us) service_pool.cc:224] Handling call
0709 13:00:04.838107 (+ 35882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.718308 (+880201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.671712 (+953404us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002b5554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:06.671892 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023157632}
I20260709 13:00:06.679775  1614 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:06.681046  1688 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.681305  1504 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.684502  1504 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:06.681855  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.690677  1688 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:06.660061  5379 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:06.671774  5274 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:06.694370  1504 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:06.694607  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.698011  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.698635  1688 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:06.699283  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.700105  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:06.700560  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:06.703176  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.703747  1613 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:06.705412  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.688870  5297 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.688287  5522 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:06.715579  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:06.720134  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.693182  5389 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:06.713723  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:06.724247  1607 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:06.725847  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.726716  1615 raft_consensus.cc:2410] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:06.731248  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:06.737623  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:06.738260  1686 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:06.739840  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.742324  5621 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:06.694839  5309 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:06.701682  5440 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:06.698714  5274 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:06.752480  1688 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:06.754884  1686 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:06.756740  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:06.753824  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.767573  1685 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:06.768748  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.769785  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.770589  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:06.770705  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.766630  1608 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:06.762542  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.773355  1608 raft_consensus.cc:1240] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:06.764276  1537 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:06.778385  1540 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:06.778625  5390 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:06.770354  1685 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:06.779623  5510 raft_consensus.cc:3055] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:06.779976  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.781397  1685 raft_consensus.cc:2393] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:06.782658  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.783329  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:06.784345  1685 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:06.785553  1608 raft_consensus.cc:606] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:06.787599  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.788849  1536 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:06.790520  1610 raft_consensus.cc:1217] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[9.10-9.10]   Dedup: 9.10->[]
I20260709 13:00:06.791064  1610 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:06.792033  1608 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:06.758327  1688 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:06.795699  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1981) took 1178 ms. Trace:
I20260709 13:00:06.929978  1690 rpcz_store.cc:276] 0709 13:00:05.617358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.618914 (+  1556us) service_pool.cc:224] Handling call
0709 13:00:06.795533 (+1176619us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400119754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:06.795642 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338494720}
I20260709 13:00:06.931120  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.766484  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:06.816073  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:06.932144  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 165917us
I20260709 13:00:06.932425  1686 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:06.818920  1685 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:06.841801  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.754844  5440 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:06.759968  5623 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:00:06.938194  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:06.939513  1615 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:06.939975  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:06.940503  5620 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:00:06.939312  5274 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:06.941359  5459 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:06.793407  5302 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:06.993396  5459 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:06.995630  5302 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:06.796312  5611 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:00:06.946089  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 1974) took 1342 ms. Trace:
I20260709 13:00:06.996668  1681 rpcz_store.cc:276] 0709 13:00:05.604036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.604316 (+   280us) service_pool.cc:224] Handling call
0709 13:00:06.945804 (+1341488us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b540035af54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:06.945981 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65730304}
I20260709 13:00:06.998199  1681 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.935938  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:07.000563  1685 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:07.001763  1685 pending_rounds.cc:85] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 13:00:07.002027  1685 pending_rounds.cc:107] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:07.002256  1685 raft_consensus.cc:2889] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.953406  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.953910  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:06.780041  5510 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:07.009614  5510 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.011297  5510 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.962235  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:06.969777  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:07.019183  1690 raft_consensus.cc:2410] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:06.989024  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:07.023324  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 271429us
W20260709 13:00:06.951086  5619 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:00:06.944857  5520 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:07.020413  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:07.031957  1536 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:06.975595  5440 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.033834  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:07.034265  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:07.021407  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:06.968639  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:07.013578  1688 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:07.035310  1537 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:07.036716  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:07.033260  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:07.038818  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:07.012470  5569 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:07.039708  1540 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:07.040269  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:06.951810  5519 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.044919  1689 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:07.061470  5459 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.063130  5459 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.065274  1682 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:07.042021  5569 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:07.073477  5573 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.073112  5569 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.074319  5569 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.075740  2303 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:07.081496  1538 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:07.086297  1681 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:00:07.080046  5263 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
W20260709 13:00:07.094947  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 333642us
W20260709 13:00:07.098893  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 127871us
I20260709 13:00:07.080507  5524 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:07.098839  5297 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:07.106285  5478 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 13:00:07.127801  1681 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:07.111050  1689 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:00:07.104574  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 80625.7us
W20260709 13:00:07.129254  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.139895  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.154665  1506 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.621s (SENT)
I20260709 13:00:07.108748  5475 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:07.165977  5095 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.166654  5095 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.169317  5095 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.169906  5095 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:07.170354  5095 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:07.171265  5095 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.131675  5478 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.174973  5478 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.176733  1686 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:07.177502  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.178625  5447 consensus_meta.cc:287] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.000s
I20260709 13:00:07.179191  5447 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.131732  5297 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.180778  5519 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:07.183336  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.184360  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:07.192328  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 571) took 2300 ms. Trace:
I20260709 13:00:07.192790  1684 rpcz_store.cc:276] 0709 13:00:04.891736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.993340 (+101604us) service_pool.cc:224] Handling call
0709 13:00:04.993683 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.097467 (+1103784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.189598 (+1092131us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540032cdd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:07.192242 (+  2644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507236736}
W20260709 13:00:07.196478  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.186986  5524 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.199548  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.199882  1681 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:07.201426  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.185189  5297 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.230757  1689 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:07.231137  2305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 604) took 1194 ms. Trace:
I20260709 13:00:07.231689  2305 rpcz_store.cc:276] 0709 13:00:06.036505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.036677 (+   172us) service_pool.cc:224] Handling call
0709 13:00:06.039700 (+  3023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.068357 (+ 28657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.068386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.068430 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:06.068460 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.230823 (+1162363us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54005023d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:07.230901 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.231061 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65356032}
I20260709 13:00:07.234261  1684 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:07.235265  1681 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:07.198779  5520 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:07.236932  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 274848us
I20260709 13:00:07.238632  1681 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:07.241230  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:07.185329  5519 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:07.205493  5524 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.242987  1582 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:07.243933  4224 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:07.245937  4224 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:07.244743  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:07.248190  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:07.265671  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:07.254382  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:07.192663  5509 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.265581  4224 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.275588  5635 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.276063  5635 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:07.276616  5635 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.283576  5447 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:07.245599  5524 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.281025  5263 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:07.312019  5263 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.312448  5263 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:07.316725  5509 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.325465  5390 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.325623  5645 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:07.326134  5390 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.321707  5524 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.327509  5430 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:07.327943  5430 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:07.328716  5390 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.328869  5430 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:07.329632  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.330035  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.330546  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.332543  5558 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.333110  5558 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.335186  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:07.335336  5558 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.335987  1613 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.336691  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:07.325394  1656 connection.cc:256] RPC call timeout handler was delayed by -2.383579162999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 13:00:07.329979  5430 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:07.336952  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:07.345434  1681 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:07.353107  1681 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:07.337417  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:07.344751  1656 connection.cc:256] RPC call timeout handler was delayed by -2.3781791630000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 13:00:07.353847  1656 connection.cc:256] RPC call timeout handler was delayed by -2.22697916300001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:00:07.354296  1656 connection.cc:256] RPC call timeout handler was delayed by -2.183779162999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 13:00:07.354665  1656 connection.cc:256] RPC call timeout handler was delayed by -2.1135791629999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:00:07.355014  1656 connection.cc:256] RPC call timeout handler was delayed by -2.0082791629999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:00:07.355377  1656 connection.cc:256] RPC call timeout handler was delayed by -1.9083791630000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:00:07.355756  1656 connection.cc:256] RPC call timeout handler was delayed by -1.0128791629999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3219s for a response
I20260709 13:00:07.336568  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:07.347062  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.357201  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:07.358809  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.370196  1689 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:00:07.382539  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.339804  5478 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.384080  1681 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.324481  5637 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.394915  1613 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:07.404668  1681 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:07.413237  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.426502  1615 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:07.390061  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 188739us
I20260709 13:00:07.336110  5558 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.435256  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.408421  5297 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.438935  1681 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:07.466105  1681 pending_rounds.cc:85] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 13:00:07.434441  5447 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.457652  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:07.459069  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.387604  5390 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:07.404003  5302 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.394438  5643 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.447541  1615 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:07.467247  1681 pending_rounds.cc:107] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:07.529578  1681 raft_consensus.cc:2889] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:07.530544  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 256120us
I20260709 13:00:07.441586  5463 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.529491  1687 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:07.438163  5519 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.394713  5478 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:07.535784  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 153349us
I20260709 13:00:07.427469  5510 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:00:07.518697  5390 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.543632  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:07.384195  5520 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.434864  5587 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:00:07.543010  5390 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:07.534248  5297 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:07.440804  5637 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:00:07.535239  5463 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.534988  5643 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:07.576560  5643 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:07.582027  5638 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:07.540912  5095 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.570621  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.461802  5440 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.514524  5558 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.551015  5519 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.520284  5508 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:07.584324  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1655) took 1095 ms. Trace:
W20260709 13:00:07.599223  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 135679us
I20260709 13:00:07.575973  5463 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.538452  5302 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.532310  5447 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:07.609480  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 151974us
I20260709 13:00:07.611819  1534 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:07.598975  1685 rpcz_store.cc:276] 0709 13:00:06.488994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.001219 (+512225us) service_pool.cc:224] Handling call
0709 13:00:07.001567 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.002876 (+  1309us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:07.003202 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.271827 (+268625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.272911 (+  1084us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.273056 (+   145us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.273338 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.340048 (+ 66710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.340123 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.584053 (+243930us) raft_consensus.cc:1685] finished
0709 13:00:07.584075 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.584248 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82390,"prepare.queue_time_us":931,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":70068,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4973,"thread_start_us":268282,"threads_started":1,"wal-append.queue_time_us":382284}
I20260709 13:00:07.593719  5297 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:07.626446  5660 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:07.616034  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.593237  5645 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:07.592981  5095 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.637872  5478 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:07.638468  5478 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.639132  5478 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.639195  5095 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.636621  5635 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.646122  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 587) took 1390 ms. Trace:
I20260709 13:00:07.639585  5478 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.646771  1683 rpcz_store.cc:276] 0709 13:00:06.255603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.255725 (+   122us) service_pool.cc:224] Handling call
0709 13:00:06.269059 (+ 13334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.269393 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.269422 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.276192 (+  6770us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.409553 (+1133361us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b180026d880. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:07.603397 (+193844us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:07.603459 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.603559 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.645748 (+ 42189us) raft_consensus.cc:1685] finished
0709 13:00:07.645776 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.646026 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4098,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4752,"spinlock_wait_cycles":20733184,"thread_start_us":193568,"threads_started":1,"wal-append.queue_time_us":1357387}
I20260709 13:00:07.649360  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.624975  5297 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.661013  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.663571  5302 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:07.663409  5263 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:07.665247  5636 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:00:07.667548  5263 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:07.668139  1614 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13.
I20260709 13:00:07.670164  5644 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:07.670617  5644 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:07.672637  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.676609  5645 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.677376  5440 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.679112  5558 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:07.681813  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 1993) took 1185 ms. Trace:
I20260709 13:00:07.682262  1690 rpcz_store.cc:276] 0709 13:00:06.496029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.043550 (+547521us) service_pool.cc:224] Handling call
0709 13:00:07.082264 (+ 38714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.336795 (+254531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.336830 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.337503 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.616450 (+278947us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:07.616514 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.616616 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.681569 (+ 64953us) raft_consensus.cc:1685] finished
0709 13:00:07.681594 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.681735 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254071,"raft.queue_time_us":256967,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":278427,"threads_started":1,"wal-append.queue_time_us":341917}
I20260709 13:00:07.685446  5519 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:07.685775  5659 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:07.686079  5519 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:07.686784  5519 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.688913  5524 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.690284  5297 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.691124  5524 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:07.719645  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 199531us
W20260709 13:00:07.722097  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.671497  5644 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:07.740058  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.686190  5659 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:07.745494  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 84724.3us
I20260709 13:00:07.731657  5524 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.731881  5302 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.748795  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.751236  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:07.744480  5661 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.746172  5418 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.747721  5519 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:07.759828  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 225600us
I20260709 13:00:07.749883  5440 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:07.767131  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:07.754959  5389 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.753783  5302 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.775849  5651 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:07.777040  5662 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.779006  5662 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:07.759266  5644 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.752924  5524 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.783635  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:07.784650  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:07.786031  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:07.787164  1690 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:07.787358  1688 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.788889  1683 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:07.784067  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:07.763674  5661 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:07.796723  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.797474  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.797961  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.765558  5418 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.803112  1688 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:07.808740  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:07.809737  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:07.810019  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:07.811203  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:07.811277  5569 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:07.812161  5569 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.803260  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:07.805801  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:07.781069  5635 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:07.816150  1538 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:07.780138  5637 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:00:07.818240  1690 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:07.854702  1532 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 13:00:07.858511  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.795405  5447 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:07.938205  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.882052  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47702.4us
I20260709 13:00:07.814996  5569 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:07.948869  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2372) took 1231 ms. Trace:
I20260709 13:00:07.949703  1610 rpcz_store.cc:276] 0709 13:00:06.717663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.717773 (+   110us) service_pool.cc:224] Handling call
0709 13:00:06.790421 (+ 72648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.791400 (+   979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.948586 (+1157186us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54001b1a50. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:07.948797 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166265088}
I20260709 13:00:07.855224  1532 pending_rounds.cc:85] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 8
I20260709 13:00:07.951612  1532 pending_rounds.cc:107] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:07.951920  1532 raft_consensus.cc:2889] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:07.862972  5509 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.961813  5509 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.824452  5263 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:07.949117  5430 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.002s
I20260709 13:00:07.851889  5519 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:07.983528  5661 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:07.984293  5519 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:07.954437  5447 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:07.988504  5478 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:07.851274  5390 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:07.793403  5659 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:08.007136  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 463616us
I20260709 13:00:08.008453  1656 leader_election.cc:400] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:08.009027  1656 leader_election.cc:403] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:00:07.969956  5263 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:08.043524  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 248966us
I20260709 13:00:07.998569  5519 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.048013  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:08.033672  5478 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:08.061908  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:08.035127  5263 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.003285  5447 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.034665  5661 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.062525  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:08.071537  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 454258us
I20260709 13:00:08.077840  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:08.073611  5520 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:08.081745  5520 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:08.044606  5463 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:08.080717  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 248950us
W20260709 13:00:08.089864  1506 leader_election.cc:336] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.926s (SENT)
I20260709 13:00:08.090487  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:08.068703  5645 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.062498  5305 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:00:08.094020  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 482) took 1386 ms. Trace:
I20260709 13:00:08.075918  1428 maintenance_manager.cc:419] P a34435529147466db8abc42dc6329534: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033335
I20260709 13:00:08.079612  5478 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.097267  5309 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.101295  1539 rpcz_store.cc:276] 0709 13:00:06.707409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.707653 (+   244us) service_pool.cc:224] Handling call
0709 13:00:06.707966 (+   313us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:06.712950 (+  4984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.712982 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:06.718377 (+  5395us) log.cc:844] Serialized 78 byte log entry
0709 13:00:07.007111 (+288734us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b1800478300. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:07.187625 (+180514us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:07.384197 (+196572us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.435229 (+ 51032us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.607591 (+172362us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.093400 (+485809us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b1800478300. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d58801d70 00007f8d587f5293 00007f8d587eacea 00007f8d587eb23a 00007f8d58c55a2a 00007f8d58c650bf 00007f8d58c65038
0709 13:00:08.093692 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.093767 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.093817 (+    50us) raft_consensus.cc:1685] finished
0709 13:00:08.093830 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.093965 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59926,"prepare.queue_time_us":533429,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":5095,"raft.queue_time_us":77717,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":84311,"spinlock_wait_cycles":44012288,"thread_start_us":539001,"threads_started":3,"wal-append.queue_time_us":549836}
I20260709 13:00:08.086803  5659 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.085738  5637 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:08.112638  1656 leader_election.cc:400] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
I20260709 13:00:08.079294  5667 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:08.115170  1656 leader_election.cc:403] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:08.079010  5661 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:08.125882  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64049.8us
W20260709 13:00:08.115167  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.122771  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:08.128394  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 181603us
I20260709 13:00:08.130754  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:08.131127  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:08.118970  5389 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.118705  5519 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.134864  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:08.125890  5643 consensus_meta.cc:287] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.549s	user 0.014s	sys 0.000s
I20260709 13:00:08.138459  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:08.140287  5643 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.142673  5643 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.142879  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:08.143549  2309 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:08.123972  5418 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.144814  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:08.146938  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:08.127974  5664 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 9. Current term is 10.
W20260709 13:00:08.149335  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.149674  2305 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:08.149484  1690 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.147740  5478 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:08.158735  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.139309  5665 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.167189  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 538) took 1599 ms. Trace:
W20260709 13:00:08.168627  5673 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:00:08.178755  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.134712  5668 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.120498  5309 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.185875  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:08.136445  5667 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.138043  5554 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:08.195335  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.207964  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 78616.9us
I20260709 13:00:08.186241  2307 rpcz_store.cc:276] 0709 13:00:06.567785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.567955 (+   170us) service_pool.cc:224] Handling call
0709 13:00:06.581290 (+ 13335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.584519 (+  3229us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:06.704810 (+120291us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.108156 (+403346us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.129748 (+ 21592us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:07.129818 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:07.129877 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.338214 (+208337us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b180038a280. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:08.166831 (+828617us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b54002e5ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:08.166901 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.167099 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20414,"prepare.queue_time_us":84252,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":111113,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":1878,"spinlock_wait_cycles":32345984,"thread_start_us":415666,"threads_started":2,"wal-append.queue_time_us":401213,"wal-append.run_cpu_time_us":1670,"wal-append.run_wall_time_us":1058061}
I20260709 13:00:08.204157  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:08.205385  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:08.206434  1683 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:08.146950  5524 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.120781  5637 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.206568  1690 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:08.214036  1541 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:08.186827  5671 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:08.208508  5390 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:08.222872  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.214609  5305 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:00:08.220252  5639 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:00:08.241564  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 103194us
I20260709 13:00:08.243292  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.244004  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.244618  1536 raft_consensus.cc:2376] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10. Re-sending same reply.
I20260709 13:00:08.244680  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.245429  1541 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:08.215955  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.246742  1690 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:08.243311  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:08.148159  5502 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:00:08.249574  1537 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:00:08.139053  5389 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.263275  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.263413  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:08.269356  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.272575  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.273272  1532 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:08.275079  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.275882  1538 raft_consensus.cc:2410] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:08.277823  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.278393  1539 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.280750  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.281366  1538 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:08.207402  5554 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:08.185811  5643 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:08.295950  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.221662  5671 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.133325  5520 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.307070  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.308143  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:08.211911  5519 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.244726  5587 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.314457  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51174.9us
I20260709 13:00:08.302090  1539 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:08.322448  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.323052  1537 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:08.326650  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:08.335330  1538 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:08.296818  5664 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.295212  5676 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.311287  5554 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.354290  5502 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:08.359565  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.319623  5447 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.319905  5671 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:08.368785  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.211632  5668 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.360641  5463 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:08.372463  5679 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:08.352663  5519 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:08.374006  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 132349us
I20260709 13:00:08.389503  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.394841  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2002) took 1687 ms. Trace:
I20260709 13:00:08.394850  1537 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:08.370985  5698 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.405496  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:08.415690  2309 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:08.372704  5447 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.372516  5690 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.371934  5699 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.395680  5524 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.355791  5676 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.352048  5587 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.424405  2275 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:08.404990  1682 rpcz_store.cc:276] 0709 13:00:06.707250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.066153 (+358903us) service_pool.cc:224] Handling call
0709 13:00:07.123731 (+ 57578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.124069 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:07.158518 (+ 34449us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.389218 (+230700us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.582005 (+192787us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b1800351f40. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b2c2a6 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9
0709 13:00:07.583984 (+  1979us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b1800351f40. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 13:00:07.753312 (+169328us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b1800351f40. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:08.040864 (+287552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.040917 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:08.040959 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.041023 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.394660 (+353637us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b540011a150. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:08.394782 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1360,"prepare.queue_time_us":38858,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":219690,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":33742,"spinlock_wait_cycles":179194112,"thread_start_us":682868,"threads_started":2,"wal-append.queue_time_us":408557}
W20260709 13:00:08.418021  5674 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:00:08.396034  5661 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.382982  5645 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:08.412652  5644 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.378520  5642 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:00:08.439196  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67280.6us
W20260709 13:00:08.434311  5672 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:00:08.443360  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:08.451514  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.424288  5447 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.441170  5309 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:08.484350  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 158158us
I20260709 13:00:08.494464  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:08.422366  5698 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:08.484503  5675 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:00:08.501379  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.502900  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:08.446107  5644 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.424834  5690 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.485198  5661 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.461078  5305 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:00:08.486796  5389 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.495249  5309 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:08.546671  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 122348us
I20260709 13:00:08.550156  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:08.573348  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.549912  5661 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.577731  5661 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.536422  5645 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:08.578896  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 74001.8us
I20260709 13:00:08.549113  5309 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.582010  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 87644.4us
I20260709 13:00:08.587491  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:08.548633  5653 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:08.539988  5637 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:08.596688  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 92575.1us
I20260709 13:00:08.600056  1582 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:08.602274  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 598) took 1034 ms. Trace:
I20260709 13:00:08.582085  5645 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.592283  5309 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:08.594870  5653 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.597843  5687 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.208s	user 0.000s	sys 0.008s
I20260709 13:00:08.602846  1687 rpcz_store.cc:276] 0709 13:00:07.568356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.568520 (+   164us) service_pool.cc:224] Handling call
0709 13:00:07.594414 (+ 25894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.779493 (+185079us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:07.779529 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.780026 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.074450 (+294424us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:08.074488 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.074557 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.601981 (+527424us) raft_consensus.cc:1685] finished
0709 13:00:08.602022 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.602196 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12713,"raft.queue_time_us":63772,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":47655,"thread_start_us":465809,"threads_started":2,"wal-append.queue_time_us":367525}
I20260709 13:00:08.605082  5685 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:08.616894  5692 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:00:08.596562  5703 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.639045  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1686) took 1948 ms. Trace:
I20260709 13:00:08.611486  5686 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:08.604133  5519 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.640911  1686 rpcz_store.cc:276] 0709 13:00:06.693069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.953591 (+260522us) service_pool.cc:224] Handling call
0709 13:00:08.638848 (+1685257us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540035be54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:08.638984 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385944448}
I20260709 13:00:08.612319  5645 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:08.582525  5689 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:00:08.615306  5653 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:08.603397  5389 consensus_queue.cc:1059] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:08.581121  5554 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:08.645313  5297 consensus_meta.cc:287] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.955s	user 0.005s	sys 0.008s
I20260709 13:00:08.616815  5685 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:00:08.681190  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1800) took 1346 ms. Trace:
I20260709 13:00:08.681578  1614 rpcz_store.cc:276] 0709 13:00:07.334638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.337077 (+  2439us) service_pool.cc:224] Handling call
0709 13:00:08.677217 (+1340140us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54003d72d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:08.681128 (+  3911us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722750848}
W20260709 13:00:08.678574  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 175032us
I20260709 13:00:08.683501  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:08.682631  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.696584  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:08.679921  5700 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:00:08.696008  2302 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:08.691417  5686 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:08.707908  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 264614us
I20260709 13:00:08.696095  5676 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.698884  5389 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:08.691105  5297 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.720677  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:08.707242  5714 raft_consensus.cc:3055] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:08.734007  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.709515  5447 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:08.764333  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 43867.8us
I20260709 13:00:08.767130  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:08.769768  4224 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:08.770319  4224 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.778316  5297 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.780658  5554 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:08.793045  5554 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.793509  5554 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.781258  5686 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.781751  5302 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:08.784351  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2411) took 1774 ms (client timeout 1709 ms). Trace:
I20260709 13:00:08.807044  1504 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:08.785295  5274 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.728554  5714 raft_consensus.cc:740] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:08.786953  5644 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.725086  5389 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:08.788327  5711 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:08.788645  5648 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 1.204s	user 0.008s	sys 0.003s
W20260709 13:00:08.828575  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.789168  5447 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:08.792060  5668 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.835331  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.795506  5554 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:08.807433  1534 rpcz_store.cc:269] 0709 13:00:07.009996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.020984 (+ 10988us) service_pool.cc:224] Handling call
0709 13:00:08.784133 (+1763149us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54000c1554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:08.784283 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326352768}
I20260709 13:00:08.796653  5689 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.812470  5660 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.816874  5710 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:08.816998  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.862845  1532 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:08.804812  5667 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.826682  5711 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.792315  1540 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:08.835989  1690 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:08.827760  5664 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.836423  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.877909  1681 raft_consensus.cc:2410] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:08.846376  1686 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:08.879465  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.879606  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.807005  5676 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:08.762876  5587 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.848305  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:08.848786  5714 consensus_queue.cc:260] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.850143  5653 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.811815  5524 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:08.924929  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:08.808949  5637 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:08.864941  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:08.858223  5440 consensus_meta.cc:287] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.091s	user 0.013s	sys 0.000s
I20260709 13:00:08.926178  5554 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.965523  5714 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.965664  5440 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.824203  5698 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.927279  1681 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:08.834172  5389 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:08.864717  5660 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.968456  5715 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.969161  5715 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.970209  5660 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:08.971336  5715 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.971901  5478 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.972420  5478 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.873247  2302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:53448
I20260709 13:00:08.873558  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.975453  2302 raft_consensus.cc:606] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:08.772110  4224 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:08.875643  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.976981  1507 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:08.977301  1615 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:08.882319  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.977849  1507 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:08.887806  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.883419  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:08.922087  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.862638  5665 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:08.864818  5390 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.925926  1534 raft_consensus.cc:2410] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:08.987955  1535 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:08.926638  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.904839  5657 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:08.873813  5667 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.924729  5664 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:08.942682  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.925180  5652 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:08.964835  1682 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:08.965921  5554 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.871004  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.975814  2302 raft_consensus.cc:614] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:08.981671  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.000907  1607 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:08.986933  1507 leader_election.cc:400] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13.
W20260709 13:00:08.989940  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 90249.6us
I20260709 13:00:08.861765  5447 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:08.994897  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.998111  1611 raft_consensus.cc:2410] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:00:08.998945  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:08.974712  5478 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.001924  1507 leader_election.cc:403] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:08.943296  5688 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:08.989142  5587 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.013397  1685 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:08.996336  5657 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.863570  5689 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.000159  5637 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:09.048192  5263 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.977s	user 0.004s	sys 0.007s
I20260709 13:00:08.989056  5440 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:09.026963  5711 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.075276  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:08.996686  5660 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:09.075431  5440 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:09.012763  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:09.030682  5587 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.031728  5688 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.076653  5440 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:09.077384  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:09.078125  1534 raft_consensus.cc:2393] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:09.013453  5668 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13.
I20260709 13:00:08.998664  5665 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:08.988513  5697 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.079273  5697 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.079787  1681 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:09.078918  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:09.049783  5671 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.001s
I20260709 13:00:09.080967  1534 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:09.081517  5697 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:09.076053  5660 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:08.998843  5390 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:09.082056  1534 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:09.006778  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65070.4us
I20260709 13:00:09.052512  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:09.085520  1682 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:09.020401  1689 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:09.046603  5309 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:09.105074  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.993819  5524 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.114799  2302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79180ee33a124de7a839155b4a30086e"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:53448
I20260709 13:00:09.063066  5653 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.115924  2302 raft_consensus.cc:606] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:09.140198  2302 raft_consensus.cc:614] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:09.136693  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:09.026415  5709 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:00:09.141575  1615 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:09.083969  5657 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.014951  5478 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:09.026947  5554 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:09.179049  5726 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:09.029587  5447 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.003379  5652 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.081753  5263 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.081857  5671 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.115988  5637 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:09.194630  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:09.339439  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.519326  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.276558  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:09.517733  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 1.20971e+06us
I20260709 13:00:09.520383  2309 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
W20260709 13:00:09.231555  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.517678  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 372534us
I20260709 13:00:09.371289  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.521311  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2012) took 1035 ms. Trace:
I20260709 13:00:09.203900  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:09.525015  1536 rpcz_store.cc:276] 0709 13:00:08.485547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.485693 (+   146us) service_pool.cc:224] Handling call
0709 13:00:08.486083 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.510041 (+ 23958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.510085 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.512029 (+  1944us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.914763 (+402734us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.914826 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.914927 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.359484 (+444557us) raft_consensus.cc:1685] finished
0709 13:00:09.359512 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.521256 (+161744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36377,"raft.queue_time_us":64862,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":19219,"thread_start_us":334845,"threads_started":1,"wal-append.queue_time_us":805434}
I20260709 13:00:09.520933  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:09.526826  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.530929  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:09.532462  1653 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:09.519243  5389 consensus_meta.cc:287] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 13:00:09.137945  5688 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.139839  5524 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.142445  5463 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:09.587026  1683 raft_consensus.cc:1240] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:09.575356  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.590817  1616 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:09.368999  5737 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.179775  5689 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.415326  5686 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:09.517596  5587 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:09.557854  1689 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
W20260709 13:00:09.572325  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 51471.5us
I20260709 13:00:09.361953  5676 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:09.368319  5722 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:09.314845  5660 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:09.665307  5659 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.545s	user 0.014s	sys 0.004s
I20260709 13:00:09.536929  5478 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:09.674628  5519 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.675319  5738 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:00:09.674855  5686 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:09.601084  5645 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.001s
I20260709 13:00:09.559196  5558 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:09.555385  5716 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:09.618820  5688 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:09.678544  5725 log.cc:927] Time spent T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.474s	user 0.000s	sys 0.001s
I20260709 13:00:09.626587  5667 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:09.833046  5519 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:09.834806  5309 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:09.835275  5558 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:09.552652  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.758208  1532 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:09.752158  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.840145  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:09.773537  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 493) took 1531 ms. Trace:
I20260709 13:00:09.761375  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 492) took 1519 ms. Trace:
W20260709 13:00:09.614305  1607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.004s
I20260709 13:00:09.563906  1610 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:09.562213  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.627115  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.773562  1535 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:09.970324  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.001s
I20260709 13:00:09.784215  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:09.784749  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.785610  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:09.788585  1609 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:09.790343  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.983892  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.984403  5701 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:09.985811  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.950498  1540 rpcz_store.cc:276] 0709 13:00:08.242320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.243652 (+  1332us) service_pool.cc:224] Handling call
0709 13:00:08.792117 (+548465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.872837 (+ 80720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.772961 (+900124us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000c1550. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:09.773290 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117620096}
I20260709 13:00:09.794358  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:09.987095  5748 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:09.794898  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2016) took 2462 ms. Trace:
I20260709 13:00:09.987489  5390 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:09.792822  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:09.987962  5748 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:09.989545  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 197211us
I20260709 13:00:09.987789  1684 rpcz_store.cc:276] 0709 13:00:07.331848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.341229 (+  9381us) service_pool.cc:224] Handling call
0709 13:00:07.341586 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.611779 (+270193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:07.951778 (+339999us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.134040 (+182262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.134105 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.134152 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.234452 (+100300us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b1800351ca0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:08.767530 (+533078us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b1800351ca0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:09.691840 (+924310us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:09.794309 (+102469us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400256054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:09.794415 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.794707 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12751,"prepare.queue_time_us":143688,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":14332,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3206,"spinlock_wait_cycles":702928640,"thread_start_us":497439,"threads_started":2,"wal-append.queue_time_us":189551}
I20260709 13:00:09.990856  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:09.806524  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:09.808899  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:09.992137  2307 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:09.992846  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 550) took 1184 ms. Trace:
I20260709 13:00:09.993211  2307 rpcz_store.cc:276] 0709 13:00:08.808191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.805634 (+997443us) service_pool.cc:224] Handling call
0709 13:00:09.992777 (+187143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:09.945293  5746 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:09.993589  5734 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:09.810695  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2024) took 1638 ms. Trace:
I20260709 13:00:09.994246  5746 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.994627  5734 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:09.811864  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:09.993621  5274 consensus_meta.cc:287] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.171s	user 0.004s	sys 0.015s
I20260709 13:00:09.996037  2310 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:09.813163  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:09.997960  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:09.811754  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:09.817473  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 602) took 1642 ms. Trace:
I20260709 13:00:09.823271  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:09.818435  2276 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:09.821218  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:10.000676  1687 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:09.829620  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:09.611729  5463 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.012789  5463 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.013006  1614 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:09.832116  5665 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.609838  5389 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.014842  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.674878  5509 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:09.833689  5667 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:10.016453  5667 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:09.765404  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2008) took 1352 ms. Trace:
I20260709 13:00:10.019274  5732 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:09.970671  5309 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.558306  1611 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:10.020416  5309 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.021840  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:09.689203  5688 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:10.022965  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.008s
W20260709 13:00:10.023730  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.008s	sys 0.008s
W20260709 13:00:10.024791  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 239531us
I20260709 13:00:10.024542  5688 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:10.025166  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.707662  5690 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:10.026029  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 242243us
I20260709 13:00:10.026047  5644 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:09.703317  5686 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:10.026839  5644 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:10.026988  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:10.027426  1608 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:09.948078  5587 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:10.027948  1532 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:10.029038  1682 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:10.028762  5587 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.029528  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:10.030613  1532 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:10.031746  2303 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:10.031903  5587 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:09.701772  5708 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 1.122s	user 0.002s	sys 0.000s
W20260709 13:00:09.696810  5714 consensus_meta.cc:287] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.000s
I20260709 13:00:09.685648  5716 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.103652  5716 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.614398  5737 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.104668  5478 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.106321  5737 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:09.840260  5652 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.558461  5447 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:09.784066  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:09.985492  5701 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:09.986424  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:09.642904  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.991176  5748 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:09.800493  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.001703  5390 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.002367  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:09.823616  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:10.004509  5379 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.004783  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:10.001134  1685 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 13:00:10.010288  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 547) took 1122 ms. Trace:
W20260709 13:00:09.692392  5681 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.925s	user 0.000s	sys 0.003s
I20260709 13:00:09.677811  5722 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.019013  1538 rpcz_store.cc:276] 0709 13:00:08.413045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.413194 (+   149us) service_pool.cc:224] Handling call
0709 13:00:08.413533 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.773767 (+360234us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:08.773799 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.774259 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.517941 (+743682us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:09.517981 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.764562 (+246581us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540030a054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:09.764664 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.764762 (+    98us) raft_consensus.cc:1685] finished
0709 13:00:09.764775 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.765199 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2444,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":827703168,"thread_start_us":371018,"threads_started":1,"wal-append.queue_time_us":908862}
I20260709 13:00:09.682438  5645 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.192611  5722 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.193372  5645 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:10.035115  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.999440  1683 rpcz_store.cc:276] 0709 13:00:08.174799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.224054 (+ 49255us) service_pool.cc:224] Handling call
0709 13:00:08.245609 (+ 21555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.603722 (+1358113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.816956 (+213234us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540012e154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:09.817305 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3084615424}
I20260709 13:00:10.035966  5671 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:09.695528  5699 consensus_meta.cc:287] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.259s	user 0.010s	sys 0.000s
I20260709 13:00:10.197021  1613 raft_consensus.cc:2368] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11.
I20260709 13:00:10.196975  5699 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:10.027434  5644 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.198722  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2010) took 1757 ms. Trace:
I20260709 13:00:10.200763  1541 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:10.037631  5676 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.012925  5696 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:10.204380  5696 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.205830  5701 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:09.949486  1533 rpcz_store.cc:276] 0709 13:00:08.242049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.243584 (+  1535us) service_pool.cc:224] Handling call
0709 13:00:08.306091 (+ 62507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.392756 (+ 86665us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:08.673544 (+280788us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.813760 (+140216us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.814591 (+   831us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.814912 (+   321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.814957 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:08.815004 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.760592 (+945588us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b540040c4d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:09.760694 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.761133 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47203,"prepare.queue_time_us":113610,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":47472,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":215,"spinlock_wait_cycles":198830848,"thread_start_us":372282,"threads_started":2,"wal-append.queue_time_us":305038}
W20260709 13:00:10.044600  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 226483us
I20260709 13:00:10.045418  5509 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:10.047303  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2036) took 1211 ms. Trace:
I20260709 13:00:09.987545  1689 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:10.051488  1684 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:10.223569  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55612 (request call id 616) took 1025 ms. Trace:
W20260709 13:00:10.053002  1506 leader_election.cc:336] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.704s (SENT)
I20260709 13:00:10.055085  5732 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.057133  5263 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.057394  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:10.060458  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.003s	sys 0.002s
I20260709 13:00:10.061908  5389 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.064428  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:10.071300  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44343.7us
I20260709 13:00:10.067525  5746 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.084048  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.089470  5686 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:10.089890  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:10.090051  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:10.090526  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:10.091382  1607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.021s	sys 0.019s
I20260709 13:00:10.096252  5651 raft_consensus.cc:993] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:10.096657  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.096771  5643 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:10.097509  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.100013  5309 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.107542  5447 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.110100  2309 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:10.232499  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.126127  1687 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:00:10.062987  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.001s	sys 0.004s
W20260709 13:00:10.844152  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.007s	sys 0.016s
W20260709 13:00:10.844611  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 1.31669e+06us
W20260709 13:00:10.163910  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 363837us
I20260709 13:00:10.126633  1609 rpcz_store.cc:276] 0709 13:00:08.887693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.887896 (+   203us) service_pool.cc:224] Handling call
0709 13:00:08.905163 (+ 17267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.788130 (+882967us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b54001ec420. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc2dc0 00007f8d58c4d1c0 00007f8d58c4e231 00007f8d58c4ad8f 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c
0709 13:00:10.009867 (+221737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.010209 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165506816}
I20260709 13:00:10.848861  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.849201  1609 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:10.166697  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 231506us
I20260709 13:00:10.849874  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.852115  5510 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:10.852726  1507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 1.786s (SENT) [suppressed 12 similar messages]
I20260709 13:00:10.852942  5510 consensus_queue.cc:1243] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:10.853713  5510 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:10.854007  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:10.177189  5662 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.026s	sys 0.055s
W20260709 13:00:10.856922  5662 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.565s	user 0.026s	sys 0.056s
I20260709 13:00:10.177034  5680 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.857887  5680 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.858276  5680 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:10.177356  1539 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.020s
W20260709 13:00:10.860592  1539 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.005s	sys 0.021s
I20260709 13:00:10.188642  5519 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:10.223949  1689 rpcz_store.cc:276] 0709 13:00:09.199409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.793600 (+594191us) service_pool.cc:224] Handling call
0709 13:00:10.223497 (+429897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.223290  1686 rpcz_store.cc:276] 0709 13:00:08.835707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.881641 (+ 45934us) service_pool.cc:224] Handling call
0709 13:00:08.882079 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.205324 (+323245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.205372 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.205929 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.623596 (+417667us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:09.623657 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.809159 (+185502us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54004402d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:09.809238 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.046790 (+237552us) raft_consensus.cc:1685] finished
0709 13:00:10.046819 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.047118 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24823,"raft.queue_time_us":188393,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"spinlock_wait_cycles":595436928,"thread_start_us":266105,"threads_started":1,"wal-append.queue_time_us":675421}
I20260709 13:00:10.236359  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:10.863015  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 810151us
W20260709 13:00:10.864346  1506 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.744s (SENT)
I20260709 13:00:10.864849  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:10.238796  1533 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:00:10.865820  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2028) took 1054 ms. Trace:
I20260709 13:00:10.849870  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1819) took 1396 ms. Trace:
I20260709 13:00:10.866259  1533 rpcz_store.cc:276] 0709 13:00:09.811129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.237807 (+426678us) service_pool.cc:224] Handling call
0709 13:00:10.238227 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.865557 (+627330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.865764 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.866376  1609 rpcz_store.cc:276] 0709 13:00:09.453402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.848508 (+1395106us) service_pool.cc:224] Handling call
0709 13:00:10.848935 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.849629 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.849818 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.248212  1681 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:10.199115  1537 rpcz_store.cc:276] 0709 13:00:08.441534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.441792 (+   258us) service_pool.cc:224] Handling call
0709 13:00:08.442099 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.444950 (+  2851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.444980 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.445463 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.767094 (+1321631us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b18000de520. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1
0709 13:00:09.767399 (+   305us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:10.084131 (+316732us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.198121 (+113990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.198241 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.198285 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:10.198380 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.198560 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23156,"raft.queue_time_us":54174,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":30019,"spinlock_wait_cycles":17953152,"thread_start_us":375811,"threads_started":3,"wal-append.queue_time_us":251847}
I20260709 13:00:10.223893  5667 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.868577  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 2045) took 1078 ms. Trace:
I20260709 13:00:10.868952  1681 rpcz_store.cc:276] 0709 13:00:09.790327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.823037 (+ 32710us) service_pool.cc:224] Handling call
0709 13:00:10.868500 (+1045463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.223255  5509 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.206598  5696 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:10.246359  5686 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.870301  5509 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.870523  5686 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.854051  5510 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.871572  5510 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.872128  5699 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:10.872967  5699 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.289287  2310 raft_consensus.cc:2368] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12.
I20260709 13:00:10.290966  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 614) took 1150 ms. Trace:
W20260709 13:00:10.319538  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 87238.7us
I20260709 13:00:10.876629  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 505) took 1046 ms. Trace:
I20260709 13:00:10.877447  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.878394  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.310536  5390 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:10.177568  5690 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.212s
I20260709 13:00:10.880627  5390 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.349629  1611 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:10.882829  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1809) took 1487 ms. Trace:
I20260709 13:00:10.883215  1611 rpcz_store.cc:276] 0709 13:00:09.395614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.071766 (+676152us) service_pool.cc:224] Handling call
0709 13:00:10.882768 (+811002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.883616  5386 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:10.884466  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:10.885233  5569 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:10.885643  5569 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.885808  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.886569  1611 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:10.876464  1682 rpcz_store.cc:276] 0709 13:00:09.140786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.031227 (+890441us) service_pool.cc:224] Handling call
0709 13:00:10.170428 (+139201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.290425 (+119997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.290469 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.290536 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:10.290581 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.290682 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.290887 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.887509  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.264038  5671 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:10.356370  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.243069  5379 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.889834  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:10.890170  5775 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:10.891151  5519 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.890945  5775 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.347359  5651 raft_consensus.cc:1081] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:10.891601  5519 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.892066  5519 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.378310  1685 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:10.892714  1685 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:10.893352  5775 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.893965  5775 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:10.893693  1685 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.894740  5379 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:10.894804  1685 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:10.409631  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 324090us
I20260709 13:00:10.885972  5569 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.355345  5645 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.896167  1581 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:10.896786  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:10.897959  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:10.415220  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 552) took 1328 ms. Trace:
I20260709 13:00:10.898932  5731 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.899101  1610 rpcz_store.cc:276] 0709 13:00:08.985785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.985928 (+   143us) service_pool.cc:224] Handling call
0709 13:00:08.986300 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.986257 (+999957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.265788 (+279531us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540020ce54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:10.314241 (+ 48453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327966080}
I20260709 13:00:10.377120  5309 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:10.900274  1506 leader_election.cc:336] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.762s (SENT)
I20260709 13:00:10.900434  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.900597  5309 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:10.900779  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:10.415446  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1806) took 1036 ms. Trace:
I20260709 13:00:10.420758  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1810) took 1024 ms. Trace:
W20260709 13:00:10.418752  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 495) took 1722 ms (client timeout 2015 ms). Trace:
I20260709 13:00:10.899677  5731 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:10.899111  5690 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:10.901952  1608 rpcz_store.cc:276] 0709 13:00:09.395906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.311005 (+915099us) service_pool.cc:224] Handling call
0709 13:00:10.396717 (+ 85712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.420241 (+ 23524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.420291 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.420386 (+    95us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:10.420435 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.420532 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.420685 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.903016  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:10.903748  1686 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
W20260709 13:00:10.422637  5657 consensus_meta.cc:287] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.833s	user 0.015s	sys 0.000s
I20260709 13:00:10.592662  1687 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:10.904840  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57982 (request call id 2039) took 1117 ms. Trace:
I20260709 13:00:10.621640  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 501) took 1828 ms. Trace:
W20260709 13:00:10.424743  5524 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.006s
I20260709 13:00:10.660288  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2025) took 1285 ms. Trace:
W20260709 13:00:10.669945  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 91897.8us
I20260709 13:00:10.905192  1687 rpcz_store.cc:276] 0709 13:00:09.787945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.001915 (+213970us) service_pool.cc:224] Handling call
0709 13:00:10.904777 (+902862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.620065  5748 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.905572  5524 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:10.906235  1506 leader_election.cc:336] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.874s (SENT)
I20260709 13:00:10.906440  5748 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:10.412421  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 407827us
I20260709 13:00:10.909154  5724 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:10.909739  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:10.910331  5724 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:10.911417  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:10.412700  5688 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:10.911726  1541 rpcz_store.cc:269] 0709 13:00:08.696163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.696301 (+   138us) service_pool.cc:224] Handling call
0709 13:00:10.418494 (+1722193us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540017b1d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:10.418671 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457005952}
I20260709 13:00:10.912413  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:10.912505  5688 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.912918  5722 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:10.888178  1611 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:10.914568  1611 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:10.914705  5722 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:10.915112  5667 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:10.915227  5722 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:10.915520  5520 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:10.662655  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2026) took 1126 ms. Trace:
I20260709 13:00:10.915915  5667 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:10.732842  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.746990  5447 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:09.994480  1688 rpcz_store.cc:276] 0709 13:00:08.172471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.172666 (+   195us) service_pool.cc:224] Handling call
0709 13:00:08.173032 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.208620 (+ 35588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.208656 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.219056 (+ 10400us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.332154 (+113098us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.332196 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.809827 (+1477631us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400363154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:09.809939 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.810025 (+    86us) raft_consensus.cc:1685] finished
0709 13:00:09.810042 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.810446 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258,"raft.queue_time_us":4546,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":23692,"spinlock_wait_cycles":80816896,"thread_start_us":20493,"threads_started":1,"wal-append.queue_time_us":119447,"wal-append.run_cpu_time_us":3445,"wal-append.run_wall_time_us":1605467}
I20260709 13:00:10.768749  1538 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:10.739673  5664 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.790867  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2042) took 1001 ms. Trace:
I20260709 13:00:10.916060  1535 rpcz_store.cc:276] 0709 13:00:09.530471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.032774 (+502303us) service_pool.cc:224] Handling call
0709 13:00:10.033150 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.033473 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:10.252904 (+219431us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.622008 (+369104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.622063 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:10.657008 (+ 34945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.657096 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.657228 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20995,"prepare.queue_time_us":255710,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":26918,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":467563,"threads_started":2,"wal-append.queue_time_us":407977}
I20260709 13:00:10.917446  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2030) took 1105 ms. Trace:
I20260709 13:00:10.728842  5746 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:10.749151  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.917994  1538 rpcz_store.cc:276] 0709 13:00:09.811750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.768171 (+956421us) service_pool.cc:224] Handling call
0709 13:00:10.768537 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.917206 (+148669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.917393 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.762318  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 553) took 1762 ms. Trace:
I20260709 13:00:10.905570  1532 rpcz_store.cc:276] 0709 13:00:09.367963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.031493 (+663530us) service_pool.cc:224] Handling call
0709 13:00:10.072068 (+ 40575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.226777 (+154709us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:10.277953 (+ 51176us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.612665 (+334712us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.653021 (+ 40356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.653077 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:10.653127 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.653191 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.653324 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56152,"prepare.queue_time_us":35681,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":5115,"raft.queue_time_us":67342,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9594,"thread_start_us":247352,"threads_started":1,"wal-append.queue_time_us":368223}
I20260709 13:00:10.826018  5558 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:10.830610  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.830200  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2031) took 1018 ms. Trace:
I20260709 13:00:10.854204  5660 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:10.901635  1612 rpcz_store.cc:276] 0709 13:00:09.379183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.344350 (+965167us) service_pool.cc:224] Handling call
0709 13:00:10.378132 (+ 33782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.414997 (+ 36865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.415026 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.415107 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:10.415143 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.415212 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.415357 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.920805  5660 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.831879  5758 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:10.921626  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.921972  5758 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:10.922118  5746 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.922559  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.923015  5758 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.854316  5587 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.924458  5587 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.924947  5587 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.924662  2301 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:10.917482  1683 rpcz_store.cc:276] 0709 13:00:09.789252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.227211 (+437959us) service_pool.cc:224] Handling call
0709 13:00:10.233863 (+  6652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.234190 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:10.397901 (+163711us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.790317 (+392416us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.790511 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.790559 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:10.790601 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.790664 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.790787 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3161,"prepare.queue_time_us":451992,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":88,"raft.queue_time_us":68470,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":780,"spinlock_wait_cycles":1495296,"thread_start_us":530348,"threads_started":3,"wal-append.queue_time_us":358064}
I20260709 13:00:10.926370  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:10.236554  5732 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.927253  2305 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:10.168926  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.855726  5389 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:10.928371  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46818 (request call id 1805) took 1549 ms. Trace:
I20260709 13:00:10.928755  1616 rpcz_store.cc:276] 0709 13:00:09.378861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.117223 (+738362us) service_pool.cc:224] Handling call
0709 13:00:10.928313 (+811090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.928598  5389 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.924558  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.929984  2309 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:10.930939  5389 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.919430  1607 rpcz_store.cc:276] 0709 13:00:09.000397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.003337 (+  2940us) service_pool.cc:224] Handling call
0709 13:00:09.003656 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.003890 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:10.350305 (+1346415us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.746466 (+396161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.749870 (+  3404us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:10.754100 (+  4230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.755395 (+  1295us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.762266 (+  6871us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272764,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":25778,"raft.queue_time_us":15632,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":845,"thread_start_us":1554452,"threads_started":2,"wal-append.queue_time_us":375592}
W20260709 13:00:10.828508  5749 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.845s	user 0.019s	sys 0.019s
I20260709 13:00:10.403926  1614 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:10.435436  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 546) took 1552 ms. Trace:
I20260709 13:00:10.915925  5520 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:10.932288  1613 rpcz_store.cc:276] 0709 13:00:08.887323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.887472 (+   149us) service_pool.cc:224] Handling call
0709 13:00:10.435135 (+1547663us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003f4b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:10.435340 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800426880}
I20260709 13:00:10.933197  5746 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.933012  5520 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.933568  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 610) took 1861 ms. Trace:
I20260709 13:00:10.901681  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff79ac342d91424db634ca7802846535"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:10.934062  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1812) took 1537 ms. Trace:
I20260709 13:00:10.903801  1608 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:10.934444  5520 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.934536  1610 raft_consensus.cc:606] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:10.901597  5699 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:10.904438  5657 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.924747  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.884562  5386 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.936790  2304 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:10.936874  5386 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.670573  5643 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.680702  5759 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.236s	user 0.002s	sys 0.006s
I20260709 13:00:10.937812  5657 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.931447  1540 rpcz_store.cc:276] 0709 13:00:09.812070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.829235 (+1017165us) service_pool.cc:224] Handling call
0709 13:00:10.829578 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.829844 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.829878 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.829934 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:10.829962 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.830013 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.830126 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.934536  1614 rpcz_store.cc:276] 0709 13:00:09.396519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.341081 (+944562us) service_pool.cc:224] Handling call
0709 13:00:10.343577 (+  2496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.932206 (+588629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.933788 (+  1582us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b5400216454. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:10.933996 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138275072}
I20260709 13:00:10.914805  5688 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:10.869827  5757 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.683568  5644 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.937839  5643 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.940461  5757 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.940932  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:10.941831  5643 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.939651  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2018) took 2054 ms. Trace:
I20260709 13:00:10.905296  1536 rpcz_store.cc:276] 0709 13:00:08.792885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.561757 (+768872us) service_pool.cc:224] Handling call
0709 13:00:09.572945 (+ 11188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.103784 (+530839us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:10.353728 (+249944us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.619288 (+265560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.619344 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:10.619424 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.621223 (+  1799us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54002c6d54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:10.621266 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.621421 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14558,"prepare.queue_time_us":185666,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":16872,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":151,"spinlock_wait_cycles":1219751168,"thread_start_us":460449,"threads_started":2,"wal-append.queue_time_us":370680}
I20260709 13:00:10.925688  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.819000  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1815) took 1388 ms. Trace:
I20260709 13:00:10.942750  1534 rpcz_store.cc:276] 0709 13:00:08.884756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.601663 (+716907us) service_pool.cc:224] Handling call
0709 13:00:09.602077 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.602500 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:09.972637 (+370137us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.344182 (+371545us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.398214 (+ 54032us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.398361 (+   147us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:10.398398 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.407648 (+  9250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.939341 (+531693us) raft_consensus.cc:1685] finished
0709 13:00:10.939360 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.939481 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":586643,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":8658,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":13703,"thread_start_us":522097,"threads_started":2,"wal-append.queue_time_us":405769}
I20260709 13:00:10.925068  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.943830  1615 rpcz_store.cc:276] 0709 13:00:09.430231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.817978 (+1387747us) service_pool.cc:224] Handling call
0709 13:00:10.818423 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.818631 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.818659 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.818717 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:10.818747 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.818800 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.818919 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.945084  5688 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.945966  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.903837  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:10.917222  5309 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.947968  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:10.949021  5711 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:10.949535  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.937444  5386 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:10.682144  5762 log.cc:927] Time spent T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:00:10.934067  1690 rpcz_store.cc:276] 0709 13:00:09.071871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.072006 (+   135us) service_pool.cc:224] Handling call
0709 13:00:09.072405 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.393340 (+320935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.393385 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.394216 (+   831us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.024569 (+630353us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:10.024699 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.024833 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.827679 (+802846us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:10.933257 (+105578us) raft_consensus.cc:1685] finished
0709 13:00:10.933274 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.933495 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":295780,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":156327168,"thread_start_us":949987,"threads_started":2,"wal-append.queue_time_us":588550}
I20260709 13:00:10.952525  5390 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:10.952780  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49078.6us
I20260709 13:00:10.855304  5418 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:10.953588  5418 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:10.953969  5758 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.954244  5660 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:10.954555  5418 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.956620  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:10.941847  5644 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.935190  1610 raft_consensus.cc:630] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Rejecting request to transfer leadership because tablet server 0f82bbd9193f4b71a0c17a0357cf0ce9 is not a voter in the active config
I20260709 13:00:10.894517  5775 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:10.960536  5418 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.963229  5696 consensus_queue.cc:1059] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:10.906800  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:10.939574  5524 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.909355  5748 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.964833  5660 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.965538  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:10.965849  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 59686.8us
I20260709 13:00:10.966545  5379 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.966921  5379 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.967257  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:10.967476  5379 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.968680  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:10.969434  1536 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:10.969326  5722 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:10.968703  5775 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:10.970777  5722 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.877074  1533 rpcz_store.cc:276] 0709 13:00:09.829760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.867617 (+1037857us) service_pool.cc:224] Handling call
0709 13:00:10.867924 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.876279 (+  8355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.876319 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.876368 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:10.876402 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.876462 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.876559 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.973646  5711 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.867834  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.942795  5757 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:10.980993  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:10.943403  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:10.963804  5587 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:11.005913  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 62641.5us
I20260709 13:00:11.011361  1685 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:11.012310  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2049) took 1212 ms. Trace:
I20260709 13:00:11.016929  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:11.012732  1685 rpcz_store.cc:276] 0709 13:00:09.799728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.256759 (+457031us) service_pool.cc:224] Handling call
0709 13:00:10.267724 (+ 10965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.011978 (+744254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.012243 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.022258  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:11.023334  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69669.5us
I20260709 13:00:11.033763  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.034646  1685 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:11.035889  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.005801  5676 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.038456  2308 raft_consensus.cc:2368] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:11.041225  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.041808  1610 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:11.046922  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.047340  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.047534  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 500) took 2255 ms. Trace:
I20260709 13:00:11.047566  1614 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:11.048310  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.048959  2305 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 13:00:11.025307  5645 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:11.024958  5775 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:11.051532  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:10.912025  5509 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.048101  1539 rpcz_store.cc:276] 0709 13:00:08.792256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.560535 (+768279us) service_pool.cc:224] Handling call
0709 13:00:09.560862 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.561106 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:10.861033 (+1299927us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.046933 (+185900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.046995 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:11.047052 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.047333 (+   281us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.047466 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":547261,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":1481141,"threads_started":2}
I20260709 13:00:11.057564  1611 raft_consensus.cc:1240] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:11.058298  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.056309  5676 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.061528  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:11.062206  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 137) took 11912 ms (client timeout 15000 ms). Trace:
I20260709 13:00:11.062945  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:11.072010  1537 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:11.072799  1535 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:11.063359  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:11.064029  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34880
I20260709 13:00:11.073799  1538 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.074260  1538 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.064651  5459 raft_consensus.cc:3055] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:11.064985  1653 leader_election.cc:400] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12.
I20260709 13:00:11.075237  1653 leader_election.cc:403] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:11.077257  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:11.066053   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:11.069283  1614 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:11.054458  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:11.065212  5653 consensus_queue.cc:1059] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:11.080685  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.082589  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.056707  5644 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:11.075852  5390 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12.
I20260709 13:00:11.085546  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.055693  5775 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.086845  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:11.087880  1608 raft_consensus.cc:2393] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:11.089887  2310 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:11.091775  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.093143  5696 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:11.093793  5696 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.094252  5696 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:11.098065  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.098619  5653 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:11.099005  5653 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:11.090065  5775 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.099666  5447 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:11.072897  5524 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:11.101263  1532 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:11.076622  5459 raft_consensus.cc:740] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.109683  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.116750  1533 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:00:11.120823  1533 pending_rounds.cc:85] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 5
I20260709 13:00:11.121021  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.099864  5653 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.103705  5660 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.100275  5447 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:11.122967  5390 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:11.126425  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:11.132351  1653 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:11.121845  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.141696   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:11.142390  5379 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.116573  5389 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:11.121064  1533 pending_rounds.cc:107] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:11.144779  1533 raft_consensus.cc:2889] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:11.144860  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 99891.6us
I20260709 13:00:11.133056  5459 consensus_queue.cc:260] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.104091  5699 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.144497  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:11.071770  1436 rpcz_store.cc:269] 0709 12:59:59.150085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.152446 (+  2361us) service_pool.cc:224] Handling call
0709 13:00:11.061945 (+11909499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:05.659649 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:05.660181 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:05.660215 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:00:05.660252 (+    37us) tablet.cc:662] Decoding operations
0709 13:00:05.661548 (+  1296us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:05.661629 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:05.661657 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:00:05.662692 (+  1035us) tablet.cc:701] Row locks acquired
0709 13:00:05.662705 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:00:05.662852 (+   147us) write_op.cc:270] Start()
0709 13:00:05.662966 (+   114us) write_op.cc:276] Timestamp: P: 1783602005662802 usec, L: 0
0709 13:00:05.662984 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:00:05.663859 (+   875us) log.cc:844] Serialized 5604 byte log entry
0709 13:00:05.938800 (+274941us) op_driver.cc:464] REPLICATION: finished
0709 13:00:05.981501 (+ 42701us) write_op.cc:301] APPLY: starting
0709 13:00:05.981587 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:05.981917 (+   330us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:05.982042 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:06.059213 (+ 77171us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:06.061625 (+  2412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:00:06.061678 (+    53us) write_op.cc:312] APPLY: finished
0709 13:00:06.062006 (+   328us) log.cc:844] Serialized 101 byte log entry
0709 13:00:06.062191 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:06.062335 (+   144us) write_op.cc:454] Released schema lock
0709 13:00:06.062404 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:06.063227 (+   823us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:06.063255 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36662,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":42422,"apply.run_cpu_time_us":4812,"apply.run_wall_time_us":81697,"num_ops":14,"prepare.queue_time_us":140381,"prepare.run_cpu_time_us":13071,"prepare.run_wall_time_us":112537,"raft.queue_time_us":119732,"raft.run_cpu_time_us":4087,"raft.run_wall_time_us":63009,"replication_time_us":264666,"thread_start_us":314178,"threads_started":4,"wal-append.queue_time_us":130756,"wal-append.run_cpu_time_us":12562,"wal-append.run_wall_time_us":1282391}]]}
I20260709 13:00:11.156991  5389 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.159155  5389 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.159648  5389 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:11.151101  5748 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:11.161254  5748 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:11.168648  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.128672  5587 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.171448  1581 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:11.165752  1656 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.172578  5524 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:11.161687  5748 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:11.175407  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 56145.6us
W20260709 13:00:11.176410  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 53311.3us
I20260709 13:00:11.178474  1538 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.185768  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.188083  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.175601  5389 consensus_queue.cc:1243] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:11.148763  5686 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.209246  1538 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.203594  1507 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.212275  1535 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:11.213897  1535 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:11.173178  5660 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.194977  5379 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.198151  5657 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:11.202993  5587 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.175020  5699 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:11.226053  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73234.1us
I20260709 13:00:11.187418  5732 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.230139  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.209316  5643 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:11.232435  1609 raft_consensus.cc:2368] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11.
W20260709 13:00:11.224560  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 107120us
W20260709 13:00:11.274879  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 75927.6us
I20260709 13:00:11.293689  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.294036  5699 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.294287  1685 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.295117  5680 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:11.295617  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 67060.5us
I20260709 13:00:11.296511  1579 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:11.297204  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 67184.6us
I20260709 13:00:11.300694  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.293356  5386 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.302846  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:11.318475  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.304881  5447 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:11.305441  5683 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:11.306016  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 44514us
I20260709 13:00:11.306133  5686 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.306896  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.334088  1689 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.299872  1535 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:11.310820  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.312330  5786 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:11.313277  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 167348us
W20260709 13:00:11.313511  5780 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:00:11.314275  5305 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:11.315296  5732 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.316195  5509 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.316622  5263 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:11.304570  5676 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.210973  5651 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:00:11.352497  1532 raft_consensus.cc:3055] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:11.352937  5784 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:00:11.274121  5758 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:11.324323  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 150871us
I20260709 13:00:11.270458  5643 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:11.336328  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.336946  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:11.360709  1538 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.322033  5459 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:11.317237  5524 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:11.352959  1532 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:11.358278  1685 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:11.345419  5305 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.340606  5731 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:11.373112  1535 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.317986  5510 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.381994  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:11.346832  5680 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.346926  5263 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.400130  5263 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:11.401433  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.402050  1683 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:11.402328  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.402977  1688 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.390678  5386 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:11.390307  1532 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.362572  5643 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.390990  5569 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:11.410144  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 48463.7us
I20260709 13:00:11.392197  5660 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.372752  5305 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.353514  5787 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:11.369446  5524 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.405851  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:11.412094  2309 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 13:00:11.410772  1506 leader_election.cc:336] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.138s (SENT)
I20260709 13:00:11.415102  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.378757  5731 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:11.399469  5696 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.419544  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.420661  2303 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:11.423277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.423887  1532 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.426941  1690 raft_consensus.cc:2410] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:00:11.427207  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 45344.9us
I20260709 13:00:11.427970  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:11.396040  5748 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.446056  5748 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.416685  5787 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.452737  5787 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.453130  1688 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:11.340979  5786 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.457978  5786 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.420979  5731 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.433259  5569 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:11.436888  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.463472  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:11.404778  5519 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.418852  5524 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.464190  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:11.472828  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 44944.2us
I20260709 13:00:11.474471  1579 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:11.427001  5386 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:11.421509  5645 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:11.428932  5447 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:11.481756  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.482411  1535 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:11.479487  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47676us
I20260709 13:00:11.485055  1685 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:11.469484  5799 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:00:11.467828  5786 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:11.492755  1579 leader_election.cc:400] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:11.477843  5459 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:11.493455  1579 leader_election.cc:403] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:11.481076  5644 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:11.490988  5389 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:00:11.500597  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 95025.5us
I20260709 13:00:11.500824  1538 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:11.502293  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.484591  5447 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:11.488982  5676 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:11.505913  5696 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.507259  5653 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:11.511189  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 47122.7us
I20260709 13:00:11.513209  2276 leader_election.cc:400] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11.
I20260709 13:00:11.495030  5509 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:11.493158  5386 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.522439  1683 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
W20260709 13:00:11.536865  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.507727  5643 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.540685  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:11.501761  5459 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.552958  5459 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:11.536826  5520 consensus_meta.cc:287] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.008s
I20260709 13:00:11.542353  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.561846  1685 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.541759  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.522492  5309 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:00:11.570109  1685 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:11.571429  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:11.572485  5781 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:11.573005  5781 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.578064  5788 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:11.578514  5788 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.549894  5305 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.505936  5447 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:11.522711  5509 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:11.586203  5509 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.587356  5305 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.558413  5386 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.559597  5510 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.560045  5758 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:11.538007  5696 consensus_queue.cc:1059] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:00:11.560491  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.600662  1683 raft_consensus.cc:2393] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:11.562870  1682 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.537402  5645 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:00:11.563458  1506 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.235s (SENT)
I20260709 13:00:11.607921  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:11.584004  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 66371.6us
W20260709 13:00:11.541980  5722 consensus_meta.cc:287] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.005s
I20260709 13:00:11.609440  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.502110  5263 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.597028  5643 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:11.597766  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57140.2us
I20260709 13:00:11.598577  5686 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:11.596405  5758 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.585614  1689 raft_consensus.cc:2468] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:11.614370  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.612706  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:11.620330  1540 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.616400  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.621248  2301 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.616813  2310 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:11.622442  1685 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:11.617077  5263 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:11.626597  2275 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:11.630810  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.631515  2303 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.633837  1541 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:11.641093  1688 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:11.644821  2276 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:11.645756  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.648423  1687 raft_consensus.cc:1240] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:11.626252  5389 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:11.656503  1684 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:11.657752  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:11.658385  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 166766us
I20260709 13:00:11.658613  1690 raft_consensus.cc:2368] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:11.657760  1689 raft_consensus.cc:2393] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:11.660074  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 118753us
I20260709 13:00:11.661062  1686 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:00:11.640415  5569 raft_consensus.cc:2804] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:11.639698  5686 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:11.509472  5789 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:00:11.672184  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.673265  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:11.662459  5775 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.003s
I20260709 13:00:11.674352  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.674932  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.671604  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.653370  5510 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:11.630391  5509 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.679117  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.682569  1685 raft_consensus.cc:2368] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12.
I20260709 13:00:11.676054  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:11.678467  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.665634  5519 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:11.689913  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.573907  5781 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.678093  5569 raft_consensus.cc:697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.656818  5520 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:11.651247  5757 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:11.698958  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.579356  5788 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.700256  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.705035  2310 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:11.701257  1685 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:11.701182  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.657135  5787 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.714504  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:11.753968  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 63623.5us
I20260709 13:00:11.755048  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.755935  1683 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:11.758412  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.762280  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.767508  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.772667  5790 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:11.776522  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:11.779853  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.780854  1684 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13.
I20260709 13:00:11.781980  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.782824  1684 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:11.783136  5686 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.784044  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.783564  1437 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 2 to 5, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:11.784686  1684 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.785872  1437 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 4 to 7, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 7 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:11.790566  2301 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:11.791215  5788 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:11.682849  5775 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.798945  1684 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:11.799998  2303 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:11.823557  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.883791  2301 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:11.824373  5519 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:11.828722  5569 consensus_queue.cc:237] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:11.832384  5637 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:11.800582  5748 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.833410  5690 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:11.837397  5509 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:11.838150  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.911211  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.911816  1685 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:11.838948  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.850062  1507 leader_election.cc:400] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11.
I20260709 13:00:11.912389  1507 leader_election.cc:403] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:11.705467  5680 raft_consensus.cc:3055] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:11.857313  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.859302  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.863914  1540 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:11.865453  1682 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:11.886147  1532 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:11.898007  1688 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:11.831233  1437 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 6 to 7, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.910795  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.916283  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:11.796716  5447 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:11.918525  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 244625us
I20260709 13:00:11.945592  1653 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:11.961822  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.965417  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:11.970685  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 121336us
I20260709 13:00:11.913985  5680 raft_consensus.cc:740] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:11.979805  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:11.980705  2309 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.975380  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.984113  1685 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:11.975732  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.989292  1682 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:11.992414  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:11.992791  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.996373  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.912958  5748 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:11.997262  1683 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:11.947885  5807 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11.
I20260709 13:00:12.007086  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.019632  1682 raft_consensus.cc:2376] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10. Re-sending same reply.
W20260709 13:00:12.007104  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 184861us
W20260709 13:00:12.008438  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67176.1us
I20260709 13:00:12.013773  2303 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:12.016316  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:12.007416  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:11.974962  5637 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:12.035633  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.036517  1687 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.021982  5748 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:12.024768  5680 consensus_queue.cc:260] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.027825  1581 leader_election.cc:400] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:12.028409  2301 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:12.016808  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:12.028574  1684 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:12.029709  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:12.008044  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 69599us
I20260709 13:00:12.062932  1685 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
W20260709 13:00:12.038344  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.996204  5662 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:00:12.050909  5775 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:12.053094  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.053263  5447 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:11.979277  5520 consensus_queue.cc:1059] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:00:12.053835  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.079501  1688 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
W20260709 13:00:12.054351  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 82632.8us
W20260709 13:00:12.057565  5731 consensus_meta.cc:287] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:00:11.992138  1437 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 8 to 2, term changed from 10 to 7, leader changed from <none> to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from VOTER to NON_VOTER. New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.058887  5758 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.060108  5787 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.089751  1683 raft_consensus.cc:2410] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:00:11.986541  5757 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:00:11.991127  5722 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:00:12.077103  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:12.084020  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.100540  1682 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.088393  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.099906  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:12.101122  1685 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:12.091111  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.102878  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.096544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.098133  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.104470  1683 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.077980  5748 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:12.106981  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:12.089748  5524 consensus_meta.cc:287] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:00:12.109223  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:12.113601  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50304.2us
I20260709 13:00:12.114640  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.115617  1685 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:12.117200  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:12.117774  1534 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:12.060853  5637 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.129698  2309 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:12.131150  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:12.125102  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 179641us
I20260709 13:00:12.117831  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:12.133419  1541 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:12.137342  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.138458  1687 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 13:00:12.168686  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:12.169521  1538 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:12.170006  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.170676  1614 raft_consensus.cc:3060] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:12.172859  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.173815  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.174441  1687 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:12.112412  5809 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.177794  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.090219  5731 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:12.180861  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73992.4us
W20260709 13:00:12.183065  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 60540.9us
I20260709 13:00:12.177768  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.178380  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.188133  1581 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:12.189306  1684 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:12.121636  5748 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:12.186244  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:12.192358  1540 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:12.199433  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.200328  1688 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:12.197369  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.168722  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.184536  1682 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:12.193140  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:12.196113  1504 leader_election.cc:336] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.580s (SENT)
I20260709 13:00:12.182222  5263 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:12.217746  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.239377  1615 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:12.218773  1533 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:12.218703  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:12.219391  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.222545  1683 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:12.121390  5524 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.178629  5676 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:00:12.202919  5690 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:12.227632  1609 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:12.230001  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.230062  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.249444  1611 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:12.235270  1685 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:12.236526  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.237509  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.232048  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.242542  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.250835  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.194694  1582 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:12.251607  1682 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:12.244529  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.251616  1684 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:12.246168  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.170185  5810 consensus_queue.cc:1059] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:00:12.260525  1690 raft_consensus.cc:2393] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:12.252390  1683 raft_consensus.cc:1813] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Handling vote request from an unknown peer 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:12.253387  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.263532  1683 raft_consensus.cc:2410] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:12.197352  5757 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:00:12.264655  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 229860us
W20260709 13:00:12.270263  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.016s
W20260709 13:00:12.272583  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.017s
I20260709 13:00:12.270605  2309 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.271308  1616 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:12.191627  5809 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:12.273705  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 85314.2us
I20260709 13:00:12.275723  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.279928  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.281296  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.281942  1682 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:12.282423  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 46026.5us
I20260709 13:00:12.269536  5817 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:12.289283  5645 consensus_meta.cc:287] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
W20260709 13:00:12.289850  5816 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:00:12.292057  1686 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:00:12.293197  1686 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.294382  1686 raft_consensus.cc:1240] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:12.295586  1686 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:12.296463  5789 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:12.296618  1686 raft_consensus.cc:1240] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:12.300565  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.301306  1690 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13.
I20260709 13:00:12.302556  1690 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:00:12.302682  5815 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:12.289805  5645 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:12.313210  1684 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:12.318138  1689 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:12.314073   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.319821  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:12.320617  1532 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:12.324863  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:12.330143  1614 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:12.304162  5263 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:12.277415  5690 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:12.335527  1437 catalog_manager.cc:5697] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 4 to 5, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.351815  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.355650  1683 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:12.364924  1535 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:12.372969  1532 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
W20260709 13:00:12.382110  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.350800  5758 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:12.401804  1532 raft_consensus.cc:1240] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:12.402834  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.374327  5263 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:12.433950  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.334290  5748 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.440523  5263 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.446233  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:12.455195  1532 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:00:12.453428  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:12.462694  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.464705  2301 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:12.466197  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:12.467043  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:12.467975  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.468686  1613 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:12.470960  2310 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:12.444705  5731 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:12.474187  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.472376  1687 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:12.472836  1611 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:12.468976  1613 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:12.473562  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:12.464378  5813 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.330s	user 0.000s	sys 0.012s
I20260709 13:00:12.483727  1612 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:12.461259  5676 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.447186  5790 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:00:12.487836  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:12.489679  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.456581  5758 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:00:12.490381  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.483974  5520 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.489152  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:12.500948  1611 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:12.499897  1534 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:12.506311  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.516690  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.517602  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.518210  1611 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:12.515359  5820 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:00:12.493755  5524 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:12.525082  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.462481  5690 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.507947  5509 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:12.532830  1608 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:12.522809  5789 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.488869  5676 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.538630  1541 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:12.522766  5809 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.508283  5569 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:12.508623  5520 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.538650  5789 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:12.547556  5822 log.cc:927] Time spent T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:00:12.552100  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.538288  5787 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:12.560423  1615 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:12.562799  1614 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:12.569618  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:12.574554  1607 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:12.576875  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 65926.1us
I20260709 13:00:12.579658  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:12.553161  5788 raft_consensus.cc:2764] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:12.583020  1615 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:12.586844  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 62893.8us
I20260709 13:00:12.579017  5524 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:12.591725  5524 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.595521  5524 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.598281  2276 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:12.600981  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.603456  5676 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.604171  5569 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:12.605010  5788 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:12.605372  5788 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:12.606927  5788 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.607934  5520 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.604259  5790 raft_consensus.cc:2804] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:12.609468  5790 raft_consensus.cc:697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:12.610466  5790 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.608170  5788 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.615499  1615 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:12.617250  1507 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:12.627827  1541 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:12.632066  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:12.632776  1541 raft_consensus.cc:2376] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10. Re-sending same reply.
I20260709 13:00:12.621517  5447 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:12.643218  1611 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:12.644819  1507 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:12.649032  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.657698  1686 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.665263  1683 raft_consensus.cc:1240] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:12.666416  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.667040  1683 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:12.667871  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.672276  1683 raft_consensus.cc:2410] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:12.673508  1615 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.674230  1686 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:12.675879  1687 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:00:12.677155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.678113  1688 raft_consensus.cc:2368] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:12.620955  5787 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:00:12.683322  1685 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:12.689355  1682 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.713878  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:12.711419  5839 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:00:12.694006  5841 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:12.717556  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 72826.2us
I20260709 13:00:12.721940  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:12.723176  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.728804  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.729691  1689 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:12.715848  5789 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.739289  5789 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:12.739833  5789 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:12.740317  5835 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:00:12.743276  5524 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.745195  5569 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:12.746138  5849 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:12.746629  5849 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:12.747455  5849 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.748799  5789 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.751489  5849 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:12.753031  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.762231  5803 raft_consensus.cc:3055] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:12.762838  5803 raft_consensus.cc:740] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:12.763895  5803 consensus_queue.cc:260] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.766660  1607 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:12.768100  2276 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.769747  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:12.771095  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.771224  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.772289  5569 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:12.773471  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.774063  1690 raft_consensus.cc:2376] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11. Re-sending same reply.
I20260709 13:00:12.771929  5803 raft_consensus.cc:3060] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:12.780025  5569 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:12.783107  5524 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.788851  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.789569  1684 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.797407  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:12.796370  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:12.798153  1690 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:12.798990  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.800148  1690 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:12.800845  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:12.773066  5509 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:12.804653  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:12.806218  1689 raft_consensus.cc:2376] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6. Re-sending same reply.
I20260709 13:00:12.798607  5849 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.816681  5849 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.818892  5849 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:12.825081  1690 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:12.825399  1534 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:12.828145  1534 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:12.830400  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:12.804513  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:12.802367  5847 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:12.832762  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:12.833595  1534 raft_consensus.cc:2410] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:00:12.832968  5847 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.845094  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:12.857086  1684 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:12.874136  5818 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.874768  5818 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.876825  5524 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:12.898770  5524 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:12.859316  5841 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:12.968151  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 163754us
I20260709 13:00:12.903986  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:12.973901  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2076) took 1056 ms. Trace:
I20260709 13:00:12.974344  1682 rpcz_store.cc:276] 0709 13:00:11.917640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.306007 (+388367us) service_pool.cc:224] Handling call
0709 13:00:12.323935 (+ 17928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.689823 (+365888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.973651 (+283828us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540035b954. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:12.973835 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840014080}
I20260709 13:00:12.975747  5680 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:12.976329  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 82245.2us
I20260709 13:00:12.990953  1613 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:12.992632  1613 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:12.992939  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.049062  5787 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:13.049860  5787 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.052201  5849 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:13.053063  5849 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.054759  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:13.055591  2301 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:13.056274  5849 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.057217  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:13.058529  5787 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.059269  5787 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:13.059719  5787 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:13.060127  5787 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:13.048956  5524 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:13.065018  5524 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:12.969197  5841 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.086778  5787 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.103714  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:13.110574  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 567) took 1016 ms. Trace:
I20260709 13:00:13.111189  1609 rpcz_store.cc:276] 0709 13:00:12.094665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.094799 (+   134us) service_pool.cc:224] Handling call
0709 13:00:13.110389 (+1015590us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003f4654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:13.110514 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289910016}
W20260709 13:00:13.113045  1506 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.711s (SENT)
I20260709 13:00:13.115430  1613 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:13.123395  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.124504  1534 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:13.126387  2301 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
W20260709 13:00:13.117622  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.127779  1504 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:13.128648  1506 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.786s (SENT)
I20260709 13:00:12.976464  5856 consensus_queue.cc:1059] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:00:12.898833  5748 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.899051  5775 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:13.125447  5787 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.165441  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.126524  5305 raft_consensus.cc:3055] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:13.174594  5305 raft_consensus.cc:740] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:13.176723  5788 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.002s
I20260709 13:00:13.175489  5305 consensus_queue.cc:260] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.163061  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.171065  5509 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.171674  5680 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.178418  5509 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.178593  5680 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.180742  5509 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.181711  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:13.182426  1538 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:13.182507  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.183158  1535 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:13.184441  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.184649  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.185920  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.186759  1539 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:13.180967  5680 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.177805  5305 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:13.189625  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.191051  1536 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:13.196058  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.191967  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.197063  1537 raft_consensus.cc:2368] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:13.197155  1538 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:13.198531  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.199091  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.199214  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:13.199796  1535 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:13.150942  5853 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:13.201689  5818 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:13.204085  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.204114  2301 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:13.202319  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.206312  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.208578  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:13.211172  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.211958  1427 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.308s	user 0.004s	sys 0.013s
I20260709 13:00:13.164844  5748 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.215545  5748 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.200217  5787 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:13.168641  5775 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.218600  5818 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:13.218983  5775 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.200513  5856 consensus_queue.cc:1243] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:13.222028  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:13.223867  2310 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:13.241081  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.242242  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.240823  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:13.244658  5787 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:13.245074  5851 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.245537  5787 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:13.246124  5787 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.249338  1532 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:13.250218  5787 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.252583  5847 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.241288  5853 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:13.254731  5853 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.240412  5852 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.256678  5852 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.257858  1541 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:13.259001  5852 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.245574  5851 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:13.260761  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 62306.8us
I20260709 13:00:13.261842  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.263422  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.276154  5787 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:13.285979  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.280736  5852 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:13.288033  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.288156  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:13.293329  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 568) took 1184 ms. Trace:
I20260709 13:00:13.293797  1610 rpcz_store.cc:276] 0709 13:00:12.109275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.109399 (+   124us) service_pool.cc:224] Handling call
0709 13:00:12.125232 (+ 15833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.139447 (+ 14215us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:12.407453 (+268006us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.486137 (+ 78684us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.552793 (+ 66656us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180046ab60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:13.292460 (+739667us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180046ab60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 13:00:13.292829 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.292989 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.293028 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:13.293079 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.293153 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.293273 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43934,"prepare.queue_time_us":303156,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":12491,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5806,"spinlock_wait_cycles":56185984,"thread_start_us":220148,"threads_started":2,"wal-append.queue_time_us":104017}
I20260709 13:00:13.297518  5851 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.301381  5787 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:13.303421  5787 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:13.305563  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 110923us
I20260709 13:00:13.308472  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:13.311305  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.313200  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.318782  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.319432  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:13.320362  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:13.320341  2310 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:13.321265  5782 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:13.321684  5782 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.322189  5782 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:13.326560  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.305537  5787 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.327183  5834 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.333199  5834 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.336598  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.337432  1537 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:13.325784  5866 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:13.340911  5866 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.343807  5866 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:13.352357  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 710732us
I20260709 13:00:13.349531  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:13.317174  5818 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:13.325446  5828 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.801s	user 0.043s	sys 0.012s
I20260709 13:00:13.325584  5775 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:13.335976  5834 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.365433  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.388657  2310 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:00:13.375852  1656 connection.cc:256] RPC call timeout handler was delayed by -2.9142204689999289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:00:13.390817  1656 connection.cc:256] RPC call timeout handler was delayed by -2.79272046899996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 13:00:13.390863  1507 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:13.391458  1656 connection.cc:256] RPC call timeout handler was delayed by -2.7018204689999266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:00:13.391567  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:13.391992  1656 connection.cc:256] RPC call timeout handler was delayed by -2.6622204689999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 13:00:13.392405  1656 connection.cc:256] RPC call timeout handler was delayed by -2.5416204689999518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:00:13.392797  1656 connection.cc:256] RPC call timeout handler was delayed by -2.53442046899994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 13:00:13.393175  1656 connection.cc:256] RPC call timeout handler was delayed by -2.4957204689999344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 13:00:13.393536  1656 connection.cc:256] RPC call timeout handler was delayed by -1.8081204689999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30000000000000004s for a response
I20260709 13:00:13.394531  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:13.397420  5680 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:13.398222  5680 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:13.390192  2310 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:13.406566  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.407431  1536 raft_consensus.cc:2393] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:13.408674  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:13.409873  5305 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.410431  5305 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.411319  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:13.378863  5748 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.412245  5748 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.412365  2310 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.413475  2310 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:13.414412  5748 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:13.375209  5847 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:13.418349  5520 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:13.418536  5847 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.332370  5833 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.382354  5818 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.419689  5833 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.421372  5818 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:13.421749  5833 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.412611  5305 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:13.416100  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51531.5us
I20260709 13:00:13.418030  1684 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:13.418983  5520 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:13.424975  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:13.418404  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.434651  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.434981  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.435302  1610 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:13.436479  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.437116  1613 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:13.439301  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.440245  1614 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 15: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:13.441156  1683 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:13.406847  5853 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:13.419052  5847 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:13.439107  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.448338  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.452816  1609 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 15: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:13.399605  5680 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.388327  5775 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.454746  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.432571  5852 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:13.458837  5852 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:13.458750  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.459897  5852 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.437153  5849 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:13.464888  1610 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:13.436811  5851 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:13.465335  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:13.470888  1690 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:13.465318  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.444661  5748 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:13.474071  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:13.475545  5827 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.960s	user 0.001s	sys 0.014s
I20260709 13:00:13.446491  5853 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:13.456830  5524 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:13.482509  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:13.484656  1690 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
W20260709 13:00:13.489506  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.489506  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 55146.6us
W20260709 13:00:13.493248  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 60205us
I20260709 13:00:13.494426  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:13.498943  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49008.1us
I20260709 13:00:13.328915  1427 maintenance_manager.cc:643] P a34435529147466db8abc42dc6329534: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.182s	user 0.185s	sys 0.090s Metrics: {"bytes_written":29472,"cfile_init":1,"dirs.queue_time_us":511809,"dirs.run_cpu_time_us":602,"dirs.run_wall_time_us":33897,"drs_written":1,"lbm_read_time_us":400,"lbm_reads_lt_1ms":4,"lbm_write_time_us":215697,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"raft.queue_time_us":110003,"raft.run_cpu_time_us":9451,"raft.run_wall_time_us":72939,"rows_written":63,"spinlock_wait_cycles":11121536,"thread_start_us":477574,"threads_started":3,"wal-append.queue_time_us":299351}
I20260709 13:00:13.479580  5849 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:13.481585  5853 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:13.468761  5787 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:13.509037  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 569) took 1392 ms (client timeout 1692 ms). Trace:
I20260709 13:00:13.477664  5643 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:00:13.509545  1608 rpcz_store.cc:269] 0709 13:00:12.116527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.125696 (+  9169us) service_pool.cc:224] Handling call
0709 13:00:13.508857 (+1383161us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002887d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:13.508976 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351396736}
I20260709 13:00:13.510921  5788 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:13.511477  5873 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:00:13.512049  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.516261  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1840) took 1033 ms. Trace:
I20260709 13:00:13.514714  1428 maintenance_manager.cc:419] P a34435529147466db8abc42dc6329534: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8494 bytes on disk
I20260709 13:00:13.512754  5509 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:13.515765  1690 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:13.517146  2275 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:13.528617  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.529510  1609 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:00:13.512749  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47533.9us
I20260709 13:00:13.530946  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.486655  5872 consensus_queue.cc:1059] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:00:13.533025  5748 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:13.533360  5872 raft_consensus.cc:3055] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:13.533748  5872 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:13.533017  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:13.534647  5748 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:13.535267  5748 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:13.536497  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1839) took 1067 ms. Trace:
I20260709 13:00:13.537145  5662 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:13.537386  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.523120  1539 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:13.538707  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.503880  5851 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:13.507390  5859 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:13.532807  5833 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:13.536150  5748 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.524430  5775 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:13.518632  1616 rpcz_store.cc:276] 0709 13:00:12.485237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.500892 (+ 15655us) service_pool.cc:224] Handling call
0709 13:00:12.513818 (+ 12926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.345979 (+832161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.346022 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.346766 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 13:00:13.487345 (+140579us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:13.487418 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.487524 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.516017 (+ 28493us) raft_consensus.cc:1685] finished
0709 13:00:13.516037 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.516172 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939643,"raft.queue_time_us":831704,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":879,"thread_start_us":140071,"threads_started":1,"wal-append.queue_time_us":163879}
I20260709 13:00:13.541071  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.545264  5509 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:13.545883  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.558189  1609 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:13.549513  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:13.558825  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49278.8us
I20260709 13:00:13.536893  1612 rpcz_store.cc:276] 0709 13:00:12.468658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.486927 (+ 18269us) service_pool.cc:224] Handling call
0709 13:00:12.492751 (+  5824us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.299921 (+807170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.299952 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.303281 (+  3329us) log.cc:844] Serialized 52 byte log entry
0709 13:00:13.325874 (+ 22593us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:13.351818 (+ 25944us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.480489 (+128671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.480590 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.536283 (+ 55693us) raft_consensus.cc:1685] finished
0709 13:00:13.536303 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.536441 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":963851,"prepare.queue_time_us":26097,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":980797,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":15667,"thread_start_us":22177,"threads_started":1,"wal-append.queue_time_us":76576}
I20260709 13:00:13.560266  5509 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.560397  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.560722  5509 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:13.561162  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.568485  5775 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:13.548728  5851 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:13.569829  5851 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.571316  5841 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:13.571764  5841 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:13.552904  5818 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:13.572630  5841 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.573314  5818 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:13.573930  5841 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.574590  5818 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.571754  1608 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:13.577755  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:13.580695  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.581377  5643 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:13.581885  5643 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.582233  5643 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.582906  5874 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:13.561173  1607 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:13.580019  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:13.596552  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.606608  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.608192  1427 maintenance_manager.cc:643] P a34435529147466db8abc42dc6329534: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.068s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":453,"lbm_reads_lt_1ms":4}
I20260709 13:00:13.612071  1581 leader_election.cc:400] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:13.612664  1581 leader_election.cc:403] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:00:13.616628  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57105.1us
I20260709 13:00:13.618904  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.504006  5520 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.622326  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:13.623726  5823 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:13.632558  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.633227  5690 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.641351  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:13.634609  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 158666us
W20260709 13:00:13.643435  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 113295us
I20260709 13:00:13.646792  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.650132  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.652187  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.657436  1507 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:13.619031  5305 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:13.669703  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.674609  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.653345  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.682055  1540 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:13.678673  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:13.669566  5869 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:13.695236  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.690093  1533 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:00:13.691278  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.691671  1539 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:13.692212  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.694208  1614 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:13.655308  5852 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:13.697788  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:13.731451  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.534696  5872 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.696976  1507 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:13.654640  5676 raft_consensus.cc:2764] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:13.645299  5874 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:00:13.738451  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.739754  1534 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:13.745007  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.746297  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.654774  5683 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:00:13.651849  5840 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:00:13.751003  1612 raft_consensus.cc:2393] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:13.751502  1507 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.755738  1615 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:13.729475  5803 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.759191  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 82522.3us
I20260709 13:00:13.757823  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.758453  1607 raft_consensus.cc:2368] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:13.759595  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:13.760439  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.743996  5524 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:13.739755  5651 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:13.742332  5787 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:13.690109  5810 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:00:13.671226  5849 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.743922  5722 consensus_queue.cc:1059] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:00:13.749511  5884 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:13.787344  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.783434  5852 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:13.802621  1612 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:13.763202  5832 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.804574  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.762151  5305 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:13.808346  5509 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.788371  5524 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:13.824275  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:13.825416  5811 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.825233  5524 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.825973  5811 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.773869  5803 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.790961  5651 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.802309  5884 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.836635  1541 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:13.847046  1506 leader_election.cc:400] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13.
I20260709 13:00:13.850385  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:13.853893  1612 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:13.862219  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 106154us
W20260709 13:00:13.865042  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 115702us
W20260709 13:00:13.867957  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 329319us
W20260709 13:00:13.869485  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57637.5us
I20260709 13:00:13.828263  5803 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:13.828171  5811 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:13.867139  5879 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:00:13.844614  5884 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:13.853149  5810 consensus_queue.cc:1243] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:13.925647  1612 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:13.823892  5852 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 13:00:13.934895  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64683.7us
W20260709 13:00:13.932890  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.931412  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:13.952800  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:13.953442  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:13.873198  5775 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:00:13.814477  5832 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:13.934494  5757 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:13.972695  5902 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.973291  5902 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:13.974912  5758 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:13.975361  5758 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:13.975526  5902 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:14.024847  5886 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:00:13.966341  5859 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:13.965031  5757 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:14.039289  1614 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:14.027992  5904 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:00:14.043833  5885 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:00:14.046116  5853 consensus_meta.cc:287] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:00:14.046612  5853 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:13.979951  5758 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:14.047976  5758 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:14.051663  5883 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:00:14.037009  5680 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.957998  5305 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:14.035843  5847 consensus_meta.cc:287] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:00:14.104524  5847 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.036597  5859 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:14.073952  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 119278us
I20260709 13:00:14.075487  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:14.086254  5731 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.095742  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:14.057078  5841 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.067898  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:14.060640  5782 consensus_meta.cc:287] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.001s
I20260709 13:00:14.130164  1614 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:14.124560  1681 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
W20260709 13:00:14.136819  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 184139us
I20260709 13:00:14.143244  2275 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:14.128448  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 175079us
I20260709 13:00:14.164991  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:14.138123  5782 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:14.146816  5892 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:00:14.150226  5853 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:14.153378  5907 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:00:14.158504  5866 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:14.158185  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:14.128762  5859 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:14.179870  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.102957  5680 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.202641  5823 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.203305  5823 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.205082  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:14.205729  1688 raft_consensus.cc:3060] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:14.161712  5509 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.127133  5903 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:00:14.207363  5643 consensus_meta.cc:287] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.006s
I20260709 13:00:14.134047  5731 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.229491  1609 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:14.233784  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:14.130775  5757 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.234508  2308 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:14.236057  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:14.235416  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:14.237264  2301 raft_consensus.cc:2410] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:00:14.238716  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.239858  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.241155  1532 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:14.238029  2304 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:14.241367  1506 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:14.243328  2307 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:14.213227  5853 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:14.244342  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.244531  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:14.245117  1533 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:14.249018  2305 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:14.250061  1579 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:14.219376  5905 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:14.257129  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56280 (request call id 902) took 1033 ms. Trace:
I20260709 13:00:14.237025  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:14.260265  1688 raft_consensus.cc:2468] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 15.
I20260709 13:00:14.285813  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.286582  1538 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:14.288897  2275 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:14.229981  5643 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:14.332254  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 53329.4us
W20260709 13:00:14.387097  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 154378us
I20260709 13:00:14.388044  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:14.251433  5686 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.264897  2303 rpcz_store.cc:276] 0709 13:00:13.223566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.238584 (+ 15018us) service_pool.cc:224] Handling call
0709 13:00:13.239047 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.240802 (+  1755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.240832 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.244239 (+  3407us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.067062 (+822823us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b1800346360. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:14.226833 (+159771us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:14.226976 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.227055 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.256159 (+ 29104us) raft_consensus.cc:1685] finished
0709 13:00:14.256274 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.256981 (+   707us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1257,"raft.queue_time_us":2174,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5647,"spinlock_wait_cycles":10857856,"thread_start_us":159137,"threads_started":1,"wal-append.queue_time_us":1009960}
W20260709 13:00:14.318226  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 116692us
I20260709 13:00:14.392004  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:14.387981  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:14.289675  5722 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:14.252090  5853 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:14.399986  5853 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.400753  5853 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:14.259493  5803 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:14.261171  5916 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.261952  5905 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.285066  5810 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:14.336936  5866 raft_consensus.cc:2804] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:14.430435  1610 raft_consensus.cc:2368] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9.
I20260709 13:00:14.437613  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:14.313616  5832 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.415956  5803 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.439221  5810 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.479382  5810 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:14.480103  5894 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:00:14.482561  5914 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:00:14.483918  5823 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:14.438971  5905 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.484328  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:14.435982  5903 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:14.504595  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 116637us
I20260709 13:00:14.445719  5722 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:14.470093  5892 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:14.527606  1616 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:14.464461  5847 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:14.414594  5686 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.487262  5803 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:14.582013  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.485862  5866 raft_consensus.cc:697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 13:00:14.583211  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 457861us
I20260709 13:00:14.514971  5722 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:14.600262  5930 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:00:14.507431  5834 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
W20260709 13:00:14.602646  5896 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:00:14.602989  5569 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:14.603312  5843 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.603487  5569 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:14.603896  5843 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.604523  5569 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.605683  5569 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:14.606204  5843 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:14.606315  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:14.515177  5832 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:00:14.608556  5686 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:14.546484  5731 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:14.611100  5884 consensus_meta.cc:287] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.000s
I20260709 13:00:14.614262  5830 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.549436  5782 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.644707  5782 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.644397  5830 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.645372  5782 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.646942  5830 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:14.618238  5851 consensus_meta.cc:287] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.048s	user 0.013s	sys 0.000s
I20260709 13:00:14.648561  5851 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:14.651135  5851 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.619349  5859 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:14.544929  5653 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:14.652242  5653 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.652452  1689 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:14.652631  5653 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:14.653818  5859 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:14.648008  5782 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.445127  5916 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.655891  5884 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:14.658262  5916 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:14.661334  5884 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:14.675575  1683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.028s	sys 0.025s
W20260709 13:00:14.686673  1683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.028s	sys 0.025s
I20260709 13:00:14.687628  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 655) took 1039 ms. Trace:
I20260709 13:00:14.622157  5722 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.687971  1683 rpcz_store.cc:276] 0709 13:00:13.648603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.649146 (+   543us) service_pool.cc:224] Handling call
0709 13:00:13.673171 (+ 24025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.695740 (+ 22569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.695787 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.732609 (+ 36822us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.843790 (+111181us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:14.063402 (+219612us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.687324 (+623922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.687401 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.687441 (+    40us) raft_consensus.cc:1685] finished
0709 13:00:14.687451 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.687570 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":205846,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":11604,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7791,"thread_start_us":876916,"threads_started":3,"wal-append.queue_time_us":169103}
I20260709 13:00:14.698377  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:14.699777  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:14.700256  1506 leader_election.cc:336] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.530s (SENT)
W20260709 13:00:14.700242  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 262742us
I20260709 13:00:14.700898  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:14.666496  5680 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.705142  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:14.705789  1684 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:14.679896  5731 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.712651  1506 leader_election.cc:336] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.794s (SENT)
I20260709 13:00:14.713349  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:14.724634  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:14.725394  1611 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:14.725803  5927 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:00:14.732659  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.741461  5918 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:14.734581  5847 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.745288  5643 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.724789  1690 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:14.710227  5916 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.680615  5810 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.708001  5832 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:00:14.788002  1683 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:14.745847  5866 consensus_queue.cc:237] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.728561  5731 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:14.824048  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 113419us
I20260709 13:00:14.827994  1684 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:14.829450  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:14.833361  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 120763us
I20260709 13:00:14.840919  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.841645  1534 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:14.814112  5775 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:14.836660  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 252406us
I20260709 13:00:14.850667  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:14.853046  1532 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:14.845256  1611 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:14.819432  5637 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.861374  1535 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:14.867285  1611 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:14.866030  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:14.869958  1615 raft_consensus.cc:2376] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10. Re-sending same reply.
I20260709 13:00:14.873311  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:14.875902  1534 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 15: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:14.784279  5916 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:14.842984  5818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.012s	sys 0.006s
I20260709 13:00:14.891394  1534 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:14.895442  1536 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:14.901218  1615 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:00:14.902522  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66973.7us
I20260709 13:00:14.829280  5803 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:14.896725  5818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.014s	sys 0.007s
W20260709 13:00:14.900239  5690 consensus_meta.cc:287] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 1.251s	user 0.013s	sys 0.000s
I20260709 13:00:14.855657  5653 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:14.908437  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:14.921429  1611 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:14.907851  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2098) took 1228 ms. Trace:
W20260709 13:00:14.909708  1506 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.205s (SENT)
I20260709 13:00:14.914748  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.926957  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:14.927584  1536 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:14.906484  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:14.917647  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 525736us
I20260709 13:00:14.915638  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:14.930898  1532 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:14.907109  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:14.910486  5853 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.932049  1656 leader_election.cc:400] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:14.880080  5637 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.918838  5690 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10.
I20260709 13:00:14.903831  5775 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:14.926582  1534 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:14.935187  1656 leader_election.cc:403] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:14.932035  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:14.923835  1686 rpcz_store.cc:276] 0709 13:00:13.679220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.683325 (+  4105us) service_pool.cc:224] Handling call
0709 13:00:13.683634 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.684598 (+   964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.684626 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.743844 (+ 59218us) log.cc:844] Serialized 52 byte log entry
0709 13:00:13.930745 (+186901us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.225860 (+295115us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.904340 (+678480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.904418 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.904470 (+    52us) raft_consensus.cc:1685] finished
0709 13:00:14.904490 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.907772 (+  3282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":570935,"prepare.queue_time_us":119159,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":33,"raft.queue_time_us":6557,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":34724,"thread_start_us":521491,"threads_started":3,"wal-append.queue_time_us":502579}
I20260709 13:00:14.936213  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:14.949602  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2104) took 1078 ms. Trace:
I20260709 13:00:14.943993  1582 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:14.952178  1611 raft_consensus.cc:2410] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:14.952316  1612 raft_consensus.cc:1275] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:14.955107  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:14.955808  2304 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:14.950047  1682 rpcz_store.cc:276] 0709 13:00:13.870936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.258555 (+387619us) service_pool.cc:224] Handling call
0709 13:00:14.258806 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.258987 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:14.259242 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.949132 (+689890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.949207 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.949267 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.949376 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.949531 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380363,"prepare.queue_time_us":201,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"thread_start_us":309083,"threads_started":2,"wal-append.queue_time_us":583021}
W20260709 13:00:14.958997  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49359.5us
I20260709 13:00:14.934140  5832 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.940409  5917 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:14.964363  5653 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.961333  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:14.961645  5946 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:14.961790  5942 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.962114  5905 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.962481  5947 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:14.962663  5305 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:14.962899  5919 raft_consensus.cc:2764] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:00:14.962991  5944 consensus_queue.cc:1059] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:14.965869  2310 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:00:14.960409  1506 leader_election.cc:336] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.216s (SENT)
I20260709 13:00:14.970396  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:14.999266  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:14.999965  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:15.000516  1506 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.853s (SENT)
I20260709 13:00:15.001071  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.001650  5782 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:15.002230  5782 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:15.002406  1506 leader_election.cc:336] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.648s (SENT)
I20260709 13:00:15.002715  5782 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.003391  5946 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:14.959828  5928 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:00:14.991074  5922 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:00:15.008380  5934 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:00:14.960954  5690 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:15.008888  5905 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.009028  5690 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.009451  5690 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.011938  5872 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:15.013054  5953 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:00:14.937120  5853 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.000195  5852 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.961017  5843 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:15.026111  5853 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:15.026806  5950 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:15.028609  5686 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:15.029054  5686 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:15.029326  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.029938  5686 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:15.030586  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.031222  1614 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:15.031342  5916 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:15.006661  5945 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:00:15.032261  5803 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.032757  5637 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:14.996364  5942 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:14.996942  5947 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.033530  5947 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.035367  5942 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:14.986590  5832 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.036402  5731 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.038318  5832 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.039124  2309 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:14.981158  5917 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.040982  5917 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:15.041673  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2395) took 1435 ms (client timeout 1680 ms). Trace:
W20260709 13:00:15.042490  5758 consensus_meta.cc:287] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.994s	user 0.006s	sys 0.005s
I20260709 13:00:15.004449  5830 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:15.043135  5830 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.043536  5830 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.019179  5939 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:14.997320  5810 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.045701  1608 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.005223  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:15.029498  5757 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:15.042218  1610 rpcz_store.cc:269] 0709 13:00:13.606049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.606311 (+   262us) service_pool.cc:224] Handling call
0709 13:00:15.041411 (+1435100us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400321754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:15.041600 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891712896}
W20260709 13:00:15.053689  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 51314.5us
W20260709 13:00:15.060787  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 59701.4us
W20260709 13:00:15.061117  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 99376.2us
I20260709 13:00:15.063926  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:15.050997  5939 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:15.073944  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.074187  5939 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:15.075268  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.075562  5939 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.076967  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 660) took 1153 ms. Trace:
I20260709 13:00:15.078081  1610 raft_consensus.cc:1275] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:15.078470  1610 pending_rounds.cc:85] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 8
I20260709 13:00:15.078967  1610 pending_rounds.cc:107] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:15.077488  1688 rpcz_store.cc:276] 0709 13:00:13.923907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.265538 (+341631us) service_pool.cc:224] Handling call
0709 13:00:14.313321 (+ 47783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.945079 (+631758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.945222 (+   143us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.952839 (+  7617us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.992623 (+ 39784us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:14.992694 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.992789 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.076691 (+ 83902us) raft_consensus.cc:1685] finished
0709 13:00:15.076722 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.076888 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":524293,"thread_start_us":116400,"threads_started":2,"wal-append.queue_time_us":82928}
I20260709 13:00:15.079265  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:15.079807  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:15.080379  1540 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:15.079232  1610 raft_consensus.cc:2889] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:15.079936  1532 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.086190  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:15.065523  5524 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:15.091741  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.092912  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.098604  5918 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:00:15.105973  1536 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:15.112385  5893 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:15.062444  5722 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.127494  1540 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:15.144510  1532 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:15.145363  1615 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:15.147945  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 579) took 1232 ms. Trace:
I20260709 13:00:15.149677  1616 rpcz_store.cc:276] 0709 13:00:13.915942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.916293 (+   351us) service_pool.cc:224] Handling call
0709 13:00:13.951505 (+ 35212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.528248 (+576743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.147631 (+619383us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54001b1a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:15.147869 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324437376}
I20260709 13:00:15.127818  5947 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:15.165272  5890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.004s	sys 0.023s
W20260709 13:00:15.174707  5890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.345s	user 0.004s	sys 0.023s
I20260709 13:00:15.234637  5781 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.235224  5781 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.236937  5917 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.237448  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:15.238907  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.239041  5917 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:15.240645  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.237300  5781 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.242682  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.244925  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.245987  2310 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:15.249538  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2402) took 1563 ms. Trace:
I20260709 13:00:15.250159  1607 rpcz_store.cc:276] 0709 13:00:13.685630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.685790 (+   160us) service_pool.cc:224] Handling call
0709 13:00:15.249338 (+1563548us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54002b5554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:15.249479 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60226432}
I20260709 13:00:15.251366  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:00:15.251976  1532 raft_consensus.cc:606] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:15.252408  1532 raft_consensus.cc:614] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:15.249410  5917 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:15.249464  5929 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.263846  5917 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:15.263197  5929 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.275358  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2103) took 1425 ms. Trace:
I20260709 13:00:15.275686  1689 rpcz_store.cc:276] 0709 13:00:13.850139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.138275 (+288136us) service_pool.cc:224] Handling call
0709 13:00:14.139682 (+  1407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.652896 (+513214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.275187 (+622291us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540035c854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:15.275314 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178923392}
I20260709 13:00:15.274381  5830 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.282570  5748 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:15.283064  5748 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:15.283908  5748 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.284766  5917 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.285482  5748 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.289222  5830 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.293563  5929 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.281123  5690 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.296581  5690 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.297204  1614 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:15.293676  5651 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.304431  5929 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.270117  5782 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.303102  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2403) took 1609 ms. Trace:
I20260709 13:00:15.305114  5929 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.306074  1609 rpcz_store.cc:276] 0709 13:00:13.693705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.693855 (+   150us) service_pool.cc:224] Handling call
0709 13:00:13.735504 (+ 41649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.229951 (+494447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.302817 (+1072866us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001b6554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:15.303017 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126884096}
I20260709 13:00:15.306623  2303 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:15.329659  5929 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.331283  5782 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.338783  5782 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:15.339365  5782 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.342185  5782 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.347841  5509 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:15.349308  5970 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.282s	user 0.004s	sys 0.000s
I20260709 13:00:15.354207  5926 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.354875  5926 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.355274  5947 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.361608  5931 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.364295  5775 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:15.364883  5775 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:15.366020  5775 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.367609  5775 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.356467  5906 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:15.368724  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 436904us
I20260709 13:00:15.368837  5906 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:15.362242  5931 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.370486  5926 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.369349  5906 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.370873  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:15.371066  5926 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:15.371853  5926 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.375375  5748 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.371100  5931 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.375511  5964 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:15.375952  5748 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.376363  5964 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:15.377085  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.378134  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.378057  5748 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.378501  5964 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.379065  5964 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.379518  5964 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.380841  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2106) took 1343 ms. Trace:
I20260709 13:00:15.381210  1685 rpcz_store.cc:276] 0709 13:00:14.037611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.524497 (+486886us) service_pool.cc:224] Handling call
0709 13:00:14.538996 (+ 14499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.539238 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:14.582380 (+ 43142us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.286146 (+703766us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b180042f700. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:15.327591 (+ 41445us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b180042f700. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb23a 00007f8d58c55a2a
0709 13:00:15.380488 (+ 52897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.380560 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:15.380607 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.380679 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.380785 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45818,"prepare.queue_time_us":42959,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":12119552,"thread_start_us":6723,"threads_started":1,"wal-append.queue_time_us":752945}
I20260709 13:00:15.375447  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 657) took 1509 ms. Trace:
I20260709 13:00:15.383309  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.383673  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.384073  2305 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:15.385039  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.385357  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.385617  1689 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:15.385887  1682 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.386586  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.387135  1686 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:15.381563  5520 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:15.388974  5520 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.390527  5903 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:15.391072  5520 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.393476  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.394801  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.394646  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:15.395422  1540 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:15.395455  1533 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.382951  1681 rpcz_store.cc:276] 0709 13:00:13.866304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.142087 (+275783us) service_pool.cc:224] Handling call
0709 13:00:14.170689 (+ 28602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.170979 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:14.200020 (+ 29041us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.793904 (+593884us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b180009c400. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 13:00:15.145400 (+351496us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.375113 (+229713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.375171 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:15.375217 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.375284 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.375395 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231424,"prepare.queue_time_us":30828,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":4319,"raft.queue_time_us":1382844,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"spinlock_wait_cycles":22667520,"thread_start_us":349305,"threads_started":1}
I20260709 13:00:15.397679  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.398605  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.398788  5946 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:15.399158  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.399847  1537 raft_consensus.cc:2368] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:15.399770  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.400434  1536 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 13:00:15.400722  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.400894  5964 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.395406  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.402704  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 667) took 1209 ms. Trace:
I20260709 13:00:15.404673  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.403158  1687 rpcz_store.cc:276] 0709 13:00:14.193262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.791140 (+597878us) service_pool.cc:224] Handling call
0709 13:00:14.822974 (+ 31834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.823187 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:14.861202 (+ 38015us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.353007 (+491805us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b180044d400. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55b60a40 00007f8d55b5b4e4 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287 00007f8d58c66208
0709 13:00:15.402392 (+ 49385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.402439 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:15.402483 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.402545 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.402640 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52441,"prepare.queue_time_us":37867,"prepare.run_cpu_time_us":1704,"prepare.run_wall_time_us":14851,"raft.queue_time_us":500004,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":10718976,"thread_start_us":49130,"threads_started":1}
I20260709 13:00:15.410971  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 580) took 1454 ms. Trace:
I20260709 13:00:15.411404  1612 rpcz_store.cc:276] 0709 13:00:13.958908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.962639 (+  3731us) service_pool.cc:224] Handling call
0709 13:00:13.972464 (+  9825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.952890 (+980426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.410733 (+457843us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54003f4654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:15.410908 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238749568}
I20260709 13:00:15.412889  1533 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:15.418848  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:15.409124  5956 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:15.423496  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2272648929999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:00:15.429163  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1856) took 1755 ms. Trace:
I20260709 13:00:15.427718  5954 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:15.432551  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:15.432785  5954 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.433256  5954 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.433979  5865 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:15.427196  1682 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:15.434443  5865 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.435724  5865 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:15.429662  1608 rpcz_store.cc:276] 0709 13:00:13.673308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.673943 (+   635us) service_pool.cc:224] Handling call
0709 13:00:15.045469 (+1371526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.053227 (+  7758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.428945 (+375718us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400321750. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:15.429095 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3153761536}
I20260709 13:00:15.423857  5906 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:15.429525  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2218648930000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:00:15.440361  1656 connection.cc:256] RPC call timeout handler was delayed by -1.2047648930000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:00:15.440714  1656 connection.cc:256] RPC call timeout handler was delayed by -1.1156648930000301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:00:15.441049  1656 connection.cc:256] RPC call timeout handler was delayed by -1.1003648930000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:00:15.428045  5956 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:15.441339  1656 connection.cc:256] RPC call timeout handler was delayed by -1.0940648929999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:00:15.442461  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.442986  5956 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:15.423784  5926 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.444095  5926 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.446367  5926 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.447474  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.449956  5906 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.450894  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:15.452479  5946 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.452916  5946 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.453250  5748 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.455052  5722 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.455041  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.440485  2275 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:15.425594  5686 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.472820  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.475113  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.477847  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.483062  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:15.483999  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.484982  1608 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:15.489352  1687 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:00:15.489800  1687 pending_rounds.cc:85] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 13:00:15.490056  1687 pending_rounds.cc:107] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:00:15.490286  1687 raft_consensus.cc:2889] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:15.489579  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:15.497418  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.498178  1685 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:15.498540  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:15.502871  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.506124  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:15.503908  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:15.510038  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.510835  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:15.511183  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.511579  2309 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.512727  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.508960  1687 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:15.516835  1612 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:15.516357  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.467327  5775 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.520264  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:15.520393  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.524443  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.521160  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.525879  1682 raft_consensus.cc:2393] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:15.526507  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.517314  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.524391  1538 raft_consensus.cc:2368] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12.
I20260709 13:00:15.515208  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.525758  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.528723  2301 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:15.528050  1608 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:15.514858  1507 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:15.531596  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:15.531808  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.480931  5520 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.481030  5906 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.532302  1537 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.535583  1533 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:15.521160  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.533324  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:15.536482  1613 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:15.532320  1684 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.522549  5956 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.498886  5964 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.509577  5644 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:15.552765  5891 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:15.553113  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.553960  1613 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:15.555126  5787 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:15.546836  2305 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:15.548381  5982 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.562708  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.559248  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.513497  5929 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.561810  2301 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:00:15.569895  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.562034  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.572085  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:15.561206  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.516805  5823 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:15.557879  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 46790.2us
I20260709 13:00:15.518252  5926 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.568682  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.568092  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:15.573268  1687 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:15.576361  2301 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:15.579998  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.582468  1535 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:15.584515  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:15.584790  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.536731  5790 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:15.588313  1681 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:15.564033  5644 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:15.597590  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:15.598227  5644 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.599929  1609 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:15.604058  5834 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:15.604568  5984 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:00:15.604650  5834 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.605182  5849 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:15.600346  5856 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:15.600884  5948 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:15.601603  5943 raft_consensus.cc:2804] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:15.607775  5943 raft_consensus.cc:697] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:15.602859  5893 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.603050  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:15.603214  5869 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:15.609530  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:15.609760  1684 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:15.614650  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:15.510136  5903 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:00:15.616827  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.630534  1688 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:15.630488  5895 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:00:15.558869  5917 consensus_queue.cc:1048] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:00:15.559732  5520 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.567938  5891 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:15.638465  5520 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.622937  5964 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.643347  1681 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:15.663275  1684 raft_consensus.cc:1275] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:15.666234  2309 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:15.667950  1685 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:15.553181  5830 consensus_queue.cc:1048] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:00:15.639501  5891 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.672704  5890 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:00:15.672547  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55766.6us
I20260709 13:00:15.606937  5948 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.679409  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.619385  5823 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:15.586740  5929 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.683840  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.639302  5943 consensus_queue.cc:237] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.688542  5926 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.690346  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.691191  5926 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:15.692951  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.693791  5926 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.695003  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:15.695812  5926 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:15.697114  1656 leader_election.cc:400] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9.
I20260709 13:00:15.697470  1656 leader_election.cc:403] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:15.698122  5926 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9.
I20260709 13:00:15.699401  1656 leader_election.cc:400] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:15.701220  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.702806  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.703680  1685 raft_consensus.cc:2410] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:00:15.676604  5775 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:15.709033  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.669373  5893 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:15.682590  5964 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:15.716630  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.719193  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.717067  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.718341  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.719810  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.720203  1687 raft_consensus.cc:2376] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11. Re-sending same reply.
I20260709 13:00:15.720500  1685 raft_consensus.cc:2410] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:00:15.720847  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.720427  1684 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.724534  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.725847  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.726550  1681 raft_consensus.cc:1813] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Handling vote request from an unknown peer 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:15.727329  1681 raft_consensus.cc:2410] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:15.728618  1689 raft_consensus.cc:2393] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:15.728480  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.729382  1685 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:15.736935  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.745201  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.747612  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.748307  1687 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.751667  1682 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.755381  1685 raft_consensus.cc:2393] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 15: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:15.756830  1684 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:15.744766  5946 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.758445  5782 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:15.759984  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:15.763051  5983 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:00:15.769300  1689 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:15.778126  5929 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:15.782492  1681 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:15.785094  1687 raft_consensus.cc:2410] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:15.794888  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.795742  1684 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.796757  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.798115  1687 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:15.803570  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.773010  5782 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.808197  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.807473  1681 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:15.809484  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.760947  5823 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.811911  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.816763  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:15.827080  1684 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:15.834496  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:15.839073  1682 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:15.791250  5954 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:15.892762  1681 raft_consensus.cc:2376] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11. Re-sending same reply.
I20260709 13:00:15.814604  5948 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.931589  1686 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:15.942487  5954 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.899705  5946 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:15.864034  5893 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:16.617414  5991 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:00:16.612273  5782 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:16.631912  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.014s	sys 0.035s
W20260709 13:00:16.632611  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.014s	sys 0.035s
W20260709 13:00:16.631738  5989 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:00:16.645576  5891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.017s	sys 0.029s
W20260709 13:00:16.681608  5891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.017s	sys 0.029s
W20260709 13:00:16.719523  5865 consensus_meta.cc:287] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 1.283s	user 0.009s	sys 0.004s
I20260709 13:00:16.823719  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1779) took 1030 ms. Trace:
I20260709 13:00:16.826339  1689 rpcz_store.cc:276] 0709 13:00:15.793791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.793913 (+   122us) service_pool.cc:224] Handling call
0709 13:00:15.805776 (+ 11863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.806157 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.806182 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:15.807915 (+  1733us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.633153 (+825238us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.821870 (+188717us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.823351 (+  1481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.823447 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.823491 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:16.823504 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.823652 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4184,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":1611,"thread_start_us":979703,"threads_started":2,"wal-append.queue_time_us":886332}
I20260709 13:00:16.829425  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 556) took 1269 ms. Trace:
I20260709 13:00:16.829886  1538 rpcz_store.cc:276] 0709 13:00:15.560603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.828511 (+1267908us) service_pool.cc:224] Handling call
0709 13:00:16.828883 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.829063 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.829090 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.829133 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.829168 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.829222 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.829363 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.720176  5865 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.835088  2304 raft_consensus.cc:2393] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 13: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:16.848924  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 555) took 1299 ms. Trace:
I20260709 13:00:16.849462  1533 rpcz_store.cc:276] 0709 13:00:15.548119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.550563 (+  2444us) service_pool.cc:224] Handling call
0709 13:00:15.577664 (+ 27101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.845877 (+1268213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.845912 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.845956 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:16.845988 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.846996 (+  1008us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540017b1d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:16.847044 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.847196 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2916350720}
I20260709 13:00:16.853929  5865 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:16.854795  5865 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:16.855446  5865 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.859594  5865 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:16.861608  5787 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:16.861763  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 1.26427e+06us
I20260709 13:00:16.862142  5787 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.862586  5787 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.868534  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1787) took 1070 ms. Trace:
I20260709 13:00:16.868427  5447 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:16.869010  1685 rpcz_store.cc:276] 0709 13:00:15.798271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.812806 (+ 14535us) service_pool.cc:224] Handling call
0709 13:00:15.833840 (+ 21034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.421914 (+588074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.421960 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.479253 (+ 57293us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.702007 (+222754us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.834310 (+132303us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.834915 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.834999 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.868298 (+ 33299us) raft_consensus.cc:1685] finished
0709 13:00:16.868329 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.868474 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":587595,"raft.queue_time_us":587934,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":199,"spinlock_wait_cycles":1215360,"thread_start_us":201019,"threads_started":2,"wal-append.queue_time_us":197932}
I20260709 13:00:16.871696  5849 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.874584  5524 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:16.875301  5524 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.877130  5918 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:16.877516  5869 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:16.885761  5918 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:16.876947  5849 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:16.889081  5911 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:16.887903  5869 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.895431  5911 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:16.896353  5911 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.896881  5869 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:16.894934  5524 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:16.890664  5852 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:16.886756  5787 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.895992  5918 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:16.898598  5852 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:16.900712  5787 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:16.901213  5852 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:16.902240  5852 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:16.912117  5849 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:17.034777  5849 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:17.035634  5849 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.038427  5849 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.050906  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:17.052289  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:17.054668  1537 consensus_meta.cc:287] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.519s	user 0.023s	sys 0.006s
I20260709 13:00:17.055131  1537 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
W20260709 13:00:17.055747  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 553) took 1548 ms (client timeout 1797 ms). Trace:
I20260709 13:00:17.056536  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:17.057410  1541 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:17.056128  1537 rpcz_store.cc:269] 0709 13:00:15.507134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.531368 (+ 24234us) service_pool.cc:224] Handling call
0709 13:00:17.055679 (+1524311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.066417  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 557) took 1501 ms. Trace:
I20260709 13:00:17.067551  1539 rpcz_store.cc:276] 0709 13:00:15.565194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.065659 (+1500465us) service_pool.cc:224] Handling call
0709 13:00:17.065935 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.066103 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.066131 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.066175 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:17.066208 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.066261 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.066359 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.078140  5849 raft_consensus.cc:476] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:17.078745  5849 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:17.079344  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 554) took 1547 ms (client timeout 1503 ms). Trace:
I20260709 13:00:17.079236  5849 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:17.079778  1536 rpcz_store.cc:269] 0709 13:00:15.534552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.079148 (+1544596us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:17.079256 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:17.082072  1541 raft_consensus.cc:2410] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:00:17.087049  5849 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.088954  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:17.089691  1612 raft_consensus.cc:2393] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:17.090049  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:17.090579  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:17.091269  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:17.091931  1615 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 13:00:17.095312  2305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 656) took 1586 ms. Trace:
I20260709 13:00:17.095806  2305 rpcz_store.cc:276] 0709 13:00:15.508825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.508932 (+   107us) service_pool.cc:224] Handling call
0709 13:00:15.546586 (+ 37654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.559857 (+ 13271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.095015 (+1535158us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54004bc150. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:17.095175 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85885184}
I20260709 13:00:17.141984  1613 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:17.145452  5849 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:17.145663  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 2.713s (SENT) [suppressed 36 similar messages]
I20260709 13:00:17.145802  5787 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.146023  5849 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.146517  5787 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.150064  5787 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:17.151502  5787 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.152060  5787 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.153147  5849 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:17.153693  5849 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.154197  5787 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:17.154145  5849 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:17.152711  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1534345420000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:00:17.155232  1506 connection.cc:256] RPC call timeout handler was delayed by -1.1075345420000531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 13:00:17.155663  1506 connection.cc:256] RPC call timeout handler was delayed by -1.0958345420000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:00:17.155977  1506 connection.cc:256] RPC call timeout handler was delayed by -1.0697345420000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:00:17.156563  5787 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.157373  5849 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:17.157214  5787 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.159340  5787 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:17.160006  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2419) took 1591 ms (client timeout 2101 ms). Trace:
W20260709 13:00:17.160472  1607 rpcz_store.cc:269] 0709 13:00:15.568529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.569252 (+   723us) service_pool.cc:224] Handling call
0709 13:00:17.159922 (+1590670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.162017  5954 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:17.162571  5954 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.165025  5954 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.165473  5954 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:17.165568  5787 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:17.165964  5954 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.166894  5787 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.169690  5954 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.171484  5787 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.179769  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.196415  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:17.197113  1681 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:17.197561  1611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.712s	user 0.013s	sys 0.022s
W20260709 13:00:17.198068  1611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.713s	user 0.013s	sys 0.022s
W20260709 13:00:17.221746  1487 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0f82bbd9193f4b71a0c17a0357cf0ce9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:17.222450  1487 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:17.222786  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:17.229359  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2123) took 1708 ms. Trace:
I20260709 13:00:17.229817  1688 rpcz_store.cc:276] 0709 13:00:15.520824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.522402 (+  1578us) service_pool.cc:224] Handling call
0709 13:00:15.547882 (+ 25480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.631500 (+ 83618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.229094 (+1597594us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b5400255b54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:17.229292 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171991296}
W20260709 13:00:17.231179  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 1.62823e+06us
I20260709 13:00:17.232874  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:17.234884  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.236364  5982 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.236896  5982 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.239270  5982 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.243804  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2413) took 1683 ms. Trace:
I20260709 13:00:17.244253  1613 rpcz_store.cc:276] 0709 13:00:15.560020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.560150 (+   130us) service_pool.cc:224] Handling call
0709 13:00:15.560450 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.142485 (+1582035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.243539 (+101054us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54001793d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:17.243733 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3636542720}
I20260709 13:00:17.255901  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:17.257546  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.256878  1614 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:17.264499  1534 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:17.269412  5509 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:17.272178  5509 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.272616  1681 raft_consensus.cc:2468] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:17.277065  5509 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.277563  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:17.278219  1532 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:17.279284  6009 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.279491  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.279845  6009 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.280723  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:17.281276  2303 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:17.281998  6009 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.285099  1532 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:17.286711  6009 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:17.287302  6009 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:17.288130  2304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56290 (request call id 658) took 1772 ms (client timeout 1891 ms). Trace:
I20260709 13:00:17.288568  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.288944  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.289400  6009 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.289979  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:17.290614  2309 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:17.296630  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.297297  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.298233  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:17.298944  2301 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:17.299118  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.300086  5911 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:17.300539  2303 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:17.301529  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.303032  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.306758  2276 leader_election.cc:400] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12.
I20260709 13:00:17.307133  2276 leader_election.cc:403] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:00:17.288602  2304 rpcz_store.cc:269] 0709 13:00:15.515926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.516112 (+   186us) service_pool.cc:224] Handling call
0709 13:00:17.287901 (+1771789us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002e5254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:17.288046 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3021839104}
I20260709 13:00:17.308911  6010 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:17.312451  6011 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12.
I20260709 13:00:17.314117  6011 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:17.319583  2309 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:17.326850  6012 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:17.369809  1653 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:17.372045  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47383.2us
W20260709 13:00:17.375895  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 62858.3us
I20260709 13:00:17.376971  5954 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.377152  6012 consensus_queue.cc:1048] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:00:17.380275  5954 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.382134  6012 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:17.382405  5954 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.382570  6012 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:17.377216  6009 raft_consensus.cc:2804] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:17.384981  6009 raft_consensus.cc:697] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:17.385972  6009 consensus_queue.cc:237] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.383500  6012 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.396158  2310 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
W20260709 13:00:17.445026  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54158.2us
W20260709 13:00:17.457998  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.483645  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 106528us
I20260709 13:00:17.462248  5948 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.483501  5954 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:17.645216  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.483337  6012 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.583882  5954 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.542932  5948 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.706825  5982 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.711477  5982 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.712857  5954 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.715049  5982 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.716499  5948 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:17.736238  5982 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.741659  5982 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.774219  5982 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.811192  5982 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.812346  5982 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.815171  5982 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:17.820343  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 335547us
I20260709 13:00:17.928404  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:17.929596  6018 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:17.930131  6018 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:17.931147  6018 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:17.828925  6009 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.869019  6022 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.885578  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.920521  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.935889  6022 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:17.923180  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080029ba80 after lost signal to thread 434
I20260709 13:00:17.936769  6009 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.938192  6022 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:17.938504  5263 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:17.936192  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:17.939287  1689 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 6.
I20260709 13:00:17.938541  6009 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:17.946877  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800097080 after lost signal to thread 1473
W20260709 13:00:17.947383  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08001df320 after lost signal to thread 1493
W20260709 13:00:17.953382  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea100 after lost signal to thread 1565
W20260709 13:00:17.953786  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003492a0 after lost signal to thread 1566
W20260709 13:00:17.955209  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003a14a0 after lost signal to thread 1640
W20260709 13:00:17.955547  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080022c3c0 after lost signal to thread 1641
I20260709 13:00:17.962981  5890 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.964497  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.965359  1532 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 6.
I20260709 13:00:17.967171  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.969333  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:17.971202  6009 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:17.971644  6009 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:17.972054  6009 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:17.972178  1656 leader_election.cc:400] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:17.973135  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:17.974349  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:17.969837  5890 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.974928  5982 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.975453  5982 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:17.975879  5982 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.977005  5890 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:17.977655  6022 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:17.978091  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.978379  6022 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:17.979131  1532 raft_consensus.cc:2393] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:17.979349  6022 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:17.982425  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.983318  1532 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:17.988348  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:17.992264  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.993777  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.996452  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:17.997053  1538 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:17.996868  6009 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.000967  5834 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:18.000952  6009 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.002307  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.002902  1538 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:18.004015  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.004280  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.004557  1538 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:18.005098  2302 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:18.005760  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.006348  1538 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:18.009936  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.010504  1538 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 13:00:18.010957  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:18.012473  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.014441  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.015630  1504 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.018639  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.019256  1532 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:18.021531  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.022284  1541 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:18.084722  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:18.085438  1534 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.085825  1539 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:18.091805  1534 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:18.091709  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.117982  1536 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:18.262318  6009 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.262420  6022 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.263435  6009 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.263643  6022 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.265942  6009 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.265970  6022 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:18.272185  5943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.776s	user 0.010s	sys 0.008s
W20260709 13:00:18.272748  5943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.790s	user 0.010s	sys 0.008s
I20260709 13:00:18.273244  5916 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:18.273922  5916 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:18.275170  6026 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.275655  6009 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.275813  6026 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.276603  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2115) took 2787 ms. Trace:
I20260709 13:00:18.276336  6009 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.276988  1686 rpcz_store.cc:276] 0709 13:00:15.488870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.490351 (+  1481us) service_pool.cc:224] Handling call
0709 13:00:15.490650 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.932210 (+441560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.276341 (+2344131us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54000f8a54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:18.276542 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013687168}
I20260709 13:00:18.278324  6026 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.278862  6022 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.279951  6022 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.280145  5916 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.281059  6026 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.281487  5916 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.279374  6009 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.281567  6026 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.282526  6009 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.286422  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.285036  6009 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.289393  6009 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.290303  6026 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.284456  6022 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.292464  6028 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:18.294358  1656 connection.cc:256] RPC call timeout handler was delayed by -1.0442732910000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:00:18.296537  6009 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:18.294624  6029 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.296859  6028 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.297587  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.300601  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.300992  1686 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:18.301683  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:18.302088  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.302664  1686 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:18.303256  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.303434  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.299374  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.304028  1686 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:18.304585  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.305527  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.305954  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.306304  1686 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 13:00:18.306669  1690 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:18.304589  1684 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:18.300618  6029 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:18.309122  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.314040  6028 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.314735  6028 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.315179  6028 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.317094  6028 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.318403  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.319258  1685 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:18.321156  6029 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.321828  6029 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:18.322645  6029 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:18.323108  6029 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.323175  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.323523  6029 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:18.326426  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.325544  6009 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.335371  6009 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.336056  6009 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.336763  6009 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:18.339576  6009 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.340202  6009 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:18.317559  6028 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.342608  6028 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.343068  6028 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.328330  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.349709  2304 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:18.328557  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.351171  1688 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
W20260709 13:00:18.355223  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.326222  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080024b5e0 after lost signal to thread 1714
I20260709 13:00:18.356093  6029 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.356614  1653 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.330678  6026 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.357681  5954 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:18.358174  5954 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.357944  6026 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.358631  5954 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.360404  6026 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:18.356600  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080024b780 after lost signal to thread 1715
W20260709 13:00:18.362082  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4c40 after lost signal to thread 2334
W20260709 13:00:18.362361  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003d69c0 after lost signal to thread 2335
W20260709 13:00:18.362711  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7340 after lost signal to thread 5644
W20260709 13:00:18.362969  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080034bae0 after lost signal to thread 5662
W20260709 13:00:18.363258  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4080 after lost signal to thread 5757
W20260709 13:00:18.363644  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003b39e0 after lost signal to thread 5823
W20260709 13:00:18.364043  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4620 after lost signal to thread 5831
W20260709 13:00:18.364612  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4600 after lost signal to thread 5893
W20260709 13:00:18.365011  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003ceb80 after lost signal to thread 5920
W20260709 13:00:18.365386  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3720 after lost signal to thread 5944
W20260709 13:00:18.365736  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002c14c0 after lost signal to thread 5962
W20260709 13:00:18.366372  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 1.27558e+06us
I20260709 13:00:18.367854  5954 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:18.356993  2275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.028s	sys 0.053s
W20260709 13:00:18.369158  2275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.029s	sys 0.054s
W20260709 13:00:18.369458  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 922941us
I20260709 13:00:18.370038  2275 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.371323  2275 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.373266  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:18.373922  2304 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.376856  5999 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:18.377458  5999 raft_consensus.cc:697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 13:00:18.376924  5852 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 1.467s	user 0.021s	sys 0.011s
I20260709 13:00:18.378326  5999 consensus_queue.cc:237] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.379052  1540 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:00:18.379383  5840 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.379788  5840 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.382297  5840 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.384413  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.385208  1683 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:18.363888  5982 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.386579  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.388270  5982 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.389509  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:18.399108  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 383537us
I20260709 13:00:18.399816  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.401386  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.402204  5918 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:18.402576  5954 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.402758  5918 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:18.403734  2304 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:18.403939  5903 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:18.404458  5903 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.404788  5903 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.407459  5840 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.408789  1536 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:18.409749  5840 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:18.340842  6009 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.422662  6009 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.409866  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:18.423732  1532 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:18.411530  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 125209us
I20260709 13:00:18.426177  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.427719  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.442392  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.415271  1653 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.443475  5447 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:18.444183  5447 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:18.444739  5447 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.445324  5447 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:18.447922  6009 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:18.448509  6009 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:18.448926  1506 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.449349  6009 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.453989  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:18.454659  1682 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:18.412115  5890 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:18.428505  5524 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:18.429709  2310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56294 (request call id 589) took 1142 ms. Trace:
I20260709 13:00:18.462849  1534 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:18.431469  1536 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:18.434275  1681 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:18.403769  5918 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.436549  1683 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:18.437060  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52700 (request call id 561) took 1257 ms. Trace:
I20260709 13:00:18.467571  1540 rpcz_store.cc:276] 0709 13:00:17.179387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.179515 (+   128us) service_pool.cc:224] Handling call
0709 13:00:18.436875 (+1257360us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540040d8d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:18.436995 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2756665216}
I20260709 13:00:18.413443  1535 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:18.463095  2310 rpcz_store.cc:276] 0709 13:00:17.287489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.288676 (+  1187us) service_pool.cc:224] Handling call
0709 13:00:18.429537 (+1140861us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000ed654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:18.429650 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244928256}
I20260709 13:00:18.471009  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:18.473352  1687 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.471993  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:18.474797  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 171601us
I20260709 13:00:18.476405  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:18.472285  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:18.483626  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.484814  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.487437  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.487597  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.487972  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:18.489023  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.489976  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.492091  6022 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:18.492501  6022 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.492842  6022 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:18.499954  6022 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.501997  6022 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.502880  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.505679  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:18.490698  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.506242  6022 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.506213  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.507588  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.513443  1609 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:18.513852  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.514209  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.514914  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.515163  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.515883  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.510444  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:18.516062  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.516572  1612 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.516621  1609 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 6.
I20260709 13:00:18.510730  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.509187  1608 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:00:18.470837  5932 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:18.523496  1616 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:18.528398  1687 raft_consensus.cc:2468] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 13:00:18.531445  2275 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:18.517438  5781 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:18.535102  5781 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:18.535509  5781 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:18.540750  5840 raft_consensus.cc:2804] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:18.541512  5840 raft_consensus.cc:697] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:18.542689  5840 consensus_queue.cc:237] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.544255  5852 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.488952  5524 raft_consensus.cc:2764] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:18.547246  5447 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.517457  6030 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:18.548488  6030 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:18.548883  6030 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.550164  5447 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:18.551829  5447 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.530861  6026 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:18.552574  6026 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.552956  6026 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:18.553031  5524 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.553561  5524 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.555646  5524 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:18.520604  6022 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.560031  6022 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.519799  5954 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:18.560532  5954 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.560958  5954 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.521359  5948 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:18.563021  5948 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.563405  5948 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.519955  6018 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:00:18.573446  5911 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:18.573849  5911 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:18.488722  5890 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:18.575666  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.579558  1612 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:18.559612  6028 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.520783  5982 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:18.481351  5509 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:00:18.486265  5917 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:00:18.598592  1612 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:18.521626  5916 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:00:18.574668  5911 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.624262  5911 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:18.581413  5932 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.588397  5982 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:16.944617   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:18.572141  5954 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.658946  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.633002  5982 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:18.697379  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.552593  5447 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.631563  5865 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:00:18.652802  5932 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:18.779163  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 288589us
I20260709 13:00:18.780362  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:18.784329  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.691814  6009 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:00:18.796195  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:18.795002  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 219) took 46959 ms (client timeout 15000 ms). Trace:
I20260709 13:00:18.664187  6030 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.751643  5865 consensus_queue.cc:1243] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:18.802881  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:18.808414  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 287143us
I20260709 13:00:18.817238  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:18.817590  1506 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.795560  5890 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:18.822294  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.830713  5948 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:18.832341  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 105538us
I20260709 13:00:18.832132  6037 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.831346  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1869) took 3347 ms. Trace:
I20260709 13:00:18.833484  5948 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:18.834297  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:18.834136  6037 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:18.833577  1611 rpcz_store.cc:276] 0709 13:00:15.484311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.484526 (+   215us) service_pool.cc:224] Handling call
0709 13:00:15.484757 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.484954 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:15.485205 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.830965 (+3345760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.831016 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:18.831066 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.831127 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.831227 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1457528,"prepare.queue_time_us":431,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":6871,"thread_start_us":1887834,"threads_started":2,"wal-append.queue_time_us":456430,"wal-append.run_cpu_time_us":1281,"wal-append.run_wall_time_us":1001458}
I20260709 13:00:18.854422  1507 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:18.857074  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:18.795909  5916 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:18.820163  5852 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.818786  6029 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.819593  5918 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:18.871163  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:18.799455  5524 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:18.875634  6051 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.800117  1437 rpcz_store.cc:269] 0709 12:59:31.825144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.828382 (+  3238us) service_pool.cc:224] Handling call
0709 13:00:18.784212 (+46955830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:12.969506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:12.970168 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:12.970228 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:00:12.970252 (+    24us) tablet.cc:662] Decoding operations
0709 13:00:12.972091 (+  1839us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:12.972258 (+   167us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:12.972311 (+    53us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:12.973033 (+   722us) tablet.cc:701] Row locks acquired
0709 13:00:12.973095 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:00:12.973266 (+   171us) write_op.cc:270] Start()
0709 13:00:12.973409 (+   143us) write_op.cc:276] Timestamp: P: 1783602012973193 usec, L: 0
0709 13:00:12.973432 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:12.974194 (+   762us) log.cc:844] Serialized 2147 byte log entry
0709 13:00:13.322123 (+347929us) op_driver.cc:464] REPLICATION: finished
0709 13:00:13.395051 (+ 72928us) write_op.cc:301] APPLY: starting
0709 13:00:13.395154 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:13.798044 (+402890us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:13.830423 (+ 32379us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:14.147363 (+316940us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:14.147624 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:00:14.147675 (+    51us) write_op.cc:312] APPLY: finished
0709 13:00:14.148002 (+   327us) log.cc:844] Serialized 57 byte log entry
0709 13:00:14.148202 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:14.159616 (+ 11414us) write_op.cc:454] Released schema lock
0709 13:00:14.159744 (+   128us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:14.208486 (+ 48742us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:14.213405 (+  4919us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":170572,"reported_tablets":49,"spinlock_wait_cycles":4480,"child_traces":[["op",{"apply.queue_time_us":72668,"apply.run_cpu_time_us":17111,"apply.run_wall_time_us":773190,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18783,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":1,"lbm_read_time_us":10614,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":7,"num_ops":5,"prepare.queue_time_us":349361,"prepare.run_cpu_time_us":4187,"prepare.run_wall_time_us":5034,"replication_time_us":348539,"thread_start_us":377747,"threads_started":2}]]}
I20260709 13:00:18.868613  5948 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:18.879168  5890 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.903455  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:18.904070  1611 raft_consensus.cc:606] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:18.869227  5903 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.885244  6028 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.887873  6029 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:18.881518  1434 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:18.917851  5520 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:18.886950  6054 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:18.903748  5918 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:18.924793  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.918730  5644 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:18.906710  5890 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.922159  6029 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:18.930568  5890 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:18.930804  6033 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:00:18.931200  6029 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.932489  6029 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:18.933382  6038 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:18.935125  6030 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:18.936089  6042 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:18.936241  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:18.916476  6009 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:18.923125  5954 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.884497  6051 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.943251  5890 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.949280  6026 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:18.950829  6031 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:00:18.944730  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 46825.9us
W20260709 13:00:18.957607  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 140048us
I20260709 13:00:18.900542  5948 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.959081  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:18.961840  5781 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.962733  6051 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.963291  6051 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:18.963735  6051 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:18.963891  5781 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:18.964432  6039 log.cc:927] Time spent T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:00:18.964651  6051 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.965142  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.967633  6022 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.969198  5447 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.970036  6022 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.973031  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:18.953100  6054 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:18.970852  6026 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:18.987026  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.987699  2310 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:18.987565  5982 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.989602  5757 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.990267  5757 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.993008  5809 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.993700  5809 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.956054  5918 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:18.995755  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.996029  5817 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.996583  5817 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:18.996765  5918 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:18.976758  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.998956  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:18.999040  1541 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:18.999764  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.000138  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.977092  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:18.977046  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:18.977664  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.978108  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.978847  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.002499  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.002924  1537 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:19.003183  1536 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.003759  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.979877  5932 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:18.982578  5948 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:18.983835  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:18.969070  1434 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:19.031260  5757 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.031616  5890 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.031698  5982 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:19.032313  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6160 after lost signal to thread 434
W20260709 13:00:19.033331  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4460 after lost signal to thread 1473
W20260709 13:00:19.033735  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdd60 after lost signal to thread 1493
W20260709 13:00:19.034821  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8980 after lost signal to thread 1565
W20260709 13:00:19.035117  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080029fee0 after lost signal to thread 1566
W20260709 13:00:19.035403  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002764c0 after lost signal to thread 1581
I20260709 13:00:18.985369  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.036568  1534 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:18.984764  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:19.038733  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080031e600 after lost signal to thread 1640
I20260709 13:00:19.038697  1533 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
W20260709 13:00:19.039117  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0360 after lost signal to thread 1641
I20260709 13:00:19.005338  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.007050  1684 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:19.040716  1537 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.006633  6054 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.011224  1683 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:19.011330  1612 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:19.052484  1612 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:19.053359  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.054154  1533 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:19.013175  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:18.995712  5809 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:19.017277  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.056133  1539 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.018666  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.056903  1532 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:19.057629  1688 pending_rounds.cc:85] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 8
I20260709 13:00:19.058063  1688 pending_rounds.cc:107] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:19.058358  1688 raft_consensus.cc:2889] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:18.975570  6022 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:19.030944  1434 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 6 to 8, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 8 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:19.041219  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08001657e0 after lost signal to thread 1714
I20260709 13:00:19.006976  1504 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:19.066088  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003725e0 after lost signal to thread 1715
I20260709 13:00:19.046378  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:19.012209  1540 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:00:19.067076  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:19.067533  1562 debug-util.cc:398] Leaking SignalData structure 0x7b0800347aa0 after lost signal to thread 2334
I20260709 13:00:19.064960  1537 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:19.053296  1612 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:19.067921  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080031c6a0 after lost signal to thread 2335
I20260709 13:00:19.068277  1612 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:19.068459  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080032ec80 after lost signal to thread 5644
W20260709 13:00:19.068866  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb4c0 after lost signal to thread 5662
W20260709 13:00:19.069283  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8800 after lost signal to thread 5757
W20260709 13:00:19.069705  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003f26c0 after lost signal to thread 5823
W20260709 13:00:19.069995  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080034b8c0 after lost signal to thread 5831
W20260709 13:00:19.070604  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080020b1c0 after lost signal to thread 5834
W20260709 13:00:19.071053  1562 debug-util.cc:398] Leaking SignalData structure 0x7b0800369b60 after lost signal to thread 5893
W20260709 13:00:19.071537  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa180 after lost signal to thread 5920
W20260709 13:00:19.071899  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003f5360 after lost signal to thread 5939
W20260709 13:00:19.072194  1562 debug-util.cc:398] Leaking SignalData structure 0x7b0800397640 after lost signal to thread 5944
W20260709 13:00:19.072587  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2720 after lost signal to thread 5962
I20260709 13:00:19.065785  5830 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.075502  6022 consensus_queue.cc:1243] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:19.075786  5830 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.076748  1434 catalog_manager.cc:5697] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:19.078049  5830 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.078243  1434 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:19.080192  5817 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:19.080945  1506 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:19.076088  6022 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:19.082041  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:19.079932  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 73044.7us
I20260709 13:00:19.085875  1533 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:19.090600  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.088529  1504 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:19.093505  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.093149  1533 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:19.105852  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.111495  1612 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:19.108090  1506 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:19.116441  6056 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.117161  6056 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:19.117530  6056 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.117969  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:19.118096  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.119570  1535 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:19.087244  6023 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:00:19.122845  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 65097.7us
I20260709 13:00:19.104558  5447 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:19.104784  5932 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.086894  6022 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:19.134083  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:19.142863  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.146826  1684 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:19.132930  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:19.147769  1690 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:19.131422  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47548.7us
I20260709 13:00:19.132217  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:19.131560  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:19.130327  1535 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:19.079645  1434 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 7 to 9, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.115676  5903 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:19.148582  1682 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:19.149672  1681 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:19.149986  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:19.121618  6055 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:19.148265  1656 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.168340  1683 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:19.168794  1656 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.170258  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:19.152036  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:19.171438  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:19.118501  6037 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.121997  6056 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.172199  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.173481  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 13:00:19.174015  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 56368.6us
I20260709 13:00:19.130039  6058 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:19.175591  6058 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.175972  6058 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.177742  5999 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:19.178257  5999 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:19.179440  5999 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.175107  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.180745  1541 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:19.181749  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.182717  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.183398  1541 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.184092  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.185213  1541 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.186035  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.155893  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:19.149994  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.187351  1684 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:19.183632  6058 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.123041  5830 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:00:19.141511  5932 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.201438  1541 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:19.144992  5509 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.170358  6009 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:19.130511  5865 consensus_queue.cc:1059] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:00:19.136338  5447 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.203305  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:19.208796  1683 raft_consensus.cc:1813] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Handling vote request from an unknown peer 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:19.209439  1683 raft_consensus.cc:2393] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 7: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:19.169674  6055 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.184163  6068 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.187449  6028 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.192924  6051 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:19.203662  5932 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.193817  6057 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:19.205521  6030 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:19.221256  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 830561us
I20260709 13:00:19.232331  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.233023  1536 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.233189  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.221550  5872 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:00:19.223891  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 207134us
I20260709 13:00:19.206707  6009 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:19.227324  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 1.98884e+06us
I20260709 13:00:19.213059  6055 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.239461  5662 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:19.241214  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.215459  6068 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.264765  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.265558  1610 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.268626  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.270540  1615 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:19.226037  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:19.212968  5447 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.276932  5662 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.285427  5939 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.301959  1610 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 7.
I20260709 13:00:19.304564  1534 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.322446  1540 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:19.242820  6030 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.325126  1533 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:19.264101  6009 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.308625  1536 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:19.284494  5948 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:19.313619  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 80502.1us
W20260709 13:00:19.314098  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49606us
I20260709 13:00:19.315888  6047 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.305903  5865 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.317076  5263 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:19.313151  5918 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:19.336874  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.337459  1534 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:19.318924  1434 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:19.339391  5865 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.340386  6058 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.340312  1434 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 4 to 7, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.217041  6022 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.342180  6022 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.342618  1434 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 9 to 11, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.207955  5509 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.328346  6030 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.329036  6041 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:19.328780  5939 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.322269  1507 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:19.309420  1690 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
W20260709 13:00:19.327534  1582 connection.cc:256] RPC call timeout handler was delayed by -2.3130421710000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:00:19.218566  6051 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.334364  1540 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:19.272861  6068 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:19.347229  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.365200  5865 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.380657  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.362867  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.360392  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.345696  5509 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:19.445339  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.363865  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.364778  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.366590  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.376173  6051 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:19.374768  1582 connection.cc:256] RPC call timeout handler was delayed by -1.8549421710000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 13:00:19.480489  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:19.480911  1582 connection.cc:256] RPC call timeout handler was delayed by -1.8324421709999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 13:00:19.481166  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 131285us
W20260709 13:00:19.481405  1582 connection.cc:256] RPC call timeout handler was delayed by -1.7973421709999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2283s for a response
I20260709 13:00:19.482116  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.482264  1582 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:19.375495  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 53327.5us
I20260709 13:00:19.482976  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:19.483213  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.358497  1537 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.358810  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.485270  1537 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:19.358021  1532 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.487006  1532 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:19.364516  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.488211  1615 raft_consensus.cc:3060] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.351328  5686 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:00:19.358165  6041 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:19.376675  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 205312us
I20260709 13:00:19.376155  5916 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:19.370492  5939 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.494918  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.348839  1534 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:19.506300  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.512001  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:19.347563  6056 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.351982  5757 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:00:19.525035  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.527966  1608 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:19.528147  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.528959  1609 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.366997  5932 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.501377  5872 raft_consensus.cc:2804] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:19.359001  6047 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:19.535161  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 349206us
I20260709 13:00:19.517469  5263 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.534021  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:19.542711  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.516327  6041 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:19.546666  1535 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.519997  5833 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.549665  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 13:00:19.656761  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 107184us
I20260709 13:00:19.657799  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.658905  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:19.534608  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 426626us
I20260709 13:00:19.660063  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.530254  5644 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.661537  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.536870  1582 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.638830  1615 raft_consensus.cc:2468] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:19.655269  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:19.665684  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 128894us
I20260709 13:00:19.530705  5916 raft_consensus.cc:697] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:19.668288  6029 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:19.669690  1612 raft_consensus.cc:2393] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:19.669088  6070 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.515718  5447 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.540423  5872 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.677270  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 13:00:19.684523  1686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.020s	sys 0.057s
W20260709 13:00:19.691493  1686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.020s	sys 0.057s
I20260709 13:00:19.532986  6055 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.344203  1434 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 7 to 8, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.664595  5823 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.677942  5954 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.669490  5962 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.677148  5263 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:19.701928  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.678355  6070 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:19.721397  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44234.9us
I20260709 13:00:19.735862  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.737097  1656 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.738790  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.710175  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:19.695684  5872 raft_consensus.cc:3060] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:19.697247  6028 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:19.740082  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:19.742633  1533 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:19.742928  1608 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:19.694424  6029 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:19.743153  6070 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.741812  6026 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.748214  6080 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:19.758090  6080 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:19.759366  6047 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:19.759007  6080 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.760609  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:19.760982  6056 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.761231  2302 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:19.761626  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1893) took 1229 ms. Trace:
I20260709 13:00:19.748387  6053 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:19.760027  5916 consensus_queue.cc:237] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.763124  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.756801  2310 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:19.764456  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.757402  2308 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:19.756929  6026 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:19.765098  1434 catalog_manager.cc:5697] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 4 to 8, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:19.766208  6026 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:19.766690  1536 raft_consensus.cc:1240] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:19.767093  6026 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.766870  1434 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 2 to 7, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.758102  6055 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.762027  6029 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.769099  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.769735  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.770260  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.770340  1612 raft_consensus.cc:2376] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12. Re-sending same reply.
I20260709 13:00:19.749375  5982 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.773378  5447 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:19.748346  6054 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:19.773977  6054 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:19.774366  6054 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.762053  1616 rpcz_store.cc:276] 0709 13:00:18.531839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.531931 (+    92us) service_pool.cc:224] Handling call
0709 13:00:18.562356 (+ 30425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.231783 (+669427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.231810 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.259190 (+ 27380us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.531876 (+272686us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:19.532035 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.532099 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.761402 (+229303us) raft_consensus.cc:1685] finished
0709 13:00:19.761423 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.761567 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":669056,"raft.queue_time_us":669144,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":230131,"threads_started":1,"wal-append.queue_time_us":477240}
I20260709 13:00:19.778919  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.771504  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.771526  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.782935  1608 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:19.781870  1536 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:00:19.784503  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 273233us
I20260709 13:00:19.780071  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.782454  1609 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 16: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:19.797847  1611 raft_consensus.cc:606] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:19.799576  1611 raft_consensus.cc:614] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:19.798724  2302 raft_consensus.cc:1240] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:00:19.800884  2309 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:19.803153  1536 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:19.737382  5263 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:19.810950  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:19.812458  2310 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:19.807356  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 147404us
I20260709 13:00:19.814621  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.819604  1506 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:19.829098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.775497  1434 catalog_manager.cc:5697] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 5 to 7, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:19.771699  5982 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:19.832760  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.753873  5917 raft_consensus.cc:3055] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:19.831832  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.034s	sys 0.054s
I20260709 13:00:19.862082  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.837510  1616 raft_consensus.cc:2410] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:00:19.863202  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.041s	sys 0.070s
I20260709 13:00:19.860241  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:19.797911  5962 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.866763  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:19.870046  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.830729  5263 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.833367  5651 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:19.876899  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.878320  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.794661  6028 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:19.862407  5982 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:19.868813  6022 consensus_meta.cc:287] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.006s
I20260709 13:00:19.876173  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:19.914367  2310 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:19.876173  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:19.873729  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 206747us
W20260709 13:00:19.875226  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 340645us
I20260709 13:00:19.897545  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.833778  5447 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.883064  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:19.861954  5917 raft_consensus.cc:740] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:19.812350  6070 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.837522  6055 raft_consensus.cc:2764] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:19.913513  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.810838  5954 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:00:19.917490  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:19.873085  6056 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.872802  6076 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.922597  1434 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 3 to 6, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.926822  6090 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.907284  5651 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.928238  6028 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:19.931953  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.936400  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.933656  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:19.943800  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.943854  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.944741  1616 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:19.945600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.946316  1616 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:19.947615  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:19.949600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.923717  5447 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:19.874763  5962 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:19.938769  6063 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:00:19.930980  5932 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.966430  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.961627  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.973649  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:19.974565  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.974844  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.975188  5686 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:19.976465  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:19.977793  6072 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:00:19.983721  2310 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:19.981980  6041 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:19.985140  1434 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 6 to 7, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:19.986824  6041 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:19.986968  6078 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:19.988786  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1877) took 1504 ms. Trace:
I20260709 13:00:19.989188  1613 rpcz_store.cc:276] 0709 13:00:18.483931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.484082 (+   151us) service_pool.cc:224] Handling call
0709 13:00:18.484424 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.228683 (+744259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.228718 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.229163 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.521971 (+292808us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:19.828587 (+306616us) log.cc:844] Serialized 14 byte log entry
0709 13:00:19.829514 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.829601 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.986396 (+156795us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:19.988440 (+  2044us) raft_consensus.cc:1685] finished
0709 13:00:19.988563 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.988720 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":778639,"prepare.queue_time_us":450808,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":746966,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":1930,"spinlock_wait_cycles":12411648,"thread_start_us":562056,"threads_started":2,"wal-append.queue_time_us":608377}
I20260709 13:00:19.990572  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1881) took 1500 ms. Trace:
I20260709 13:00:19.990517  5872 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:19.992002  6075 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:00:19.992057  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.991242  1607 rpcz_store.cc:276] 0709 13:00:18.490551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.500336 (+  9785us) service_pool.cc:224] Handling call
0709 13:00:18.500689 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.309982 (+809293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.310025 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.314478 (+  4453us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.787164 (+472686us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:19.787226 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.787308 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.990302 (+202994us) raft_consensus.cc:1685] finished
0709 13:00:19.990327 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.990490 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807149,"raft.queue_time_us":810070,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2721,"thread_start_us":447925,"threads_started":1,"wal-append.queue_time_us":615528}
I20260709 13:00:19.992987  1613 raft_consensus.cc:2393] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:19.993217  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:19.993661  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.993778  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.994280  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.994388  1613 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:19.994733  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:19.933694  5944 consensus_queue.cc:1059] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:19.954681  6090 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:19.950700  5920 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:20.052145  6090 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:20.052430  5920 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:20.037729  6009 consensus_meta.cc:287] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.702s	user 0.013s	sys 0.000s
I20260709 13:00:19.938141  6076 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.053206  6009 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.053507  5920 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.054634  6076 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:20.054921  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.056449  1681 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:20.043442  5263 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.028853  5962 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:19.961015  6093 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:00:20.072916  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.037654  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 583) took 1031 ms. Trace:
I20260709 13:00:20.038617  5823 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:20.040606  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.043783  6029 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:20.046833  6030 consensus_meta.cc:287] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.000s
I20260709 13:00:20.047101  6091 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.965173  5447 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.048926  5872 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:19.964895  6053 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:20.049777  1609 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:20.026329  1616 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:20.052477  1682 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:20.037663  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51296 (request call id 19) took 1069 ms. Trace:
I20260709 13:00:20.060003  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:20.069871  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 185054us
W20260709 13:00:20.072458  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 270003us
I20260709 13:00:20.073704  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:20.073710  1538 rpcz_store.cc:276] 0709 13:00:19.006690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.007933 (+  1243us) service_pool.cc:224] Handling call
0709 13:00:19.008587 (+   654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:19.008947 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.008979 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:19.009573 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 13:00:19.068413 (+ 58840us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:19.068453 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.068516 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.528106 (+459590us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18002c89c0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:20.037339 (+509233us) raft_consensus.cc:1685] finished
0709 13:00:20.037364 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.037585 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41233,"raft.queue_time_us":1404,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":16280,"spinlock_wait_cycles":25744256,"thread_start_us":58491,"threads_started":1,"wal-append.queue_time_us":65359}
I20260709 13:00:20.079785  1683 raft_consensus.cc:1240] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:20.079511  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 196543us
I20260709 13:00:20.068959  6047 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.130654  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:20.132588  1608 raft_consensus.cc:2410] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:20.052651  6090 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.132968  1611 rpcz_store.cc:276] 0709 13:00:18.968551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.976926 (+  8375us) service_pool.cc:224] Handling call
0709 13:00:20.037491 (+1060565us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54002b5554. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c45853 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691 00007f8d5719960c 00007f8d571988c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:20.037588 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807818496}
W20260709 13:00:20.136847  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 63243.5us
I20260709 13:00:20.139307  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.139561  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:20.133548  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 1.503s (SENT)
I20260709 13:00:20.140153  1504 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.140731  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.141075  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:20.140653  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.141718  1540 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:20.141836  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.145082  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.145437  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.149405  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.151053  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.152261  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.153610  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.154255  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.155979  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.156771  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.049839  6054 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.129727  5823 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:20.163414  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.143599  6047 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.143994  5939 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.145998  6055 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:20.169835  5809 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:20.171142  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1810) took 1037 ms. Trace:
I20260709 13:00:20.172544  5916 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:20.174057  5865 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.163791  5872 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:00:20.178093  5263 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.179273  6037 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:20.198614  5939 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.179558  6009 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:20.179986  6077 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:00:20.182021  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.236860  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.237702  1609 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:20.184942  6070 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:20.185868  5823 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.156275  5520 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:00:20.095034  6030 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.189208  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.191009  5852 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:20.082087  6091 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:20.200584  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.201848  1681 rpcz_store.cc:276] 0709 13:00:19.134001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.170005 (+ 36004us) service_pool.cc:224] Handling call
0709 13:00:20.170890 (+1000885us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b540035af54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:20.171065 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036121344}
I20260709 13:00:20.091977  6029 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.201529  5809 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.218557  6053 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.196696  6047 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.260583  5852 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:20.260962  5809 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.261524  5852 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.262465  5809 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.160858  6094 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:20.220338  6068 consensus_meta.cc:287] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.003s
I20260709 13:00:20.196141  5982 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.236907  5939 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.264611  6068 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.266319  5982 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:20.266767  6068 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.267110  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1808) took 1133 ms. Trace:
I20260709 13:00:20.254525  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.267473  1689 rpcz_store.cc:276] 0709 13:00:19.133482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.135280 (+  1798us) service_pool.cc:224] Handling call
0709 13:00:19.135644 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.141817 (+  6173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.141864 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.149931 (+  8067us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.370765 (+220834us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4800190158. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5db74aa1 00007f8d5db6bb37 00007f8d5db6b9ca 00007f8d5dc6326f 00007f8d5dc62f37 00007f8d5dc7755c 00007f8d5dc77508 00007f8d5dc77488 00007f8d5dc77443 00007f8d5dc766ec 00007f8d5cba0a96
0709 13:00:19.516294 (+145529us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:19.533291 (+ 16997us) log.cc:844] Serialized 14 byte log entry
0709 13:00:19.533563 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.533663 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.055354 (+521691us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b1800218680. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e522 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:20.266891 (+211537us) raft_consensus.cc:1685] finished
0709 13:00:20.266915 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.267055 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7071,"prepare.queue_time_us":16797,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":7027,"raft.run_cpu_time_us":1815,"raft.run_wall_time_us":342048,"spinlock_wait_cycles":65289472,"thread_start_us":329427,"threads_started":1,"wal-append.queue_time_us":648307}
I20260709 13:00:20.269475  6030 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:20.270112  6030 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:20.270674  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.270465  5982 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:20.230134  6037 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:20.272045  5982 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:20.272416  6037 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:20.273202  6054 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.191063  5447 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.259676  5872 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:20.281185  5872 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:20.282637  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 214973us
W20260709 13:00:20.286126  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 152643us
I20260709 13:00:20.257728  6091 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.292618  5447 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.292387  5872 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.294092  5872 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:20.301851  5962 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:20.302430  5962 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.305804  5939 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.316124  5939 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.328058  5944 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:20.328697  5944 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.329701  5944 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.331458  5944 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:20.333940  6029 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.307520  5651 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.322250  5917 consensus_queue.cc:260] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.303428  5962 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:20.335649  6084 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.446s	user 0.003s	sys 0.001s
W20260709 13:00:20.339956  6051 consensus_meta.cc:287] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
W20260709 13:00:20.344072  6086 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.297s	user 0.004s	sys 0.000s
I20260709 13:00:20.198338  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.247447  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:20.223150  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 275640us
I20260709 13:00:20.405004  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:20.222362  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 248803us
I20260709 13:00:20.407600  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.413765  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.415633  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.416980  1611 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 7: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:20.418036  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.419338  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:20.430734  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 141770us
I20260709 13:00:20.444015  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.449703  5917 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.444973  1609 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
W20260709 13:00:20.461539  6112 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:00:20.461736  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1876) took 1980 ms. Trace:
I20260709 13:00:20.463557  1681 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:20.465976  5833 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:20.466766  5872 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:20.467983  5833 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:20.469030  5872 consensus_queue.cc:1059] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:20.473115  5918 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.475857  5644 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:20.451505  6090 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.349546  6051 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.502561  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.501708  1683 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.503655  1690 raft_consensus.cc:1240] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:20.507762  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.489631  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 217364us
W20260709 13:00:20.523726  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 89470.5us
I20260709 13:00:20.502475  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.477761  6106 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.499928  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.538136  1682 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:20.506210  6090 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.541076  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2137) took 1212 ms. Trace:
I20260709 13:00:20.542037  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:20.542506  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 130818us
I20260709 13:00:20.543241  1683 raft_consensus.cc:2410] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:00:20.545859  5823 consensus_queue.cc:1059] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:20.546166  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.547405  5823 raft_consensus.cc:3055] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:20.548043  5823 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.549371  5823 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.551596  5823 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.553365  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1910) took 1068 ms. Trace:
I20260709 13:00:20.554000  1611 rpcz_store.cc:276] 0709 13:00:19.485101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.420363 (+935262us) service_pool.cc:224] Handling call
0709 13:00:20.533103 (+112740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.552736 (+ 19633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.552782 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.552865 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:20.552931 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.553029 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.553244 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.556545  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.557857  1684 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 7: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:20.558302  6047 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.559986  1616 raft_consensus.cc:2368] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:20.565872  6055 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:20.566566  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 604) took 1202 ms. Trace:
I20260709 13:00:20.567063  1610 rpcz_store.cc:276] 0709 13:00:19.375818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.995554 (+619736us) service_pool.cc:224] Handling call
0709 13:00:19.995796 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.412959 (+417163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.413018 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.413109 (+    91us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:20.413174 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.566070 (+152896us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002887d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:20.566118 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.566352 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958010112}
I20260709 13:00:20.511258  6051 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:20.489459  5782 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:00:20.569178  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.570411  1612 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 16: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:20.570732  5782 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:20.570866  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 608) took 1039 ms. Trace:
I20260709 13:00:20.571343  1612 rpcz_store.cc:276] 0709 13:00:19.531897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.771128 (+239231us) service_pool.cc:224] Handling call
0709 13:00:20.568970 (+797842us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5c0015738c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5c5b5161 00007f8d5c756a79 00007f8d5dc109b6 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:20.570790 (+  1820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10713344}
I20260709 13:00:20.573232  6047 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.578176  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.579170  1683 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:20.482903  5918 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.584614  5948 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.584861  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:20.585397  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 445208us
I20260709 13:00:20.586161  1684 raft_consensus.cc:2410] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:20.585582  5948 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.587118  6110 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.587571  1609 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:20.477393  6044 consensus_queue.cc:1059] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:00:20.541642  1533 rpcz_store.cc:276] 0709 13:00:19.328716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.328836 (+   120us) service_pool.cc:224] Handling call
0709 13:00:19.329666 (+   830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.749861 (+420195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.540433 (+790572us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54001b7bd4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:20.540781 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949334272}
I20260709 13:00:20.476910  5833 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:00:20.589365  1609 raft_consensus.cc:1275] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:00:20.589792  1609 pending_rounds.cc:85] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 9
I20260709 13:00:20.590075  1609 pending_rounds.cc:107] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:20.590227  5833 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:20.590830  5833 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.478111  5920 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:20.592514  5920 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:20.556555  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.590374  1609 raft_consensus.cc:2889] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:20.496016  5962 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.477381  6104 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:20.605306  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.606523  6053 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.607396  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:20.608405  1689 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:20.613312  1612 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:20.613806  6091 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.614805  1612 raft_consensus.cc:3055] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:20.615159  1612 raft_consensus.cc:740] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.592103  5833 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.618124  1609 raft_consensus.cc:3055] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:20.625317  1609 raft_consensus.cc:740] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.607992  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:20.622166  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:20.594192  6106 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.616096  6091 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.634773  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:20.640379  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:20.641542  6056 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:20.593946  5920 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.643419  6044 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.644495  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:20.649048  1689 raft_consensus.cc:1240] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:20.649890  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 101706us
I20260709 13:00:20.621194  5948 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:20.653605  5833 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.675643  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:20.676505  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.679154  1616 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:20.679127  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:20.680455  6068 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:20.681476  1541 raft_consensus.cc:1240] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:20.682355  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:20.682542  5939 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.683001  5939 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.683805  1537 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:20.684197  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:20.684485  6056 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.684950  6068 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:20.685384  6068 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:20.685767  6068 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.686290  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:20.686887  6056 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.687182  1532 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.690078  6106 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.691825  5999 consensus_queue.cc:1059] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:20.692646  1609 consensus_queue.cc:260] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.693694  5999 raft_consensus.cc:3055] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:20.693845  1609 raft_consensus.cc:3060] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.694106  5999 raft_consensus.cc:740] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:20.695343  5999 consensus_queue.cc:260] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.695842  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:20.655004  6037 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.600309  6104 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.659818  1610 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:20.587797  6110 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:20.662734  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.616065  1612 consensus_queue.cc:260] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.669286  5920 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:20.669320  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:20.670781  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:20.671229  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:20.671764  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:20.671998  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:20.672456  6047 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:20.683001  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:20.718844  2309 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:20.719285  2307 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.719856  2306 raft_consensus.cc:1275] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:20.726897  5757 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:20.727535  6113 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.729583  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 122486us
I20260709 13:00:20.730902  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 602) took 1367 ms. Trace:
I20260709 13:00:20.731353  1613 rpcz_store.cc:276] 0709 13:00:19.363859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.995079 (+631220us) service_pool.cc:224] Handling call
0709 13:00:19.995378 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.478473 (+483095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.478531 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.479244 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.627795 (+148551us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:20.680581 (+ 52786us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.680809 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.695835 (+ 15026us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54003b7754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:20.695884 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.730499 (+ 34615us) raft_consensus.cc:1685] finished
0709 13:00:20.730610 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.730747 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96279,"prepare.queue_time_us":53386,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":51121,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":457,"spinlock_wait_cycles":977962880,"thread_start_us":147793,"threads_started":1,"wal-append.queue_time_us":248607}
W20260709 13:00:20.735455  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.736305  1540 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:20.731949  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:20.691869  6106 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.462532  1614 rpcz_store.cc:276] 0709 13:00:18.481112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.482801 (+  1689us) service_pool.cc:224] Handling call
0709 13:00:18.483238 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.241659 (+758421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.241689 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.242111 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.864864 (+622753us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:19.864935 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.865049 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.341937 (+476888us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:20.460900 (+118963us) raft_consensus.cc:1685] finished
0709 13:00:20.460970 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.461400 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767274,"raft.queue_time_us":773082,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10535,"spinlock_wait_cycles":9277184,"thread_start_us":622236,"threads_started":1,"wal-append.queue_time_us":702319}
I20260709 13:00:20.696743  5918 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.768900  2307 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
W20260709 13:00:20.768932  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.728278  6113 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:20.734643  5944 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:20.762275  5782 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:20.727537  5757 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.782882  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 603) took 1410 ms. Trace:
I20260709 13:00:20.783707  6009 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.785706  6110 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.788120  6029 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:20.788877  6028 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.789580  1608 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:20.790227  6053 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.791154  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:20.792750  1684 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:20.782965  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 175140us
I20260709 13:00:20.792621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:20.801131  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:20.801667  1682 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:20.801896  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:20.797380  6009 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.809329  1609 raft_consensus.cc:1275] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:20.811297  1538 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:20.697788  5939 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.818835  1610 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:20.803081  5823 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.796697  1607 rpcz_store.cc:276] 0709 13:00:19.364089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.995305 (+631216us) service_pool.cc:224] Handling call
0709 13:00:19.995647 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.401581 (+405934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.401681 (+   100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.402857 (+  1176us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.531285 (+128428us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:20.667962 (+136677us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.760860 (+ 92898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.768673 (+  7813us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.768730 (+    57us) raft_consensus.cc:1685] finished
0709 13:00:20.768752 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.774110 (+  5358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78882,"prepare.queue_time_us":141476,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":138067,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12188,"thread_start_us":532951,"threads_started":2,"wal-append.queue_time_us":327774}
I20260709 13:00:20.811743  6009 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.832748  2309 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:20.826656  5823 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.845552  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:20.848670  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 166424us
I20260709 13:00:20.849695  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:20.850478  1684 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.853657  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.830360  5999 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:20.856667  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 124810us
I20260709 13:00:20.858052  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:20.847054  1686 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:20.861346  1532 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:20.865674  6055 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.866472  1537 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.866564  6055 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.868072  5833 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:20.868956  5833 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:20.872671  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:20.885033  1536 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.887563  6091 consensus_queue.cc:1059] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:20.888873  6091 raft_consensus.cc:3055] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:20.888545  5944 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:20.889310  1612 raft_consensus.cc:3060] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:20.890239  5944 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:20.890717  5944 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.889365  6091 raft_consensus.cc:740] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:20.893415  6091 consensus_queue.cc:260] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:20.894649  6126 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:00:20.894848  6091 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:20.856281  5823 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.891884  5944 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.901638  5944 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:20.906087  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.917906  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.918848  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.926260  1609 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:20.918931  1608 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:20.931876  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:20.937793  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 795905us
I20260709 13:00:20.941593  5757 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.948565  1579 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:20.946394  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:20.920923  6037 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:20.960371  6051 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.924764  5918 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:20.829746  6053 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.944025  5757 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:20.989691  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:20.965559  6047 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:20.991961  5918 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.956987  6104 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:20.851063  6028 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:20.997913  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 67450.8us
I20260709 13:00:20.844645  6029 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.043653  6029 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:21.012853  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 189390us
I20260709 13:00:20.997081  1540 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:21.002620  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 73113.6us
I20260709 13:00:20.992525  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:21.015154  6053 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:21.004977  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 50237.2us
I20260709 13:00:21.020519  1610 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:21.018357  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:21.026854  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 76024.1us
W20260709 13:00:21.033686  6123 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:00:21.069249  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:21.037986  5524 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:21.040084  6090 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:20.999114  6030 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:00:21.044785  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 110766us
I20260709 13:00:21.045497  6047 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:21.048827  5686 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:20.986683  6113 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:21.051576  6028 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:21.053614  6068 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.057514  6055 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:21.058621  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 118480us
I20260709 13:00:21.063344  2301 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:21.065944  1607 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:21.067400  6009 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.066973  1684 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:20.932492  5944 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:00:20.974563  6051 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:21.081254  5686 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.097579  5651 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:21.066664  1612 raft_consensus.cc:1275] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:00:21.104807  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53074 (request call id 6) took 1312 ms. Trace:
W20260709 13:00:21.114964  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49541.7us
I20260709 13:00:21.115916  1608 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.112603  1612 pending_rounds.cc:85] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 11
I20260709 13:00:21.117877  1612 pending_rounds.cc:107] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:00:21.118278  1612 raft_consensus.cc:2889] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.113250  1616 rpcz_store.cc:276] 0709 13:00:19.787513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.679919 (+892406us) service_pool.cc:224] Handling call
0709 13:00:21.098550 (+418631us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400320854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c51735 00007f8d5dc11d29 00007f8d571901d4 00007f8d57190162 00007f8d57190091 00007f8d5719000c 00007f8d5718f2c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:21.099316 (+   766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283395840}
I20260709 13:00:21.086627  6053 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:00:21.105845  6051 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.093855  6090 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.127799  1581 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.145501  1579 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:21.128203  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.145645  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:21.183415  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61098.3us
I20260709 13:00:21.184178  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:21.184937  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 144192us
I20260709 13:00:21.186375  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:21.186842  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 105270us
I20260709 13:00:21.178853  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2463) took 1143 ms. Trace:
I20260709 13:00:21.187645  1612 rpcz_store.cc:276] 0709 13:00:20.035732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.614188 (+578456us) service_pool.cc:224] Handling call
0709 13:00:20.614619 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.176260 (+561641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.178765 (+  2505us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:21.188947  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 99983.2us
W20260709 13:00:21.191794  5263 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:00:21.190201  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 610) took 1528 ms. Trace:
I20260709 13:00:21.103490  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:21.123936  6091 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:00:21.196810  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 72234us
I20260709 13:00:21.192293  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1911) took 1706 ms. Trace:
I20260709 13:00:21.198516  5932 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:21.199273  5932 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.198765  1611 rpcz_store.cc:276] 0709 13:00:19.485376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.555512 (+1070136us) service_pool.cc:224] Handling call
0709 13:00:20.556142 (+   630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.592772 (+ 36630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.592808 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.593390 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.825053 (+231663us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:20.825097 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.825172 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.191978 (+366806us) raft_consensus.cc:1685] finished
0709 13:00:21.192005 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.192195 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8369,"raft.queue_time_us":1545,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":19998,"thread_start_us":231133,"threads_started":1,"wal-append.queue_time_us":491904}
I20260709 13:00:21.201941  5932 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.202440  5890 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:21.203088  5890 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:21.204373  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 87443.2us
I20260709 13:00:21.205039  5962 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:21.205444  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.145525  5524 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.204492  6068 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.205538  5962 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.179592  6113 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:00:21.194965  1610 raft_consensus.cc:606] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.192638  6037 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:21.199210  6093 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.226631  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:21.222306  6127 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
I20260709 13:00:21.199415  6105 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:21.220510  5644 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:21.208349  5809 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:21.193436  1615 rpcz_store.cc:276] 0709 13:00:19.545348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.573429 (+1028081us) service_pool.cc:224] Handling call
0709 13:00:20.573920 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.574621 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:20.765083 (+190462us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.072891 (+307808us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.072929 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:21.072960 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.073011 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.073147 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74204,"prepare.queue_time_us":79312,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":12575,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":1382,"thread_start_us":356176,"threads_started":2,"wal-append.queue_time_us":407087}
I20260709 13:00:21.225298  6009 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:21.218742  5833 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.214812  5524 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.244240  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:21.249938  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.254566  1611 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:00:21.257302  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47808.3us
W20260709 13:00:21.258351  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.242853  6068 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:21.268620  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 84498.7us
I20260709 13:00:21.269603  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:21.245345  5644 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:21.244163  6105 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.245061  6037 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:21.248154  5944 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:21.266835  1653 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:21.268427  1612 raft_consensus.cc:3055] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:21.287341  1612 raft_consensus.cc:740] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:21.282446  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 86699.5us
W20260709 13:00:21.292513  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.280612  5644 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:21.319960  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 66211.8us
W20260709 13:00:21.281244  5920 consensus_meta.cc:287] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
W20260709 13:00:21.310003  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 208032us
I20260709 13:00:21.287086  5944 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.326330  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 56873.2us
I20260709 13:00:21.280002  6009 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:21.335790  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:21.324047  6138 raft_consensus.cc:2804] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:00:21.340881  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 130694us
I20260709 13:00:21.333024  5944 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.285290  6093 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:21.347648  2309 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.347515  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.345844  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.342142  6068 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:21.339679  5890 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:21.359146  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 144696us
I20260709 13:00:21.354206  1612 consensus_queue.cc:260] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.320441  5962 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.263067  5686 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.351470  6138 raft_consensus.cc:697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:21.365401  6105 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.380512  6105 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:21.348309  5823 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.391992  1612 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:21.389139  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 183781us
I20260709 13:00:21.356592  6068 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.395936  1507 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.397178  1614 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.365335  5890 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:21.368126  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:21.358762  6090 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.406454  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.412786  1507 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:21.412760  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 48990.8us
I20260709 13:00:21.417728  5918 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.419744  6056 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:21.420351  6056 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:21.421437  6056 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.423161  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:21.424643  2304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56290 (request call id 666) took 1689 ms. Trace:
I20260709 13:00:21.425320  6028 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:21.426087  5662 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.397747  6068 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:21.438429  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 106363us
I20260709 13:00:21.403201  5890 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.445892  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.451457  5890 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.454555  5920 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:21.457084  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
W20260709 13:00:21.426980  6106 consensus_meta.cc:287] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.002s
I20260709 13:00:21.457731  1609 raft_consensus.cc:606] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.436757  6028 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:21.458104  1609 raft_consensus.cc:614] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:21.456825  6138 consensus_queue.cc:237] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.457087  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.436751  6090 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:21.477476  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 79887us
I20260709 13:00:21.488468  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.395360  6037 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.497161  1537 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:21.497716  1537 pending_rounds.cc:85] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 5
I20260709 13:00:21.498049  1537 pending_rounds.cc:107] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:21.498330  1537 raft_consensus.cc:2889] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.503707  1507 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.506834  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:21.465826  6047 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:21.459326  6009 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:21.501288  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:21.517205  1612 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:00:21.425067  2304 rpcz_store.cc:276] 0709 13:00:19.722437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.722614 (+   177us) service_pool.cc:224] Handling call
0709 13:00:19.723042 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.747816 (+ 24774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.747862 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.752255 (+  4393us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.590825 (+838570us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b180043bd60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:20.818746 (+227921us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:20.922497 (+103751us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.949910 (+ 27413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.956515 (+  6605us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.221583 (+265068us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:21.396442 (+174859us) raft_consensus.cc:1685] finished
0709 13:00:21.396470 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.411422 (+ 14952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17830,"prepare.queue_time_us":26961,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":41453,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":5158,"spinlock_wait_cycles":78607872,"thread_start_us":220401,"threads_started":1,"wal-append.queue_time_us":1321045}
I20260709 13:00:21.480235  6090 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.458889  6028 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:21.524803  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 68560.6us
I20260709 13:00:21.526680  1612 pending_rounds.cc:85] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 10
I20260709 13:00:21.532516  1612 pending_rounds.cc:107] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:00:21.532855  1612 raft_consensus.cc:2889] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.532999  1537 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:21.527792  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:21.537911  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:21.538498  1609 raft_consensus.cc:606] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.538789  1609 raft_consensus.cc:614] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:21.544020  1541 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:21.544418  6145 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:21.545414  5823 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.546562  6028 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:21.548786  6086 log.cc:927] Time spent T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:21.525467  6068 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.552942  5939 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.554338  6068 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.556991  6009 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:21.557574  6009 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.557998  6009 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:21.561745  5757 consensus_meta.cc:287] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 13:00:21.516575  5662 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:21.526152  6090 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.527812  6047 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.569787  6047 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.571270  5520 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:21.571728  5520 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.573956  5932 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:21.516887  6143 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:00:21.574437  5932 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:21.575510  5932 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:21.583037  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50304.7us
W20260709 13:00:21.583436  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 123528us
W20260709 13:00:21.588454  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 87281.6us
I20260709 13:00:21.605402  1613 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:21.576435  6056 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:21.583791  5651 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:21.560073  5890 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.564117  5644 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:21.617870  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 129561us
I20260709 13:00:21.624821  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:21.618261  5918 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:21.651741  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:21.636791  5932 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.656033  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:21.657900  1689 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:21.614187  5520 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.660071  5520 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.660477  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:21.661221  1686 raft_consensus.cc:2393] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:21.662130  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:21.662766  1683 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:21.641042  6145 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:21.668926  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 211996us
I20260709 13:00:21.675734  5644 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:21.677732  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.678536  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 018c063cc2cf4b4aa09be2b8d7067e61: Illegal state: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:21.679517  1682 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:21.681272   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:21.681203  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:21.663977  5944 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:21.683861  1608 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:21.683996   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:21.689886  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.693089  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60100.8us
I20260709 13:00:21.687786  5944 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.688905  1686 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.684511  6090 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.685200  5918 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.697558  1581 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.689404  6138 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:21.650760  6156 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:21.700704  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:21.704085  6156 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.704609  6156 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:21.705245  6155 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:21.706414  5918 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.707316  6138 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.708874  6145 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.705090  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:21.702951  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 126652us
I20260709 13:00:21.704610  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:21.713301  1533 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.714491  5263 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:21.721506  6109 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:21.729166  5263 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:21.729647  5263 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.729450  6109 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.731011  6105 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:21.731393  6105 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.731668  6109 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.712411  5686 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.721495  5948 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:21.735030  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 2f362fd54b48400ba3c9fb8b8a405a93: Illegal state: Replica 0f82bbd9193f4b71a0c17a0357cf0ce9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:21.728259  1582 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:21.737457  6044 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:21.737772  2309 raft_consensus.cc:1240] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:21.703876  6037 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:21.719101  6141 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 13:00:21.718241  6104 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.715934  6090 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.707895  6138 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.752079  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:21.753325  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:21.755292  2304 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:21.755240  1614 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:21.757642  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.760708  5890 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.761766  6138 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.764542  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:21.765115  1608 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:21.765491  6140 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:21.756284  5948 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.739706  6030 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:21.770279  6030 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:21.770639  6030 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:21.771597  5948 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:21.772603  6163 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:00:21.775033  6158 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.775549  6158 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.777613  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.778244  2305 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
W20260709 13:00:21.783072  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.745366  6037 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:21.727597  5962 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:21.785050  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:21.792285  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 87309us
I20260709 13:00:21.795687  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:21.796516  1687 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:21.798996  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:21.799569  1609 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.771543  6030 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.804378  6165 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:00:21.804828  6030 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.806057  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:21.808511  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:21.808727  6140 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:21.809122  1614 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:21.810052  6158 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:21.810904  6160 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:21.812520  5782 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:21.750763  5918 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:00:21.820912  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:21.821678  1611 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.786144  5686 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.839586  1608 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:21.839812  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.744831  6105 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.843374  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:21.844617  1653 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:21.846145  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:21.846789  1690 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:21.848963  1689 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:00:21.849375  1689 pending_rounds.cc:85] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 13:00:21.849677  1689 pending_rounds.cc:107] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:00:21.849951  1689 raft_consensus.cc:2889] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.847357  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:21.850924  1681 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.845525  5686 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.854099  1533 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:21.854245  5686 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.802336  6047 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:21.857589  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet cf01b8ced3144c0289c4f428fc24ead7: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:00:21.838846  6051 consensus_meta.cc:287] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:00:21.867761  1687 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
W20260709 13:00:21.877609  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.869467  5263 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.870430  6051 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:21.885636  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57722.4us
I20260709 13:00:21.794294  5999 consensus_queue.cc:1048] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:00:21.862210  6053 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:21.861958  6109 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.910902  1609 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:21.902580  1610 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:21.913003  1613 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:21.912425  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:21.916141  1684 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:21.916349  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 103721us
I20260709 13:00:21.914397  1507 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.927186  6161 consensus_queue.cc:1048] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:21.929657  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:21.930150  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:21.930888  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.931340  2302 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:21.927350  1582 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.931048  2305 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.932365  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:21.930280  2307 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.932915  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.932386  6093 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:21.933802  6093 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.934119  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:21.934620  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.934734  6093 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:21.936091  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:21.933046  1533 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
W20260709 13:00:21.940724  6131 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:21.941550  6051 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:21.942198  6103 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:00:21.943300  6103 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:21.943688  6103 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:21.944355  1685 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.944651  6103 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.945191  6053 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.945611  6053 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.950251  6162 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:21.951040  6109 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.951524  6169 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:21.951962  5263 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.924451  6167 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.954242  6167 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.954928  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:21.956588  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54371.3us
I20260709 13:00:21.957432  1656 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:21.959540  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.960572  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:21.961148  1687 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.961037  6009 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.962134  1683 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:21.964365  6053 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.966455  6053 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:21.967103  6171 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:00:21.969264  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.970067  6167 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.971113  5939 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.971550  5939 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.971815  5939 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.973649  2304 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:21.974610  2301 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:21.976081  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.940299  2307 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:21.977483  2308 raft_consensus.cc:2393] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:21.977741  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:21.978042  2310 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:21.981243  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:21.870486  6037 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.905149  6145 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:00:21.983754  6174 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.984440  6174 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:21.985978  6109 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:21.988353  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:21.925631  6105 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.996286  1681 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:21.995349  1687 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:21.987499  5263 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:21.998852  6053 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.000829  6140 raft_consensus.cc:2764] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:22.000854  6169 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.005012  6169 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:21.999490  1611 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 17.
I20260709 13:00:21.986829  6174 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:22.022334  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 57236.2us
W20260709 13:00:22.023489  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 64030.3us
I20260709 13:00:22.031173  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:22.031488  1507 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.032075  2308 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:22.035414  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.035284  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:21.997932  6009 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:21.979342  6028 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:22.027616  6176 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:22.041788  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.026368  6109 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:22.028570  6044 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.040577  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:22.043938  1581 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:21.989116  5944 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:22.001724  6171 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:00:22.024281  5962 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:22.038112  5263 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:22.049151  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:22.053885  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 77907.2us
I20260709 13:00:22.057428  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:22.057320  2301 raft_consensus.cc:2376] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12. Re-sending same reply.
I20260709 13:00:22.044951  6176 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.061821  5520 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.062907  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 8bbf1e27410e4984b453b68cb9b08bd6: Illegal state: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:22.037660  5918 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:00:22.065578  6103 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.065842  2301 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:22.068848  6171 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:22.060055  6091 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:22.049147  6147 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:22.071233  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.047266  6174 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:22.091104  6154 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:22.091574  6174 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.091482  5939 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.092695  6174 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.093721  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.095088  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.095513  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:22.047004  6167 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.071326  6028 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.096287  6167 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:22.096837  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54475.3us
I20260709 13:00:22.097018  5939 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.097713  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:22.098120  6028 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:22.098421  6167 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.098759  6028 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.099251  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:22.081115  5520 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.100571  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.101022  2301 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:22.101716  5520 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.102027  2302 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:22.021199  6156 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.085407  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:22.047492  6109 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:22.087117  2308 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:22.087594  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.075455  6009 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:22.075701  5757 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:22.128775  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.086567  5833 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.129372  5757 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.129688  5833 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.130133  6113 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:22.130728  6113 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.131374  6156 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:22.131713  5833 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.089920  5263 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.132125  1612 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:22.131639  6113 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.089957  5651 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:22.095769  2310 raft_consensus.cc:2393] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:22.135466  5782 raft_consensus.cc:2764] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:22.081911  5918 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:22.136137  5918 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.084677  6171 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.139842  1541 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:22.140250  1541 pending_rounds.cc:85] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 8
I20260709 13:00:22.140502  1541 pending_rounds.cc:107] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:22.140719  1541 raft_consensus.cc:2889] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:22.105786  1609 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:22.087462  6044 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:22.106694  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:22.124806  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:22.060994  6055 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:22.127571  1653 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:22.103152  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:22.157701  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.158279  1607 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:22.153429  5757 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.154934  6068 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.156666  6176 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.173414  1612 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:22.152762  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.158318  1538 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:22.091701  6154 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.153033  6044 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.109107  6109 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.105468  6091 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:22.171307  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:22.174122  1540 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:22.175006  1532 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:22.109030  6175 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:00:22.176923  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.142827  5833 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.178781  6176 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.079150  5962 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.181039  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:22.180482  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 85070.5us
W20260709 13:00:22.188625  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 88515.4us
I20260709 13:00:22.177333  6171 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.167965  6169 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.173249  6028 raft_consensus.cc:2804] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:22.199890  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:22.200593  1612 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:00:22.189637  5524 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:22.206544  5918 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.207862  5918 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:22.208783  6184 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:22.197150  5833 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.188488  5757 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:00:22.212209  6187 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:22.215323  6109 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.217680  6171 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.218186  6109 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.204691  6169 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.224953  6037 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.224752  6091 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.226305  6169 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.228077  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:22.229151  6175 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.234431  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.241918  1507 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.249511  1612 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:22.249982  1507 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.203588  5524 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.203791  6028 raft_consensus.cc:697] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:22.254034  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 51241.5us
I20260709 13:00:22.252758  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:22.255189  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:22.258572  1610 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.268365  1581 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:22.276895  6186 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:00:22.312320  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.277346  5890 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:22.259606  5939 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:00:22.252244  6169 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:22.329107  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59585.3us
I20260709 13:00:22.260347  5809 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:22.280535  6105 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:22.296998  6129 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:00:22.246806  6167 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:22.318473  1684 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:22.339763  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:22.318885  1540 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:22.227897  6154 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.313253  6093 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.320302  6028 consensus_queue.cc:237] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.321390  6044 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.322130  6143 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.322882  5833 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.310906  6174 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:22.329175  1689 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:00:22.332826  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.360378  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.266275  5932 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.337015  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:22.339762  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:22.355230  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:22.363139  1612 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:22.330909  6169 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.367640  6169 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.367902  1540 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:22.332593  5809 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.329421  5890 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.368934  5809 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:22.369041  5890 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:22.348568  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.370429  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.348510  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:22.371527  1609 raft_consensus.cc:2368] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 16. Current term is 17.
W20260709 13:00:22.362488  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.372438  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.373050  1541 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.362761  6143 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.354844  6106 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:00:22.366564  5932 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.378790  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.381695  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.379859  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.383586  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:22.384615  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:22.386054  1532 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:22.382735  6093 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:22.386482  5962 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:22.397109  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 82609.8us
I20260709 13:00:22.387336  1608 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 16. Current term is 17. Ops: [15.11-16.12]
I20260709 13:00:22.387395  5932 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.399571  1607 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.402612  1609 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:22.413872  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.416709  1532 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:22.413585  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.419015  1537 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.421216  2301 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:22.421288  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:22.422961  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:22.430760  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.399461  6055 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:22.359512  5524 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.432977  1541 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:22.441740  1540 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:22.442370  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:22.440138  1607 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:22.446184  1610 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:22.408918  6093 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:22.447599  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.447779  1507 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.449710  1611 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:00:22.450171  1609 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:22.455545  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.442003  1504 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38377 timed out after 1.781s (SENT) [suppressed 24 similar messages]
I20260709 13:00:22.399938  6044 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:22.459489  6176 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:22.446511  5833 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.460513  6183 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:22.464445  5782 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:22.467239  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.468760  6093 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.432973  6174 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.455659  6009 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.432520  5948 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:00:22.474032  6143 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:22.477099  6200 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:00:22.479053  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59767.9us
I20260709 13:00:22.443852  6055 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.489418  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:22.494920  1537 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:22.446252  6175 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:22.471837  5890 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.497951  6176 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:22.519277  1609 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
W20260709 13:00:22.564288  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 79562.8us
I20260709 13:00:22.569739  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:22.508399  5833 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.528882  6167 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.527637  5524 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.529060  6055 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.569520  6147 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.580592  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.531467  5782 consensus_queue.cc:1243] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:00:22.604431  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 141182us
I20260709 13:00:22.531248  6175 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:22.608784  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 60156.7us
I20260709 13:00:22.523581  6174 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:22.606002  6191 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:00:22.607486  5757 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:22.618677  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.614355  6192 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:00:22.624763  1532 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:22.621675  1656 leader_election.cc:400] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:22.625451  1656 leader_election.cc:403] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:22.612321  2276 leader_election.cc:400] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 16. Current term is 17.
W20260709 13:00:22.679698  6201 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:00:22.681267  6202 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:22.682062  5833 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.681161  5890 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:22.684898  6197 log.cc:927] Time spent T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:22.689772  6174 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:22.692027  6103 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.003s
W20260709 13:00:22.692910  6204 log.cc:927] Time spent T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:00:22.693521  6175 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:22.694818  6178 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.351s	user 0.002s	sys 0.002s
I20260709 13:00:22.635901  6176 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:22.709300  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 102726us
I20260709 13:00:22.710668  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:22.712065  1532 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
W20260709 13:00:22.714795  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.612134  6167 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.616938  6009 consensus_queue.cc:1048] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:00:22.719187  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:22.724354  6151 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:22.726286  6203 log.cc:927] Time spent T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:22.716605  6175 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11.
I20260709 13:00:22.716631  6028 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.741910  6028 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:22.752928  6207 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 13:00:22.753582  5809 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.716885  6183 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:22.755941  6183 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.757778  6068 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:22.758231  6068 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.759147  6068 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.759882  6167 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.757196  6183 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:22.761034  6198 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.418s	user 0.010s	sys 0.004s
I20260709 13:00:22.765182  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:22.765830  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 323856us
W20260709 13:00:22.766286  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 148478us
I20260709 13:00:22.768424  1541 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:22.747646  6209 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:00:22.792707  6154 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:22.793222  6154 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.772533  6068 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.771569  5782 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:22.781060  6171 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:22.802003  6028 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:22.813750  6180 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:22.826905  6180 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.827941  6180 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.829239  6180 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.831235  6028 consensus_queue.cc:1048] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:22.833077  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.833801  1538 raft_consensus.cc:3060] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:22.836848  1533 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:22.838316  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.839917  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.840898  1540 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:22.844556  5809 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.844820  6090 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:22.825582  6169 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.846918  6090 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:22.847631  6169 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:22.824604  5686 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:22.850222  5686 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:22.851037  5686 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.852105  5686 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.853009  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:22.854101  1538 raft_consensus.cc:2468] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:22.854128  6180 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:22.856312  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.860581  6180 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.862264  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:22.861485  6180 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.893580  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.872555  6151 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:22.900506  1534 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:22.908882  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:22.910953  2306 raft_consensus.cc:2368] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11.
I20260709 13:00:22.917747  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.918982  1535 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:22.919018  6212 log.cc:927] Time spent T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
W20260709 13:00:22.936475  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.941013  1686 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:22.948740  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.912376  6151 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:22.968626  6218 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:22.970713  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.971464  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.971683  1535 raft_consensus.cc:1240] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:22.971899  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.973165  1536 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:22.974334  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.975925  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.977656  1535 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:22.980018  6055 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:22.981091  1537 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:22.981585  1656 connection.cc:256] RPC call timeout handler was delayed by -2.0313279249999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:00:22.972590  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.985354  1541 raft_consensus.cc:2410] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:22.988407  1539 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:22.990403  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:22.993252  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:22.993597  6210 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:00:22.993724  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.992725  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:22.994122  1681 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:22.994316  1538 raft_consensus.cc:3060] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.994619  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:22.995360  1689 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:22.996754  1682 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:22.997191  1687 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:22.997550  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:22.998251  1686 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:22.998507  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:22.997206  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:22.999886  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.000020  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.000521  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.001248  1684 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:23.002787  1685 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:23.003158  1685 pending_rounds.cc:85] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 13:00:23.003043  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.003464  1685 pending_rounds.cc:107] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:23.003702  1685 raft_consensus.cc:2889] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:23.004405  1536 raft_consensus.cc:1275] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:23.006572  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.007340  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:23.008018  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.004184  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.009057  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.009338  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.010085  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.010432  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.011123  1686 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:23.011036  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.004489  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.012830  1684 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:23.014209  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:23.018319  6211 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:00:23.011915  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.021801  1686 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:23.022838  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.012102  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.023610  1686 raft_consensus.cc:2393] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:23.005173  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.023942  1682 raft_consensus.cc:2410] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:00:23.006211  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:23.006016  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.025007  6180 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:23.005460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.026938  1504 leader_election.cc:400] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11.
I20260709 13:00:23.026669  1688 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:23.029366  1504 leader_election.cc:403] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:00:23.027288  1541 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:23.029703  1538 raft_consensus.cc:2468] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:23.032550  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:23.032847  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 86700.5us
I20260709 13:00:23.023934  1684 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:23.004707  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:22.982184  6055 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.033723  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.034863  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.035003  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.035410  1685 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:23.035635  1689 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:23.036252  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.036346  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.037002  1689 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:23.037292  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.037671  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.038331  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.038621  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.041842  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.042593  1681 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:23.043694  1681 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:23.044423  6175 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:23.045297  6225 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:00:23.046808  6037 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11.
W20260709 13:00:23.049242  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.049311  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.049934  6154 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.050983  6154 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:23.056332  1681 raft_consensus.cc:3055] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:23.056769  1681 raft_consensus.cc:740] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:23.026345  6028 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:23.057569  1681 consensus_queue.cc:260] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.058327  6028 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.059084  1681 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:23.068248  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.068900  1614 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:23.072597  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.073334  1611 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:23.074303  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:23.075232  1689 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:23.078342  1682 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:23.078935  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.080440  1535 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:00:23.095224  1616 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:23.077075  1686 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:23.100768  1681 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:00:23.101256  1681 pending_rounds.cc:85] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 13:00:23.101548  1681 pending_rounds.cc:107] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:00:23.101826  1681 raft_consensus.cc:2889] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:23.102648  1607 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:23.104435  1581 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:23.105123  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.105693  1614 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:23.105805  1607 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.848188   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.111743  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.113206  1614 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:23.076706  6106 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.121644  1607 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:23.124161  1614 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:23.130144  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:23.132983  1607 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:23.132416  1507 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:23.136809  1616 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:23.140128  6028 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:23.138227  5918 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:23.141556  5918 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.141729  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:23.141956  5918 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:23.146257  6056 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:23.147426  5890 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:23.147500  1507 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:23.148269  5890 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:23.148780  1507 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:23.149495  5890 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.151490  6171 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:23.151579  6174 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:23.152205  6174 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:23.152120  6171 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:23.153154  6174 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.154043  6171 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:23.163877  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 307582us
I20260709 13:00:23.169795  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:23.170451  1539 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.173223  1611 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:23.175570  1541 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:23.125468  6106 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.180363  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:23.168967  6044 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.174206  5757 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.219981  1539 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:23.222070  1612 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 16. Current term is 17. Ops: [15.11-16.12]
I20260709 13:00:23.180660  6147 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.222390  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 118054us
I20260709 13:00:23.230907  1581 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:23.171068  6056 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:00:23.234614  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 67782us
I20260709 13:00:23.233316  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:23.208966  6176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.011s
I20260709 13:00:23.173473  6037 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:00:23.174312  6175 consensus_queue.cc:1059] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:00:23.180081  6009 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:23.206903  6044 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.256708  5686 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.257689  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:23.251930  6176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.011s
I20260709 13:00:23.263221  5809 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:23.192672  5833 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:23.230706  5757 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:23.268020  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.267125  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:23.232347  5962 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:23.276629  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.198369  6028 consensus_queue.cc:1059] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:23.209112  6090 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:00:23.302930  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.310182  1609 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:23.235476  6147 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:23.298498  6236 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:00:23.318575  5757 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.320984  1685 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
W20260709 13:00:23.342046  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 106778us
I20260709 13:00:23.342861  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:23.331751  1612 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
W20260709 13:00:23.346593  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 172275us
I20260709 13:00:23.347772  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:23.349611  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.304999  6047 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:23.367740  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.369426  1609 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:23.353910  1582 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:23.354120  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.320590  6175 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:23.359099  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.306143  6106 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.377596  1681 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:23.410030  1681 pending_rounds.cc:85] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 8
I20260709 13:00:23.410358  1681 pending_rounds.cc:107] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:23.410679  1681 raft_consensus.cc:2889] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:23.368675  1616 raft_consensus.cc:2468] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:23.419087  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.419348  1609 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:23.424091  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.428056  1614 raft_consensus.cc:1240] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:23.352586  5757 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:23.301146  5686 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:23.458976  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.437040  1688 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
W20260709 13:00:23.418422  6186 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:00:23.360574  6047 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:23.486384  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 138691us
I20260709 13:00:23.409442  6175 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:23.506187  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49252.4us
W20260709 13:00:23.506775  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.508438  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.508585  1616 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:23.355288  5263 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:00:23.455439  5757 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:23.511410  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 143670us
I20260709 13:00:23.515476  1613 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:23.454012  6224 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:23.507550  6109 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.505219  6047 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:23.528836  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.525718  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.516001  6009 raft_consensus.cc:3055] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:23.452732  6106 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:00:23.516794  6103 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:23.523337  5757 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:23.535408  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 181609us
I20260709 13:00:23.536108  1614 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:23.530117  5890 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:23.531092  6009 raft_consensus.cc:740] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:23.557664  6175 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.543283  6103 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:23.528044  6224 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.530687  6109 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:23.642680  6241 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:00:23.589968  6238 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:00:23.718393  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.722033  6255 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.722666  6255 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.724946  6255 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:23.726187  6243 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.020s
I20260709 13:00:23.726760  5686 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:23.729466  6009 consensus_queue.cc:260] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:23.782506  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 279551us
I20260709 13:00:23.794342  1611 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:23.794771  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:23.797870  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:23.765288  6044 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.820034  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:23.835526  6154 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.784s	user 0.014s	sys 0.006s
I20260709 13:00:23.836628  2307 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:00:23.836812  1537 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:23.837009  2307 pending_rounds.cc:85] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 11
I20260709 13:00:23.837304  2307 pending_rounds.cc:107] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:00:23.837579  2307 raft_consensus.cc:2889] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:23.845351  6253 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:23.782698  5890 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.847642  5890 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:23.850108  6242 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:23.852735  6175 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:23.859779  5757 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.861578  6028 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:23.862033  6028 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.862393  6028 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:23.862826  5918 consensus_meta.cc:287] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.008s
I20260709 13:00:23.863350  5918 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.864576  6233 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:23.791658  6256 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:23.866838  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:23.870273  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.755256  6255 consensus_queue.cc:1048] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:00:23.874362  1615 raft_consensus.cc:1240] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:23.876598  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.880983  1532 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:23.887009  1608 raft_consensus.cc:2393] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:23.890699  5999 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:23.891348  5999 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.890867  5757 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.894848  5999 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.896548  6105 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:23.897122  6105 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.899145  6105 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:23.880545  6103 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.902140  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:23.902851  1535 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:23.832336  6147 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.859390  6047 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.877043  6109 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:23.881026  6009 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:23.949921  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.957289  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 168871us
I20260709 13:00:23.887645  5962 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:23.904001  6257 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:23.904251  6256 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:23.963536  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.913452  6056 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.965281  1608 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:23.922030  6260 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.964442  5644 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.989830  6109 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:23.990610  6109 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.991248  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.991864  1681 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:23.992666  6256 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.995327  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.972308  6257 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.996713  6263 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.969144  5962 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:23.997226  6263 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:23.985415  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:23.999297  6263 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:23.999836  1608 raft_consensus.cc:2410] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:23.989919  6224 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:24.001643  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.001941  6109 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.004837  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.006117  6028 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.008109  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.008519  1688 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:00:24.006817  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.007398  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.010706  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.010982  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:23.976665  6056 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.012748  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.013549  6028 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.014310  6056 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.014400  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.015075  1687 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:24.021818  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.022982  1686 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:24.023247  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.024075  1685 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 10: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:24.029551  1687 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
W20260709 13:00:24.031352  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.032456  2304 raft_consensus.cc:1275] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:24.033620  1682 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:24.040455  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:24.042481  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.030966  6143 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:24.045718  6143 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.050598  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.051469  1682 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.025368  5644 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.090430  6047 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:23.986542  6260 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:24.093422  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.093796  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.094105  1687 raft_consensus.cc:2376] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13. Re-sending same reply.
I20260709 13:00:24.094473  1609 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:24.095428  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.096185  1609 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 9.
I20260709 13:00:24.109700  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.116448  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.117537  1687 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:24.118906  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.119611  1535 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:24.115392  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.121470  1685 raft_consensus.cc:2393] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:24.132702  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.133630  1537 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:24.137135  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.138222  1685 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:24.142150  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.143062  1541 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:24.050001  6028 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:00:24.111217  6047 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.148962  1539 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:24.153934  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.154817  1540 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
W20260709 13:00:24.155808  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 187425us
I20260709 13:00:24.140276  5918 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.151160  6268 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.166339  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.167169  1537 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:24.170486  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.157908  6143 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.178823  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.180080  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.180080  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.181089  1540 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:24.183048  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.184108  1609 raft_consensus.cc:2393] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:24.153467  6047 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.186839  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.188014  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:24.189287  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:24.190006  1537 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:24.187295  5644 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.202304  2307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56294 (request call id 629) took 1190 ms. Trace:
I20260709 13:00:24.202988  2307 rpcz_store.cc:276] 0709 13:00:23.027610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.030296 (+  2686us) service_pool.cc:224] Handling call
0709 13:00:23.053857 (+ 23561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.837981 (+784124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.201959 (+363978us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400475754. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:24.202220 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799445248}
I20260709 13:00:24.212666  1609 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:24.220500  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.216723  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:24.215274  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:24.188069  6264 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.224354  1540 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:24.169688  6270 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:00:24.232401  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.232640  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.241032  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:24.201300  6263 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:24.248180  6244 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:24.171911  6268 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.248834  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.250806  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34880 (request call id 2201) took 1082 ms. Trace:
I20260709 13:00:24.251545  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.253793  1690 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:24.254422  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.255452  1684 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:24.264416  6264 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.268893  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2472) took 1036 ms. Trace:
I20260709 13:00:24.273881  6255 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:24.215080  5917 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:24.276556  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.357170  1681 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:24.277215  6047 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.278512  1533 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:24.278633  5962 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.230881  6260 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.279193  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2474) took 1024 ms. Trace:
W20260709 13:00:24.284363  6243 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:24.287259  1609 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:24.295073  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:24.351229  1613 rpcz_store.cc:276] 0709 13:00:23.232899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.233050 (+   151us) service_pool.cc:224] Handling call
0709 13:00:24.268682 (+1035632us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003f3254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:24.268811 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284835200}
I20260709 13:00:24.352927  1683 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:24.320019  1537 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:24.292626  6143 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.242755  6256 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:24.350502  1690 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.355813  1540 raft_consensus.cc:2468] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:24.296540  1532 rpcz_store.cc:276] 0709 13:00:23.167992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.168097 (+   105us) service_pool.cc:224] Handling call
0709 13:00:24.250555 (+1082458us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400308254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:24.250711 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609409280}
I20260709 13:00:24.368862  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.359488  6261 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:24.371672  1615 rpcz_store.cc:276] 0709 13:00:23.254621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.254760 (+   139us) service_pool.cc:224] Handling call
0709 13:00:23.874128 (+619368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.877822 (+  3694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.278969 (+401147us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54001798d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:24.279131 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349829888}
I20260709 13:00:24.370728  1682 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:24.373385  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.296005  6105 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.292939  6244 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.384182  1684 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:24.424950  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 129945us
I20260709 13:00:24.418793  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.350775  6263 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.419746  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:24.424031  1690 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.420589  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:24.421464  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:24.376852  6175 consensus_meta.cc:287] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.524s	user 0.002s	sys 0.009s
W20260709 13:00:24.434489  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 196019us
I20260709 13:00:24.434739  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:24.435738  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:24.425057  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:24.437451  1540 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:24.425380  5263 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:24.430893  1681 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:24.438347  5263 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.438807  5263 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:24.364580  6218 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:24.444022  1687 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:24.444389  1687 pending_rounds.cc:85] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 13:00:24.444610  1687 pending_rounds.cc:107] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:24.444895  1687 raft_consensus.cc:2889] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:24.418217  6259 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.360467  6091 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:00:24.382241  5999 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:24.448951  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.441361  1690 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:24.450098  1684 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:24.451658  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.456239  1537 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:24.457767  1537 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:24.459371  1537 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:24.423803  6256 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.365132  5917 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.443822  5944 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:24.468616  1686 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:24.469317  1532 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:24.483893  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.428607  6105 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.461531  6255 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:24.461745  6261 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:24.443657  5962 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:00:24.530563  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.426542  6143 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.475365  5944 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.545202  5263 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.546516  1681 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:24.517100  6175 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:24.463198  5999 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.451556  6218 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.525406  6090 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.456296  6259 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.589522  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:24.525720  6028 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:24.564193  6270 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.591727  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 118281us
I20260709 13:00:24.609917  5263 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.566763  5944 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:24.571705  6158 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.618059  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:24.618901  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 376309us
I20260709 13:00:24.609397  6174 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:24.628289  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52700 (request call id 606) took 1733 ms. Trace:
I20260709 13:00:24.628880  1533 rpcz_store.cc:276] 0709 13:00:22.895145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.895286 (+   141us) service_pool.cc:224] Handling call
0709 13:00:22.895612 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.359263 (+1463651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.627968 (+268705us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400075654. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:24.628198 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3180031744}
I20260709 13:00:24.523247  6244 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.652621  6244 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:24.653133  6260 consensus_queue.cc:1175] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" responder_term: 9 status { last_received { term: 7 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:24.657207  5917 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.661478  6257 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:24.633487  6274 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:00:24.622545  6158 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.671393  6158 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.636694  6175 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:24.676997  6175 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.679155  6175 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:24.679769  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 243998us
I20260709 13:00:24.608690  6247 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:00:24.614970  6256 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.682574  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:24.683393  5263 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:24.638453  6277 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:00:24.608893  6272 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:00:24.602166  6090 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.686502  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:24.581772  6261 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:24.640185  6279 log.cc:927] Time spent T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:00:24.641655  6143 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.646041  6218 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.646740  6268 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.648566  5999 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.649034  6264 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.649190  6105 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.649228  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.528851  6263 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.611405  6270 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.683773  5263 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.718924  5263 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:24.718940  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.609774  6028 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.695297  1616 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:24.693436  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.726096  1532 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:24.697691  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:24.699651  1690 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:00:24.690999  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.726951  1534 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:24.727303  1535 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
W20260709 13:00:24.706419  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.729506  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.730502  1533 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:24.679876  6175 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:24.693919  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 210144us
I20260709 13:00:24.741098  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.734535  1690 pending_rounds.cc:85] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 7
I20260709 13:00:24.737241  5263 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.690063  6261 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.746924  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.688207  6090 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.689009  6250 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:24.743316  1690 pending_rounds.cc:107] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:00:24.749272  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.755237  1690 raft_consensus.cc:2889] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:24.759196  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.760089  1535 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:24.762387  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.714406  6091 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:24.666781  6109 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:24.769399  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.771168  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.720033  6264 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:24.730116  6257 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:24.802631  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:24.803496  1533 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:24.808637  1656 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.765409  6261 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:24.772652  6287 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.793390  6175 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:24.810104  6267 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:24.806744  6256 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:24.816445  6281 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:24.806568  6250 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:24.793023  6091 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.821300  5962 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:24.828177  6261 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:24.810986  6257 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.845660  6257 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.846887  6028 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.849006  6250 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.852845  6270 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.824766  6287 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.853621  5944 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.855371  6287 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.855680  5944 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:24.831758  6268 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:24.866659  1533 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:24.826198  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:24.808030  6264 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.827589  6293 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:24.837167  6009 consensus_meta.cc:287] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.877s	user 0.011s	sys 0.002s
W20260709 13:00:24.874148  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 145146us
I20260709 13:00:24.871881  6028 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:24.874994  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 225858us
I20260709 13:00:24.879805  1685 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:00:24.880163  1685 pending_rounds.cc:85] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 7
I20260709 13:00:24.880401  1685 pending_rounds.cc:107] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:00:24.880646  1685 raft_consensus.cc:2889] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:24.873168  6288 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.054s	user 0.005s	sys 0.000s
I20260709 13:00:24.878006  6028 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.884590  6028 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.868345  5962 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.873190  6247 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:24.886904  6299 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:24.887470  6091 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:24.878752  6264 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:24.892093  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:24.873281  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 47185.5us
I20260709 13:00:24.898547  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.906657  6264 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:24.907730  6264 consensus_queue.cc:1048] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:24.908627  1656 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:24.909663  6264 raft_consensus.cc:2804] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:24.910126  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.915475  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 1981) took 1646 ms. Trace:
I20260709 13:00:24.915879  1610 rpcz_store.cc:276] 0709 13:00:23.268905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.269041 (+   136us) service_pool.cc:224] Handling call
0709 13:00:23.269296 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.269583 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.269608 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.270084 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.718652 (+1448568us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b18000231a0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:24.819836 (+101184us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:24.819875 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.819940 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.898961 (+ 79021us) raft_consensus.cc:1685] finished
0709 13:00:24.898981 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.915405 (+ 16424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6027,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2978,"spinlock_wait_cycles":9390848,"thread_start_us":101013,"threads_started":1,"wal-append.queue_time_us":1560658}
I20260709 13:00:24.918987  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.919436  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:24.920409  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:24.921003  2304 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:24.920959  2307 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:24.932641  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.939574  1533 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:00:24.941365  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.942003  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.918998  6176 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:00:24.915410  6255 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.945712  6255 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:24.948555  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.949512  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.929502  6218 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.948683  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.950336  6218 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:24.947994  1534 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:24.915529  6287 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:24.953985  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.910214  6264 raft_consensus.cc:697] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.929255  6009 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:24.963424  1534 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:24.953444  6306 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:24.960568  6311 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:00:24.959956  6009 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.941009  6296 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:00:24.977437  6009 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:24.977588  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.978206  6296 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:24.978327  1539 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:24.978629  6296 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:24.980604  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:24.988919  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 75035.7us
I20260709 13:00:24.994419  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.995443  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:24.942582  6305 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:24.979662  6296 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.019263  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55612 (request call id 793) took 1028 ms. Trace:
W20260709 13:00:25.017933  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.006611  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.027580  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:24.997237  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.057132  1610 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:25.007026  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:24.967829  6218 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:25.016285  6286 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
I20260709 13:00:25.055012  1688 rpcz_store.cc:276] 0709 13:00:23.990580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.991355 (+   775us) service_pool.cc:224] Handling call
0709 13:00:23.991671 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.008979 (+ 17308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.019034 (+1010055us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54002a58d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:25.019206 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37996416}
I20260709 13:00:24.997733  6287 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:00:25.005970  6259 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.031577  6037 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:00:25.066493  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 71497.8us
I20260709 13:00:25.082856  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:25.070885  6308 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:25.068722  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.086239  6282 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:25.086717  6282 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.087072  6282 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.078008  6151 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.088696  6151 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.091091  6151 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.080811  6293 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.073443  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.092314  1536 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:25.000887  5962 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.081493  6224 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.094416  6224 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.028777  6250 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.009452  5263 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.015674  6268 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.100719  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:25.102177  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:25.104658  1536 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:25.108534  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.109393  1684 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
W20260709 13:00:25.108536  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 151254us
I20260709 13:00:25.116076  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.112360  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.122752  1504 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.122776  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.123811  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.124826  1532 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:25.124868  2307 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:24.996379  6306 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:00:25.128557  1540 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:25.119881  1506 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:25.131554  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.131661  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.132426  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.133435  6109 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:25.133754  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.134958  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:25.098640  6296 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:25.144696  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.143378  2302 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:25.147910  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:25.150866  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.152468  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.119971  6259 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:25.107424  6265 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.008891  6264 consensus_queue.cc:237] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.154940  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.106962  6068 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.092007  6293 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.129212  6176 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:25.131382  6262 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:25.131158  6090 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:25.168351  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2213) took 1004 ms. Trace:
I20260709 13:00:25.139525  6167 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:25.170470  1541 rpcz_store.cc:276] 0709 13:00:24.163658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.168765 (+  5107us) service_pool.cc:224] Handling call
0709 13:00:24.169519 (+   754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.184617 (+ 15098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.184651 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.215233 (+ 30582us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.583971 (+368738us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:24.584020 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.584089 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.015686 (+431597us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:25.162764 (+147078us) raft_consensus.cc:1685] finished
0709 13:00:25.162788 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.168279 (+  5491us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8566,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":6990,"spinlock_wait_cycles":11968768,"thread_start_us":335360,"threads_started":1,"wal-append.queue_time_us":560173}
I20260709 13:00:25.175285  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.120656  6250 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.179931  2276 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:25.163810  6259 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.168099  6171 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:25.168591  6068 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.167398  6262 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:25.170428  6090 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:25.208408  6090 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.209093  5890 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.204547  6259 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.214151  6293 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.214566  6262 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:25.207417  6218 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:25.152455  6151 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:25.171252  5917 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:25.147964  6311 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:25.148353  6009 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.202420  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:25.219081  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 43906.1us
I20260709 13:00:25.181054  6224 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.166184  6028 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:25.218008  6319 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:25.232785  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:25.237179  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.207705  6294 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:25.238662  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1873) took 1083 ms. Trace:
I20260709 13:00:25.217998  6293 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.239061  1685 rpcz_store.cc:276] 0709 13:00:24.151619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.157783 (+  6164us) service_pool.cc:224] Handling call
0709 13:00:24.158070 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.888497 (+730427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.234699 (+346202us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400119c54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:25.234912 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657988352}
I20260709 13:00:25.240899  6293 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.242146  6028 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.242802  1687 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:25.242858  6293 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.227208  5917 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.253837  5917 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.256798  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.227905  6047 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.263134  1607 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:25.266820  6287 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:25.268015  6028 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.268543  6028 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.268927  6009 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.269518  6047 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.270685  6028 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.271495  6047 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.260372  6315 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.260106  5999 consensus_queue.cc:1059] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:00:25.240305  6294 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.275188  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:25.284029  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 925218us
I20260709 13:00:25.285493  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.285298  6282 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.288045  5263 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:25.288496  6250 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.289075  6250 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:25.289410  6250 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.289758  6250 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:25.290179  6047 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:25.290719  6047 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.264489  6109 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:25.292536  6147 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:25.292713  6047 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.293087  6147 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.295145  6147 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.297637  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:25.298815  5962 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:25.299028  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:25.299301  5962 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:25.299638  1537 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.299932  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.300210  5962 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.299639  1540 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:25.305482  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.306232  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.310438  1537 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:25.312717  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:25.316635  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:25.286864  6310 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 13:00:25.316365  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.320353  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.321929  1686 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:25.326822  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.324846  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.330261  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.330366  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.331796  5263 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:25.332167  5263 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.332600  5263 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.333372  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.334645  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:25.274741  6294 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.335654  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.336215  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.333492  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.342005  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:25.342613  1690 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:25.331372  1686 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:25.336436  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.314220  6311 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:25.331308  6272 raft_consensus.cc:2764] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:00:25.333910  6147 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:25.317984  6091 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:00:25.319818  6259 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.409247  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.409958  1686 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:25.380851  1690 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
W20260709 13:00:25.381733  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65220.1us
I20260709 13:00:25.340515  5644 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:25.413121  5644 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.416431  5644 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.422165  1685 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:25.422410  6259 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.381711  6090 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.413601  6176 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.425684  6090 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.429376  1686 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:00:25.433338  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:25.438344  6318 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:00:25.440150  6321 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:25.441098  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.441999  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.443185  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.443321  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:25.443845  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.381886  6311 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.337757  5944 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:25.337142  6109 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:25.345247  6257 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:25.372167  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.463117  1687 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:25.404342  6287 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:25.368786  1582 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.411167  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.444312  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:25.403323  5263 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.408455  6147 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.461602  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.458360  6311 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.473723  5263 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.458240  5944 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:25.477455  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66343us
I20260709 13:00:25.478279  1506 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.495054  1506 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:25.470547  6147 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.471277  5524 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.502470  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.546382  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:25.501842  6287 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:25.549469  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 181571us
I20260709 13:00:25.504159  5948 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.473568  5917 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.551995  1507 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.554307  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.544343  6266 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:25.562578  1686 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:00:25.568828  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.569705  1687 raft_consensus.cc:2393] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:25.574679  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:25.576879  1685 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:25.577569  5890 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:25.552910  6257 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:25.581972  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.582819  1682 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:25.595327  5944 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.598137  6344 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:25.598711  6344 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:25.599529  6344 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:25.600787  6333 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:00:25.604197  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.605433  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.605991  1688 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:25.607177  1688 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:25.607502  1688 pending_rounds.cc:85] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 4
I20260709 13:00:25.607709  1688 pending_rounds.cc:107] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:25.607913  1688 raft_consensus.cc:2889] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:25.608520  6329 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:00:25.611681  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.559516  6109 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:25.627036  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 285873us
I20260709 13:00:25.628000  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.629828  6037 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.560824  6090 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:00:25.568158  6174 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:00:25.631417  6323 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 13:00:25.645850  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:25.646476  1612 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.646889  6294 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.648983  6294 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.650552  1682 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:00:25.645978  6331 log.cc:927] Time spent T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:00:25.658610  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 2490) took 1750 ms. Trace:
I20260709 13:00:25.643940  6282 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.659010  1607 rpcz_store.cc:276] 0709 13:00:23.907911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.908054 (+   143us) service_pool.cc:224] Handling call
0709 13:00:23.908354 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.263712 (+1355358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.658393 (+394681us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400178ed4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:25.658552 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115484928}
I20260709 13:00:25.675746  6337 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:00:25.668771  1612 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:25.659154  1581 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:25.673069  6266 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:25.698010  6270 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:25.674746  6336 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:25.698848  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.698701  6270 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.699249  6336 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:25.700722  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49607.5us
I20260709 13:00:25.701066  6270 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.674947  1506 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:25.702711  1507 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:25.703400  6270 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:25.675627  6271 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:25.704406  6348 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:25.704487  6271 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.705230  6348 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:25.703989  6169 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:25.678622  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.715412  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.716265  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.757179  1539 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:25.757421  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:25.757395  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:25.758689  1685 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.760143  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:25.766206  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 110982us
I20260709 13:00:25.769022  1541 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:25.653689  6147 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:25.773177  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 114194us
I20260709 13:00:25.715732  6068 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.652490  6262 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.775843  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:25.780483  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.781105  1533 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:25.781890  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:25.780067  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:25.783625  1535 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.657696  6250 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.757400  6169 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:25.790690  1540 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:25.795693  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:25.760423  5644 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.713589  6257 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.787492  6342 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:25.698770  6266 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.811748  6342 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.824728  6342 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.802228  6336 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.799847  5944 consensus_queue.cc:1059] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:00:25.936403  6271 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:25.953502  1535 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:25.859854  6169 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:25.953512  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:25.955588  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:25.937047  6334 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.964320  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:25.967460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:25.968279  1690 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:25.902148  6286 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:00:25.975219  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:25.861804  6336 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:25.977295  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 355194us
I20260709 13:00:25.953276  6223 raft_consensus.cc:3055] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:25.976440  1685 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:25.987587  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:26.012526  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:25.984932  6336 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.989223  6223 raft_consensus.cc:740] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:25.998389  5917 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.032024  6352 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:26.035064  6347 log.cc:927] Time spent T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:00:26.034817  6223 consensus_queue.cc:260] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:25.997946  6103 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:25.972182  6334 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.035300  6352 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:26.055235  6349 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:00:26.040848  6103 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.057369  6360 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:26.057976  6360 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.041239  6352 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.067271  6346 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.068074  6346 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.027436  6336 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:26.070775  6103 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.072542  6360 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:25.986219  5962 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:00:26.033793  6345 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:00:26.095991  6352 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:26.033784  6343 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.175s	user 0.005s	sys 0.000s
W20260709 13:00:26.034430  6353 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:25.801993  6348 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.111320  1607 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:26.080844  5644 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:26.075515  6351 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:00:26.117592  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 257573us
I20260709 13:00:26.125468  1690 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:26.039727  6147 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.119964  6223 raft_consensus.cc:3060] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.161981  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.170943  1579 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:26.176975  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 171107us
I20260709 13:00:26.182785  1579 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.180440  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:26.171869  6350 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.185096  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.187239  1579 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.180027  6360 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:26.188496  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.184011  6047 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.200117  6359 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:26.200850  6352 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.207005  6336 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.207664  6262 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.186285  6337 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:00:26.188408  6147 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:26.198796  6287 consensus_meta.cc:287] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.001s
I20260709 13:00:26.201509  6357 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.210280  1579 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.192716  6346 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.237555  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.202772  5644 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.267094  1579 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.268169  6346 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.269059  6346 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:26.269507  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.270943  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.273111  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.274364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.275588  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.276196  1614 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:26.278057  1614 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:26.280104  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:26.280659  6371 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:00:26.281348  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.282640  6334 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.285287  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.286494  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:26.286798  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.290238  1613 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.245728  6359 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.293205  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.297535  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.243377  6287 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:26.376643  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:26.378058  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.379251  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.379871  1612 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:26.380667  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:26.381443  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.381771  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.382157  1611 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13.
I20260709 13:00:26.382829  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.382879  1609 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:26.383425  1614 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:26.384359  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.385696  1609 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:26.386936  1609 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:26.391563  6342 consensus_meta.cc:287] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.002s
I20260709 13:00:26.394253  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:26.420737  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:26.449134  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 675926us
I20260709 13:00:26.450700  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:26.505736  1614 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:26.511971  1613 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:26.513013  1609 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:26.483481  6311 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:26.392202  6342 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.470800  6009 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:00:26.568257  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 117620us
I20260709 13:00:26.574520  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.581377  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.567739  6311 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:26.583293  1610 raft_consensus.cc:1240] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:26.576134  6330 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 1.158s	user 0.009s	sys 0.000s
I20260709 13:00:26.568826  6336 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.586865  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.590758  6167 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.593724  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.588377  6055 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.586258  6009 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:26.582209  6264 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:26.587117  6311 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.615954  6296 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.624173  1539 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:26.627276  1535 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:26.618345  6266 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:26.617961  6264 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:26.634708  6259 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.641001  6293 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.641721  6293 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.640426  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.644309  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.644539  6028 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.645071  6028 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.621196  6009 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.646256  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.629498  6380 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.633575  6266 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:26.630823  6296 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.648326  6259 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.656672  6266 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.657276  6380 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.672539  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1887) took 1111 ms. Trace:
I20260709 13:00:26.654798  6293 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.660491  6377 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.648959  6382 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.660750  6009 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.663983  6028 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.657589  6381 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.665426  6259 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.665096  6296 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.683841  5263 raft_consensus.cc:3055] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:26.666445  6342 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.684504  5263 raft_consensus.cc:740] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:26.673345  1681 rpcz_store.cc:276] 0709 13:00:25.561544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.614907 (+ 53363us) service_pool.cc:224] Handling call
0709 13:00:25.615227 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:25.625033 (+  9806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.625065 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:25.625588 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:00:25.716429 (+ 90841us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800372700. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:25.858962 (+142533us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:25.943188 (+ 84226us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.666837 (+723649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.666913 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.666961 (+    48us) raft_consensus.cc:1685] finished
0709 13:00:26.671865 (+  4904us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.672454 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":511230,"prepare.queue_time_us":102911,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3026,"raft.queue_time_us":519113,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":15431,"spinlock_wait_cycles":24789376,"thread_start_us":351333,"threads_started":2,"wal-append.queue_time_us":448437}
I20260709 13:00:26.685424  5263 consensus_queue.cc:260] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.686340  5263 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:26.658502  6167 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:00:26.678242  6293 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.704056  1616 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:26.704581  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 53898.1us
I20260709 13:00:26.706532  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.688539  6009 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:26.710626  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.715942  2307 raft_consensus.cc:1275] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:00:26.716454  2307 pending_rounds.cc:85] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 8
I20260709 13:00:26.716724  2307 pending_rounds.cc:107] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:00:26.717012  2307 raft_consensus.cc:2889] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.718708  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.690758  6028 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.726579  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.690253  5917 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:00:26.728240  2309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.721794  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.657511  6264 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.730233  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.745193  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.748829  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.684303  6382 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:26.757112  6383 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:26.760340  6379 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.760977  6379 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.731243  5524 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.766805  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:26.769340  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.769958  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.709733  6293 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.755126  6367 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:26.775388  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64530.9us
I20260709 13:00:26.777127  2276 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13.
W20260709 13:00:26.778098  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 131925us
I20260709 13:00:26.778466  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:26.778774  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:26.777446  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 53667.4us
I20260709 13:00:26.767153  6264 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.750186  6296 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:00:26.791548  6381 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:26.792907  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:26.793728  6296 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:26.794257  6296 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.794696  6296 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.795447  6382 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.796023  6387 consensus_queue.cc:1059] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:26.784390  6367 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:26.798110  6266 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.798413  6367 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.799816  6367 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.789309  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:26.793792  6374 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:00:26.800593  6380 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.801261  6224 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:26.801424  6183 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:26.801786  6293 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.801988  6183 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:26.771404  6379 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.802423  6183 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:26.805480  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:26.731683  6028 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.801520  6380 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:26.809212  6380 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:26.809599  6380 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:26.810073  6028 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.786164  6231 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:26.810397  6380 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.812073  6379 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:26.801700  6224 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:26.812638  6379 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.813808  6266 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.813938  5524 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.814451  5263 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:26.814776  6379 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.813083  6224 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:26.814954  5263 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:26.813758  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.817703  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.801816  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.818861  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.814579  5524 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.820013  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.820302  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.830731  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:26.828310  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 805998us
I20260709 13:00:26.786832  6294 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.816498  6380 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.865796  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.869868  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:26.870517  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:26.871114  1689 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.875175  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.877113  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.823601  6293 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:26.889648  1681 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:26.874243  6379 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:26.898087  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 66345us
I20260709 13:00:26.897015  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.896396  6378 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:26.903088  5263 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.875365  6056 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.907053  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:26.879848  6382 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:26.874503  6305 raft_consensus.cc:3055] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:26.905973  6378 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:26.899426  6341 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:26.883944  6028 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.918607  5524 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:26.920680  6183 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.922861  6183 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.864406  6311 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.925753  6311 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:25.859251   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.932826  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.933602  1610 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:26.932427  6341 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.901319  6388 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:26.938402  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:26.939015  1684 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:26.913687  6305 raft_consensus.cc:740] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:26.903939  6387 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:26.940646  1682 raft_consensus.cc:1240] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:26.908316  6296 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.935206  6293 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:26.941293  1689 raft_consensus.cc:2468] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:26.923626  6224 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.912709  6266 consensus_queue.cc:1059] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:26.943094  1433 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 12 to 15, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:26.914136  6056 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.948840  1688 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:26.938287  6382 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:26.911620  6381 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:26.948364  6176 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:26.962113  6381 consensus_queue.cc:1243] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:26.962410  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:26.963325  6392 raft_consensus.cc:3055] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:26.963747  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:26.964524  1684 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:26.966856  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.964412  6176 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:26.957363  6382 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:26.970609  6176 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.971375  6272 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:26.971995  6272 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.972934  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:26.974188  6272 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:26.975374  6311 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:26.975814  6311 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:26.976682  6311 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:26.977907  6311 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.978574  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:26.981457  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 2024) took 1114 ms. Trace:
I20260709 13:00:26.981904  1608 rpcz_store.cc:276] 0709 13:00:25.866858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.969568 (+102710us) service_pool.cc:224] Handling call
0709 13:00:25.970488 (+   920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.981881 (+ 11393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.981913 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.981954 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:25.981983 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.981226 (+999243us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54003b7254. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:26.981276 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.981397 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25361792}
I20260709 13:00:26.971932  6176 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:26.985692  6224 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:26.991907  1608 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:26.963735  6392 raft_consensus.cc:740] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:26.971825  6382 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.000857  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:27.010243  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.007822  6341 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.005992  6266 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:27.002720  6387 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:27.017529  6266 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:27.019510  6266 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.022076  6392 consensus_queue.cc:260] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.023365  6392 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.018362  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.032512  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.033308  1683 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:27.034806  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.038431  6387 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:26.967129  6305 consensus_queue.cc:260] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.042961  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2243) took 1250 ms. Trace:
I20260709 13:00:27.044736  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.043447  1533 rpcz_store.cc:276] 0709 13:00:25.793038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.793210 (+   172us) service_pool.cc:224] Handling call
0709 13:00:25.813591 (+ 20381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.813798 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:26.963643 (+1149845us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b180021c400. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d5c6433c7 00007f8d58c559a7 00007f8d58c650bf
0709 13:00:26.963783 (+   140us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.042627 (+ 78844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.042690 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:27.042739 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.042803 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.042907 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1329,"prepare.queue_time_us":30145,"prepare.run_cpu_time_us":9039,"prepare.run_wall_time_us":89306,"spinlock_wait_cycles":18386304,"thread_start_us":215591,"threads_started":2}
I20260709 13:00:27.057680  2275 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:27.040337  6271 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:27.054663  5918 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:27.051771  6055 consensus_queue.cc:1175] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "631fb66c0070402b8f78fd74633dae6f" responder_term: 11 status { last_received { term: 9 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:27.072402  6393 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.074435  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.076676  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:27.080920  6068 raft_consensus.cc:2804] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:27.081585  6068 raft_consensus.cc:697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:27.082463  6068 consensus_queue.cc:237] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.083243  6250 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.064235  6271 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:27.084453  6271 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.077641  6296 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.093766  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:27.095474  5962 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:27.095990  5962 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:27.080412  6393 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.151746  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.169334  1540 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:27.104615  5962 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.152344  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:27.153812  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.173578  2308 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:27.173708  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.173905  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:27.156394  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.162273  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.164292  1686 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:27.164741  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.175585  1690 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
W20260709 13:00:27.164983  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 72069.3us
I20260709 13:00:27.165665  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.176950  1683 raft_consensus.cc:2393] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 11: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:27.177524  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.167202  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.172475  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.178732  1533 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:27.178990  1540 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 15.
I20260709 13:00:27.184702  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.185461  1540 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 7.
I20260709 13:00:27.189494  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.189648  1656 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:27.190095  1536 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:27.188834  1535 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:27.162544  6265 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.158010  6356 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.192569  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:27.262264  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 69786.9us
I20260709 13:00:27.263522  1685 raft_consensus.cc:2410] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:00:27.173238  6028 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.168951  6250 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.183691  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.198114  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:27.290110  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 100551us
I20260709 13:00:27.290130  1533 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:27.291410  6009 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:27.291926  6255 consensus_queue.cc:1048] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:27.201952  1641 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:33233 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:33233 timed out after 15.000s (SENT)
I20260709 13:00:27.206151  6266 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.193204  6264 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.207475  6305 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.211503  6342 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:27.208863  6271 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.250846  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.324255  1538 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:27.259349  6393 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.169435  6382 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:27.193972  2308 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:27.265105  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:27.265612  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:27.327924  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 270307us
I20260709 13:00:27.268606  1612 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:27.266824  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:27.273555  1681 raft_consensus.cc:1240] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:00:27.275738  1683 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:27.274597  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.278373  6341 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:27.278913  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.279456  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.281479  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.281281  6028 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.286350  5918 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:27.265573  6056 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.292042  6009 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:27.291348  1433 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 8, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 8 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:27.174480  6388 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.277253  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.303305  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:27.315604  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.290012  6250 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.292142  6296 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:27.328056  1607 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.276467  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.331012  1610 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13.
I20260709 13:00:27.261231  6265 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.329615  1688 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:27.334656  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.338187  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.378533  1538 raft_consensus.cc:2468] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:27.339130  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.344952  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.345070  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.348702  1536 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 13: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:27.382205  1688 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:00:27.382670  1688 pending_rounds.cc:85] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 13:00:27.382927  1688 pending_rounds.cc:107] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:00:27.383196  1688 raft_consensus.cc:2889] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.369737  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.384559  1687 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.385066  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.385300  1686 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:27.323666  6272 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:27.391788  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.373368  6388 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.393059  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.394316  6388 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.378695  1681 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:27.338739  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.391886  6272 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.398756  6306 raft_consensus.cc:493] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.399258  6306 raft_consensus.cc:515] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.400367  6174 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.400867  6174 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.402773  6174 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.403225  6174 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:27.403625  6174 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:27.409797  1688 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:00:27.410531  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.399940  6272 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.411517  1689 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.413120  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.419620  1686 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:27.424924  1687 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:27.385996  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.390317  1607 raft_consensus.cc:2468] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:27.426577  6028 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.429036  6266 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.430276  6009 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.369463  6176 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:27.432698  6176 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.435312  6176 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.338361  6392 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.436313  6392 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.439576  6392 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.374241  6287 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.440789  1689 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:27.440680  6287 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.442914  6287 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.445919  1687 raft_consensus.cc:1240] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:27.366659  6380 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.448748  6380 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.322233  6264 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.338089  6382 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.298813  6356 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.346104  6247 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:27.382344  6406 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:27.480997  1683 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:27.461428  1609 raft_consensus.cc:2410] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:00:27.466581  6403 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:00:27.480911  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:27.463003  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:27.488884  1616 raft_consensus.cc:606] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:27.489337  1616 raft_consensus.cc:614] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.490532  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.451999  6380 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.492969  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:27.491688  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 422304us
W20260709 13:00:27.496241  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.460496  6382 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.458292  6264 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.497339  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.455484  6265 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.498711  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:27.497340  2276 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33617 timed out after 2.023s (SENT) [suppressed 23 similar messages]
I20260709 13:00:27.453931  6271 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.462296  6356 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.469749  6250 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.501156  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.511346  1607 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:27.506398  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.514710  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:27.466488  6247 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.515802  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.516242  1611 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:27.517601  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:27.518399  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:27.519353  2307 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:27.524106  2308 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:27.532684  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:27.537616  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:27.538497  2305 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:27.534055  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:27.540120  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 248157us
I20260709 13:00:27.542538  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:27.545722  1579 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:27.546763  6250 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:27.547158  6250 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.547544  6250 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.557214  2276 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13.
I20260709 13:00:27.557744  2276 leader_election.cc:403] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.558555  2276 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:27.564008  6315 raft_consensus.cc:2804] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:27.564563  6315 raft_consensus.cc:697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:27.565424  6315 consensus_queue.cc:237] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.566279  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:27.566809  1616 raft_consensus.cc:606] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:27.567154  1616 raft_consensus.cc:614] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.569892  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:27.570431  1616 raft_consensus.cc:606] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:27.573137  6174 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.574002  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.574810  6250 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.575623  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:27.576924  1616 raft_consensus.cc:606] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:27.577474  1616 raft_consensus.cc:614] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.580528  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:27.580938  6306 leader_election.cc:290] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.581658  1616 raft_consensus.cc:606] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:27.582229  1616 raft_consensus.cc:614] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.582813  6380 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:27.575758  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:27.583333  6380 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.583475   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:27.584020  6380 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.584690  6247 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.586208  6389 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13.
I20260709 13:00:27.594653  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.595506  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.554808  6169 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:27.597993  6169 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.598515  6169 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.594960  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.598302  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.601284  6389 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:27.562144  6393 consensus_queue.cc:1059] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:00:27.602110  6393 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:27.602512  6393 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:27.602845  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.603675  6389 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:27.608768  6264 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:27.609155  6264 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.609500  6264 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:27.611634  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:27.612476  6382 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:27.612843  6382 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:27.613349  6382 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:27.614033  6250 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.612815  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:27.615588  6028 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:27.607641  6380 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.615913  1656 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 13:00:27.619172  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.620913  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:27.621438  2307 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.625484  1613 raft_consensus.cc:1240] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:27.632095  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 235554us
I20260709 13:00:27.634248  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.636068  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.523344  6151 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:00:27.640782  1538 raft_consensus.cc:1240] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:00:27.638433  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.615949  6028 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.631688  6296 raft_consensus.cc:2804] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:27.641597  6409 log.cc:927] Time spent T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.003s
I20260709 13:00:27.603526  6393 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.697064  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:27.687815  6415 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:00:27.688077  6417 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.001s
I20260709 13:00:27.704492   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:27.690593  6369 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.618191  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 13:00:27.711566  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 93464.2us
I20260709 13:00:27.693495  6028 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.715764  1609 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:27.716138  1433 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 4 to 11, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.718685  1433 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 10, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.714663  6263 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:27.728820  6263 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.729301  6263 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:27.742707  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.744818  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.745579  1609 raft_consensus.cc:2393] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:27.745373  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:27.746898  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:27.748098  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.748842  1616 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:27.749253  1686 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:27.750571  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.711067  6296 raft_consensus.cc:697] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:27.758332  2307 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:27.762732  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.763545  1579 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:27.764426  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.765817  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.768440  1532 raft_consensus.cc:1240] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:27.768987  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.739378  6393 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.769845  1689 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:27.770850  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.771157  1684 raft_consensus.cc:1240] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:27.773097  1538 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:27.774925  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.775590  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.775923  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.776612  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.776885  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.777747  1684 raft_consensus.cc:2410] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:00:27.777710  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:27.779373  1532 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:27.780573  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.781131  1535 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 8.
I20260709 13:00:27.781823  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.783012  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.784480  6255 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.785915  6255 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:27.786305  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.789829  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.771582  6264 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:27.792759  6418 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:27.793383  6264 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.793992  6264 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:27.794602  6264 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:27.769580  6250 raft_consensus.cc:2804] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:27.795617  6250 raft_consensus.cc:697] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:27.796684  6416 log.cc:927] Time spent T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:00:27.796614  6250 consensus_queue.cc:237] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.759500  6154 consensus_queue.cc:1059] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:00:27.791366  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.799575  6154 raft_consensus.cc:3055] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:27.799952  6154 raft_consensus.cc:740] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:27.800851  6154 consensus_queue.cc:260] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.802321  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.803525  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.804420  1537 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:27.804625  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.808696  6296 consensus_queue.cc:237] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.714987  6369 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.803834  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.824129  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.824400  1536 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:27.827771  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.829581  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.830404  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.834488  1538 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:27.834127  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:27.777416  6378 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.780058  6379 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.824203  6293 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:27.837687  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:27.825868  6264 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:27.830598  6420 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:27.840974  6009 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:27.848052  6369 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.848819  6255 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:27.851693  6263 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.838107  6379 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.853780  6263 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.853856  6382 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.854417  6379 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.855993  1686 raft_consensus.cc:1240] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:27.857757  1685 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 15: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:27.864714  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:27.891268  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.891116  1538 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:27.871924  6055 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.897397  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:27.901409  1536 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:27.838411  6378 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.928670  6378 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.936175  1540 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:27.920344  6028 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.939611  6028 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:27.898782  6380 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:27.943507  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.922530  6169 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.945917  1539 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:27.947077  1681 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:27.893885  6382 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.948017  6169 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:27.900024  6055 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.950541  6055 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.951659  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:27.952853  1684 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:27.953305  1684 pending_rounds.cc:85] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 13:00:27.953635  1684 pending_rounds.cc:107] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:27.953907  1684 raft_consensus.cc:2889] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.886230  6282 consensus_queue.cc:1059] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:00:27.954808  6282 raft_consensus.cc:3055] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:27.955201  6282 raft_consensus.cc:740] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:27.955305  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:27.956115  6282 consensus_queue.cc:260] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.957594  6282 raft_consensus.cc:3060] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.953249  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:27.956159  1688 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 7.
I20260709 13:00:27.969209  5962 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:27.969969  5962 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:27.971799  6257 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:27.972185  6257 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:27.974942  6257 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.976027  6257 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.981658  5962 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:27.982398  6356 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.002599  6356 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.005290  6356 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.006906  6420 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:28.014984  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 258164us
W20260709 13:00:28.015470  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 181439us
I20260709 13:00:28.016012  6427 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:28.016491  6433 consensus_queue.cc:1059] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:27.994935  6055 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.017467  6427 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:28.017854  6427 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:28.017762  6055 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.018206  6433 raft_consensus.cc:3055] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:28.018671  6433 raft_consensus.cc:740] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:28.018821  6427 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.019933  6427 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.995397  6154 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:28.019608  6433 consensus_queue.cc:260] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:27.995946  5918 consensus_queue.cc:1059] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:27.997135  1433 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 2 to 8, term changed from 7 to 12, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.000604  6342 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:28.001659  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:28.028610  1534 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:28.027490  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.028831  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.043582  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.044274  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:28.050020  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.056248  1538 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:28.062131  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:28.063599  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 204240us
I20260709 13:00:28.068480  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.075724  1538 raft_consensus.cc:2468] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:28.076144  1540 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:28.118232  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.105566  6154 consensus_queue.cc:1059] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:00:28.081079  6315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.020s
W20260709 13:00:28.120571  6315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.008s	sys 0.020s
I20260709 13:00:28.120746  6154 raft_consensus.cc:3055] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:28.020844  6433 raft_consensus.cc:3060] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.121165  6154 raft_consensus.cc:740] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:28.122049  6154 consensus_queue.cc:260] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.123267  6154 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.084955  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.126394  1506 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.020181  6055 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:28.021961  5918 raft_consensus.cc:3055] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:28.127363  5918 raft_consensus.cc:740] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:28.119948  1540 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:28.128285  5918 consensus_queue.cc:260] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.129364  5918 raft_consensus.cc:3060] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:28.130191  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.056209  5962 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:28.131274  6055 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:28.132486  5962 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.089466  6091 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:28.133174  6091 consensus_queue.cc:1243] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:28.093012  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:28.134114  5962 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.134580  5962 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.095041  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.127547  1506 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.048777  6342 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:28.136430  6342 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:28.097510  1539 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:00:28.136852  6342 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:28.137454  6174 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:28.137969  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.139181  6174 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.139472  2308 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:00:28.139604  6174 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.139824  2308 pending_rounds.cc:85] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 9
I20260709 13:00:28.100636  1688 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:28.103477  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.103830  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.140089  2308 pending_rounds.cc:107] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:00:28.144111  2308 raft_consensus.cc:2889] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.056859  6420 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.065932  6250 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:28.083762  6356 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:00:28.115592  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:28.136549  6265 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.099390  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:28.136579  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.185560  6444 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:28.186291  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 49838.3us
I20260709 13:00:28.186129  6444 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.187042  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.147893  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:28.188529  6393 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.189105  6265 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.151005  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.155350  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.161064  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:28.164773  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:28.181005  6423 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:00:28.167618  1610 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:28.196527  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.196513  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.197232  1536 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:28.198285  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.198323  5962 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:28.169633  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.172586  6427 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:28.172812  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:28.158074  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.175624  1532 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:28.181573  2275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.183624  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.183863  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.203464  1534 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:28.204718  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.205812  2308 raft_consensus.cc:2410] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:00:28.212682  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 97315.7us
I20260709 13:00:28.182037  6250 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:28.213879  6250 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:28.212836  6356 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:28.214730  6091 consensus_queue.cc:1059] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:28.216820  1581 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:28.218083  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.218267  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.212662  1433 catalog_manager.cc:5697] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.200634  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.225184  1532 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:28.225106  1581 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:28.226323  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 56818.9us
I20260709 13:00:28.229401  1433 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 12, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:28.232700  5962 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:28.233244  5962 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.233664  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.234064  5962 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.234450  1538 raft_consensus.cc:2376] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12. Re-sending same reply.
I20260709 13:00:28.236744  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.237488  1540 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:28.240252  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.242102  6420 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:28.242735  1433 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.246209  1433 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.248610  6444 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:28.252503  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.254935  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.199965  5932 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:28.258343  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.262629  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:28.228081  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.268860  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:28.271090  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 70577.4us
I20260709 13:00:28.206352  2307 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:28.276674  1653 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:28.287900  1532 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:28.218019  6257 raft_consensus.cc:3055] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:28.217248  6265 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.218225  6423 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.302583  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 25da6efa74464e65b8319c8230d379fc: Illegal state: Replica 0f82bbd9193f4b71a0c17a0357cf0ce9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } }
I20260709 13:00:28.295384  1534 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:28.324288  1539 raft_consensus.cc:2468] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:28.294340  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.222219  6356 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.222117  6433 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.318073  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 55516.3us
W20260709 13:00:28.301568  6381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.066s	sys 0.091s
I20260709 13:00:28.296736  6427 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.296452  6296 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:28.334498  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.335456  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.336273  1684 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:00:28.300012  5917 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.337488  1689 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:00:28.335291  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.350606  1686 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:28.350796  1690 raft_consensus.cc:1240] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:00:28.286978  6446 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:28.300833  6388 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.302673  6257 raft_consensus.cc:740] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.342454  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.270535  6420 raft_consensus.cc:2764] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:00:28.340461  6381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.066s	sys 0.091s
I20260709 13:00:28.341444  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.353984  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.354280  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:28.351840  2301 raft_consensus.cc:1240] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:28.327652  6380 raft_consensus.cc:2764] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:00:28.299167  6342 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.339846  6068 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:28.248649  1433 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 11, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.363552  1504 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.372704  1533 raft_consensus.cc:1275] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:00:28.373099  1533 pending_rounds.cc:85] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 8
I20260709 13:00:28.373334  1533 pending_rounds.cc:107] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:00:28.373575  1533 raft_consensus.cc:2889] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.377333  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:28.378374  1533 raft_consensus.cc:2410] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:28.380548  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:28.389945  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.356961  6388 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:28.330266  6423 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.391570  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.361461  5918 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:28.359253  6296 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:28.358629  6009 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:28.364104  6393 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.360514  6315 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:00:28.346367  6433 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.408248  1539 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:28.385874  5932 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:28.405144  6388 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:28.425381  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 77089.3us
I20260709 13:00:28.400840  6446 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.406481  6420 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:28.403079  6444 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:28.368091  6443 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:28.388993  6068 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:28.445137  1434 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 220) took 36917 ms (client timeout 15000 ms). Trace:
I20260709 13:00:28.446413  6068 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.446538  6433 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:28.455350  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.409749  6454 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:28.433964  6444 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:28.413585  6257 consensus_queue.cc:260] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:28.474633  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 120421us
W20260709 13:00:28.477734  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 75632.1us
I20260709 13:00:28.479224  6257 raft_consensus.cc:3060] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:28.467603  5962 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:00:28.482627  6296 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.448359  6420 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:28.433969  6356 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.478638  6446 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.487329  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.487742  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.488247  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.488348  1689 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:28.493759  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.494342  1686 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:28.488603  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:28.491760  1539 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:28.497051  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.497738  1533 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:28.497162  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:28.501691  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:28.502511  1533 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
W20260709 13:00:28.505251  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.472316  6444 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.533725  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.525521  1608 raft_consensus.cc:1240] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:28.536326  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.537928  6381 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:00:28.538071  6463 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:00:28.540033  5962 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:28.540624  1581 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:28.542094  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.542687  6381 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:28.543040  6461 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:28.543347  6381 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:28.464073  1433 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.544157  6464 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:28.544653  6464 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.545604  6464 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.539965  6466 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:28.545953  1433 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 5 to 10, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.546944  6466 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.546885  6423 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:28.548319  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.547940  6466 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.549125  6445 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:28.549343  6466 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:28.549614  6445 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.550100  6445 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.549926  1433 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 6 to 9, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.553562  6443 consensus_queue.cc:1059] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:28.555023  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64301.3us
I20260709 13:00:28.555302  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.551847  1433 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 5 to 7, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 6 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:28.566457  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.572212  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.559535  6423 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:28.556528  6460 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:28.619485  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 47335.5us
I20260709 13:00:28.621639  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:28.622737  1433 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.565227  6455 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:28.625361  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 294483us
I20260709 13:00:28.634995  2307 raft_consensus.cc:1240] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:28.635190  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.635979  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.636689  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43a3d11aec04f86a107e64e2a5bc263" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.637626  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.596505  6028 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:28.566104  6174 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.619186  6265 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:28.625587  6311 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:28.644547  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:28.645424  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.610513  5948 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:00:28.650522  6174 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.640689  6423 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:28.655169  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:28.643934  6342 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.645570  6265 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.648563  6311 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:28.662092  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 120064us
W20260709 13:00:28.664083  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 91848.1us
I20260709 13:00:28.665410  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.654139  6423 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.655627  6443 consensus_queue.cc:1243] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:28.663404  6296 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:28.668511  1582 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:28.674856  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:28.664215  6265 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:28.664294  6311 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:28.642239  6420 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.676839  1608 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
W20260709 13:00:28.682250  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 115955us
I20260709 13:00:28.672713  6423 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:28.691394  6154 consensus_meta.cc:287] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.003s
I20260709 13:00:28.672904  6342 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:00:28.683866  6250 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:28.445609  1434 rpcz_store.cc:269] 0709 12:59:51.527771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.529443 (+  1672us) service_pool.cc:224] Handling call
0709 13:00:28.444921 (+36915478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:20.896456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:20.897394 (+   938us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:20.897464 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:00:20.897508 (+    44us) tablet.cc:662] Decoding operations
0709 13:00:20.899472 (+  1964us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:20.899591 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:20.899632 (+    41us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:21.208613 (+308981us) tablet.cc:701] Row locks acquired
0709 13:00:21.223162 (+ 14549us) write_op.cc:260] PREPARE: finished
0709 13:00:21.223342 (+   180us) write_op.cc:270] Start()
0709 13:00:21.223507 (+   165us) write_op.cc:276] Timestamp: P: 1783602021223273 usec, L: 0
0709 13:00:21.223555 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:00:21.224363 (+   808us) log.cc:844] Serialized 5950 byte log entry
0709 13:00:21.953006 (+728643us) op_driver.cc:464] REPLICATION: finished
0709 13:00:22.092252 (+139246us) write_op.cc:301] APPLY: starting
0709 13:00:22.092381 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:22.176493 (+ 84112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:22.176618 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:22.703935 (+527317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:22.704288 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:00:22.704348 (+    60us) write_op.cc:312] APPLY: finished
0709 13:00:22.704785 (+   437us) log.cc:844] Serialized 139 byte log entry
0709 13:00:22.704991 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:22.705152 (+   161us) write_op.cc:454] Released schema lock
0709 13:00:22.705226 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:22.705685 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:22.705733 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1930884,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":108138,"apply.run_cpu_time_us":25927,"apply.run_wall_time_us":625814,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":440416,"prepare.run_cpu_time_us":27155,"prepare.run_wall_time_us":518513,"raft.queue_time_us":174544,"raft.run_cpu_time_us":23863,"raft.run_wall_time_us":84206,"replication_time_us":729268,"thread_start_us":586199,"threads_started":4,"wal-append.queue_time_us":363530,"wal-append.run_cpu_time_us":34812,"wal-append.run_wall_time_us":2114891}]]}
I20260709 13:00:28.709582   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:28.755059  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.658771  6472 consensus_queue.cc:1059] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:00:28.713052  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44682.3us
W20260709 13:00:28.692687  6459 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.245s	user 0.004s	sys 0.000s
I20260709 13:00:28.677034  6296 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.750802  6473 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:28.711872  6444 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.712574  6443 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:28.769096  6444 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:28.751689  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45249.3us
I20260709 13:00:28.702514  6388 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.774204  6388 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:28.753798  1610 raft_consensus.cc:1275] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:00:28.700415  6458 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:00:28.782668  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:28.753088  6449 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 13:00:28.712630  5932 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.753464  5918 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:28.779927  6250 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:28.696316  6474 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:00:28.704671  6028 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:28.780493  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:28.787232  5917 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:28.787670  5917 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:28.692181  6445 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.789332  1506 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.792308  5917 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.795240  5917 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:28.797995  6473 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:28.798525  6473 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:28.801286  6450 log.cc:927] Time spent T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:00:28.799597  6473 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:28.809756  6452 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.373s	user 0.002s	sys 0.000s
I20260709 13:00:28.811600  6282 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.812330  6282 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.821347  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.822587  1506 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.822865  6460 consensus_queue.cc:1048] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:28.823274  6055 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.823896  6055 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.824357  6476 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:28.824743  6451 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.387s	user 0.000s	sys 0.002s
I20260709 13:00:28.825569  6454 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:28.825951  6454 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.826516  1686 raft_consensus.cc:1240] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:00:28.826699  6457 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:28.827411  6443 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:28.827286  6457 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.827800  6443 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:28.819974  1582 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:28.831627  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:28.848577  1582 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:28.850615  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:28.851320  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:28.851697  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:28.793747  6265 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.871622  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.871914  1689 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:00:28.871721  1582 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:28.872733  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.874405  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:28.874869  2276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.788038  6028 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:28.875826  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:28.876135  2274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.876713  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:28.877869  1690 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.879926  1684 raft_consensus.cc:1240] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:28.883229  1681 raft_consensus.cc:1240] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:28.883291  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.864494  6464 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:28.897879  1690 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:28.875062  6445 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.901651  1504 leader_election.cc:304] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:28.884290  6471 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:28.878068  6475 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:28.904175  6265 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.899645  5932 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.900532  6461 raft_consensus.cc:2804] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:28.909132  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:28.865015  6474 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:28.881997  6257 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:28.907775  6460 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:28.886345  6478 consensus_queue.cc:1059] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:00:28.905031  6419 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.927742  6169 raft_consensus.cc:2749] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:28.928402  6471 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.826728  6454 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.828620  6443 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.901646  6091 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:28.910187  6342 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:28.919265  6282 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:28.923633  6265 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:28.907001  6444 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:28.907948  6311 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:28.949832  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 48243us
I20260709 13:00:28.965220  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:28.939088  6457 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:28.916347  5932 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.967216  6492 consensus_queue.cc:1059] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:28.986649  6444 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:28.987131  6444 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:28.989596  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.991899  6311 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:28.952677  6466 consensus_queue.cc:1175] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "631fb66c0070402b8f78fd74633dae6f" responder_term: 15 status { last_received { term: 12 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 14. Current term is 15. Ops: [14.8-14.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:28.987957  6444 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.995013  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:28.995568  6444 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.996167  1688 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:00:28.997228  6477 raft_consensus.cc:3055] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:28.997676  6477 raft_consensus.cc:740] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:28.998484  6477 consensus_queue.cc:260] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:28.993367  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:28.933197  6460 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:28.972349  6282 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.004611  1504 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:29.005419  6282 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:28.972910  6423 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.006103  6460 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:28.981593  5932 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:29.007265  6423 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:29.008452  6296 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:29.011164  6257 raft_consensus.cc:3055] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:29.011561  6257 raft_consensus.cc:740] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:29.012676  6443 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.012375  6257 consensus_queue.cc:260] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.013172  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.013772  6257 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.017704  6028 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:29.018996  6485 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:28.982106  2305 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:28.951463  6454 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:29.044376  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.045455  1533 raft_consensus.cc:2393] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:28.961071  1581 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:29.051167  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 90214.2us
I20260709 13:00:29.087445  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.089952  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:29.090763  1533 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.092087  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.093071  1534 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 15: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:29.101643  6491 log.cc:927] Time spent T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:29.095953  6257 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:00:29.106143  6257 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:29.106564  6257 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:29.107400  6257 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.097806  6367 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.110203  6367 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.106292  6381 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:29.121023  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:29.121721  1539 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.044490  6477 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.095080  6474 raft_consensus.cc:2804] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:29.161851  1539 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:29.163194  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:29.133646  6257 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.178026  1539 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:29.177875  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.158298  6474 raft_consensus.cc:697] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:29.175184  6419 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:00:29.174165  6437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.011s	sys 0.009s
W20260709 13:00:29.238029  6437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.011s	sys 0.009s
I20260709 13:00:29.224108  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:29.239622  1687 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:29.228680  6419 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:29.229956  6455 raft_consensus.cc:3055] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:29.193023  6367 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:29.190498  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 265659us
I20260709 13:00:29.239678  6474 consensus_queue.cc:237] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.219355  1533 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:29.254094  1687 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:29.256460  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:29.257191  1683 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:29.258611  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:29.242458  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:29.262589  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:29.263211  1690 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:29.265323  2276 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:29.269065  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:29.241539  6419 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.267994  6499 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.287073  6499 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.267930  6497 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.291052  6497 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.273782  6282 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:00:29.293107  6497 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.259024  6461 raft_consensus.cc:697] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:29.294803  6461 consensus_queue.cc:237] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:29.297681  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.241034  6455 raft_consensus.cc:740] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:29.298959  6455 consensus_queue.cc:260] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.300144  6455 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:29.286139  6388 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:29.309530  6388 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.311650  6388 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:29.268126  6367 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.268261  6462 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.313114  6462 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.313539  6462 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:29.314182  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 45550.5us
I20260709 13:00:29.273092  1539 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:00:29.317991  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 46824.3us
I20260709 13:00:29.319123  1506 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:29.272198  1582 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:29.329521  1686 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:00:29.388895  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 55819.3us
W20260709 13:00:29.389554  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 70506.6us
I20260709 13:00:29.392670  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:29.392802  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 111344us
I20260709 13:00:29.393420  1534 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
W20260709 13:00:29.394870  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 122742us
I20260709 13:00:29.395807  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:29.398833  1682 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:29.403462  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:29.404699  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:29.405272  1541 raft_consensus.cc:3060] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:29.405911  1537 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:29.407666  1540 raft_consensus.cc:1240] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:00:29.408267  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:29.404655  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:29.411716  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:29.272735  6480 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:29.416339  1533 raft_consensus.cc:2368] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13.
I20260709 13:00:29.408811  1686 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:29.421223  5962 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.410753  6356 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.397086  6174 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.497757  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.543504  1535 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 13: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:29.544839  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.546263  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.547964  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:29.549233  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:29.550280  1613 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.551749  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.552830  1538 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:29.268411  5917 consensus_queue.cc:1048] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:00:29.555742  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.556818  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.558326  1607 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:29.393381  6476 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.560984  6068 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:29.561633  2305 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:29.562179  6464 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.552889  6443 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.542970  2275 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:29.562911  6174 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.583985  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.584692  1615 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 15.
I20260709 13:00:29.585429  6174 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.562211  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:29.586391  2302 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:29.587886  6464 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.590842  6464 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.591570  6464 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:29.592712  6443 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.593649  5999 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:29.595551  6443 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.563225  6492 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.596856  6492 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.393551  6499 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:29.599318  6500 log.cc:927] Time spent T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:29.600453  6492 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.412966  6495 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.602708  6495 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.603165  6495 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.575800  1609 raft_consensus.cc:2410] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:00:29.577678  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.607316  1607 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:29.581835  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.572594  1612 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:29.601339  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 107646us
I20260709 13:00:29.601967  6499 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:29.614285  1613 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:29.623041  1541 raft_consensus.cc:2468] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:29.493791  6496 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:29.554119  6493 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.627568  1534 raft_consensus.cc:1275] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:00:29.638010  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.622931  1504 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8bbf1e27410e4984b453b68cb9b08bd6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:29.560791  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 170388us
I20260709 13:00:29.634078  1538 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:00:29.400130  6497 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 13:00:29.642570  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:29.639633  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 157938us
I20260709 13:00:29.644176  1582 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:29.644718  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:29.594189  5999 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.542016  6480 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.657120  1685 raft_consensus.cc:2393] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 8: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:29.658406  1582 leader_election.cc:400] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13.
I20260709 13:00:29.661127  1582 leader_election.cc:403] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.621873  6499 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.664002  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:29.663410  6443 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13.
I20260709 13:00:29.636476  6492 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:29.667871  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.668555  1538 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:29.641599  6356 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.660409  6420 raft_consensus.cc:3060] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.624145  6068 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:29.678483  6477 consensus_meta.cc:287] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:00:29.680400  5962 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.680862  6443 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:29.681556  5999 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:29.682256  6356 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.685685  6475 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:29.686558  6462 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:29.687562  6504 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:00:29.662269  6480 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:29.688032  6495 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.688687  6446 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:29.660621  6174 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.672731  6445 consensus_queue.cc:1059] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:00:29.660271  6496 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.663889  6499 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:29.660554  6474 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.592185  6464 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.671471  6492 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.656597  6493 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.609568  6476 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.742635  6174 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.735890  6447 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.735498  6461 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:29.815335  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 169309us
I20260709 13:00:29.819628  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:29.822117  6495 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:29.827817  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.812983  6477 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.781137  6447 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.846356  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:29.785156  6461 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.867130  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:29.841255  1609 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:29.848886  1613 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:29.822180  6445 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:29.845250  6488 consensus_queue.cc:1059] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:29.862352  6174 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.873494  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:29.873821  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:29.875244  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:29.875800  1610 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.839604  6475 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:29.864889  6505 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:00:29.866313  6492 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:29.898463   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:29.878791  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:29.900939  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:29.901051  2305 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
W20260709 13:00:29.901561  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 214058us
I20260709 13:00:29.902810  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:29.845482  5999 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.918814  6492 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:29.919413  6492 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.919826  6492 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:29.907256  6068 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:29.920245  6480 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:29.924304  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 81094us
I20260709 13:00:29.878932  6475 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:29.929565  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.905594  1609 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:00:29.908422  2310 raft_consensus.cc:2368] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12.
I20260709 13:00:29.930223  1609 pending_rounds.cc:85] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 8
W20260709 13:00:29.888459  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 184675us
I20260709 13:00:29.930555  1609 pending_rounds.cc:107] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:00:29.930619  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.930917  1609 raft_consensus.cc:2889] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:29.931835  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:29.898221  6460 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:29.933291  1533 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:29.935114  1540 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:29.878575  6457 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.940462  6423 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:29.824257  6466 consensus_queue.cc:1048] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:00:29.940974  6423 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.943074  6423 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.946834  6492 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:29.949250  6480 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:29.964720  6464 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.967092  6356 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.968700  6462 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:29.996722  1579 leader_election.cc:400] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12.
I20260709 13:00:29.997119  1579 leader_election.cc:403] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.849398  6477 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:29.924953  5999 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.007329  5999 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.008585  6476 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:29.933797  6475 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.005239  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.010725  6477 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.011133  6461 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.012483  6447 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:29.998597  6508 log.cc:927] Time spent T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.248s	user 0.004s	sys 0.000s
I20260709 13:00:29.939107  6460 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:30.013432  6460 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:30.013720  6420 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:30.014240  6496 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.015794  5962 raft_consensus.cc:3055] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:30.016175  5962 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:30.016608  6492 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.017031  5962 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.018247  5962 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:30.018672  6475 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.027997  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:30.028877  1541 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:30.033535  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.035392  1534 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:30.036378  1610 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:30.038174  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.038774  1682 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 8.
I20260709 13:00:30.039688  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.047190  1541 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:30.055114  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:30.055760  1682 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:30.062307  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 109114us
I20260709 13:00:30.063441  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:30.071394  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:30.071498  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.072037  2308 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:30.023254  6460 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.067575  1582 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.082065  2308 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:30.083088  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.083123  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.085093  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.081708  1682 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:30.088364  1685 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:30.088174  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.088846  2275 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:30.069351  6455 raft_consensus.cc:3060] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.092187  1540 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:30.097064  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:30.076138  6514 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:00:30.077242  6464 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.103382  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.076495  6518 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.106069  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.105523  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.089861  6492 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:30.104485  1685 raft_consensus.cc:1275] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:30.105202  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.105500  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:30.081640  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:30.108901  1541 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 13: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:30.074122  6461 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:30.077466  6466 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:30.096323  6510 raft_consensus.cc:2804] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:30.109467  6474 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:00:30.098587  6475 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.122097  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:30.122947  1685 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.106532  6518 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.126171  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.126875  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.130271  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:30.130976  1682 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:30.132911  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.132942  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:30.133702  1683 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:30.135435  1681 raft_consensus.cc:1275] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:30.137473  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.139994  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.141268  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:30.142864  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.145793  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.155911  1682 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:30.119417  6492 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:30.108047  6464 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.181872  5917 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.192842  1685 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:30.143126  6518 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.197189  6464 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.193467  5917 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.181999  6388 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:00:30.200937  6460 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:30.201819  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 53974.8us
I20260709 13:00:30.206050  2302 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:30.144862  6510 raft_consensus.cc:697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:30.220492  1581 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:30.220103  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 67835.3us
I20260709 13:00:30.146433  6521 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.178340  6465 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:30.227859  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:30.231665  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:30.235580  1581 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:30.242002  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:30.238359  5917 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.238003  6356 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.224629  6296 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.243845  1581 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:30.154350  6499 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.225278  6437 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.219988  6519 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:00:30.226428  6461 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:30.245540  6444 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.245349  6475 consensus_queue.cc:1048] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:30.283200  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:30.284834  6529 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:30.286062  6510 consensus_queue.cc:237] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.287371  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.288618  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:30.256819  6523 log.cc:927] Time spent T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:00:30.257550  6296 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.242769  6465 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:30.237387  6389 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.224764  6514 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:30.242308  6474 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.260370  6499 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.260407  2308 raft_consensus.cc:1240] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:30.265916  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:30.237464  6496 consensus_queue.cc:1048] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:00:30.301992  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 44069us
I20260709 13:00:30.305454  6475 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:30.266994  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:30.274953  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1941) took 1011 ms. Trace:
I20260709 13:00:30.194608  6492 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.255060  1611 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 15.
I20260709 13:00:30.315945  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.301391  6448 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:30.312564  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.309310  1689 rpcz_store.cc:276] 0709 13:00:29.263221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.263366 (+   145us) service_pool.cc:224] Handling call
0709 13:00:29.263741 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:29.264160 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.264200 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:29.268264 (+  4064us) log.cc:844] Serialized 52 byte log entry
0709 13:00:29.702815 (+434551us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:29.736872 (+ 34057us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.739555 (+  2683us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.815056 (+ 75501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.815159 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.118107 (+302948us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18003dd320. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:30.272502 (+154395us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18003dd320. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:30.274722 (+  2220us) raft_consensus.cc:1685] finished
0709 13:00:30.274744 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.274892 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5513,"prepare.queue_time_us":36848,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":105281,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":31854,"spinlock_wait_cycles":12965504,"thread_start_us":473445,"threads_started":2,"wal-append.queue_time_us":505880}
I20260709 13:00:30.316987  1687 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:30.293933  6437 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.335280  6519 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.351903  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.328315  6419 raft_consensus.cc:2764] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:00:30.300410  6389 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.336768  6497 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:30.312433  6411 consensus_queue.cc:1059] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:00:30.369443  6174 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:30.370101  6174 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:30.356916  6294 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.357440  6447 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.358279  6514 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:30.335850  6519 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:30.382373  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 59761us
I20260709 13:00:30.385228  6519 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.376861  6420 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.386410  6420 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.387372  6518 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.390787  2304 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:30.390940  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.371232  6174 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:30.375934  6497 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:30.383003  6514 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.380724  6381 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:30.397226  6296 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.381669  6294 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:30.401080  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.402655  6493 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.402909  6455 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 11. Current term is 12.
I20260709 13:00:30.382804  6447 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.356729  6465 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.405031  6420 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:30.406630  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 481582us
I20260709 13:00:30.425045  6381 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.446798  6381 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.447458  6497 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.434044  6495 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.448812  6497 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.448550  6495 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.449715  6447 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.451110  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.416786  6514 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:30.409056  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.411149  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:30.414805  2307 raft_consensus.cc:2368] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 13:00:30.417870  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:30.459918  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:30.419348  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:30.408815  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 314481us
I20260709 13:00:30.451936  1683 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:30.460711  1616 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 8: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:30.456658  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:30.458840  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:30.461503  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.461958  1689 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.462105  1608 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:30.461520  1581 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.433708  6282 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:30.468369  5962 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:30.468765  5962 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.469080  5962 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:30.468385  6282 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.439319  6174 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.473876  6282 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.475346  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:30.464869  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:30.477867  6522 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:30.478281  6522 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.478438  6476 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:30.478641  6522 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:30.479092  6476 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:30.442097  6294 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.458531  6518 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.489580  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.486688  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.500047  1532 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:30.484411  6427 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:30.503357  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.504873  1532 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:30.507647  1607 raft_consensus.cc:2468] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:30.482324  6420 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.516675  6492 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.517400  6492 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:30.498690  6549 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:00:30.523440  1689 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:30.525779  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.502188  6282 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:30.557596  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 51322.8us
I20260709 13:00:30.509707  6477 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:30.510924  6488 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:30.563079  2275 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:30.569024  1504 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:30.567981  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 57109.4us
I20260709 13:00:30.570747  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.512300  6461 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.498961  6296 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.583570  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:30.586877  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.588929  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.592324  6356 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.592734  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:30.592901  6356 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.593287  1616 raft_consensus.cc:606] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:30.593716  1616 raft_consensus.cc:614] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:30.594916  6560 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:30.595296  6356 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.595454  6560 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.596206  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:30.525439  6420 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.575603  6477 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.598640  6495 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.584897  6315 raft_consensus.cc:2804] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:30.573709  6461 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.571512  6282 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.629407  6526 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.630096  6526 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.631003  6282 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.569646  6556 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:30.582015  6455 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.632294  6547 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:30.624908  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.632503  6455 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.633293  6315 raft_consensus.cc:697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:30.634184  6315 consensus_queue.cc:237] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.634639  6455 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.634521  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.636518  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.637372  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.629374  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:30.591060  6492 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.623009  6311 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.585173  6296 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.582201  6488 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.642999  6556 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:30.669049  6566 ts_tablet_manager.cc:933] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
I20260709 13:00:30.668901  6556 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.674064  6420 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.676910  6560 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.678943  6461 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.683535  6477 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.685757  6488 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.671239  6514 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.695616  6522 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.699280  6522 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.699689  6514 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:30.625811  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 165941us
I20260709 13:00:30.628551  1507 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:30.739270  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 110687us
I20260709 13:00:30.740758  1616 raft_consensus.cc:606] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:30.741614  1616 raft_consensus.cc:614] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:30.744894  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.746399  1689 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:30.746840  1539 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:30.747530  1582 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:30.753260  2305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.759251  5948 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:30.763159  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.766515  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.766760  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.767146  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.771545  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.771764  1609 raft_consensus.cc:1240] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.767881  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:30.773226  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.776404  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.777158  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.781798  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.787236  6296 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.741631  1536 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:30.807000  1611 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:30.809659  6466 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.810732  6466 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.811570  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.812477  1540 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:30.813771  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.814859  1540 raft_consensus.cc:2368] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 14. Current term is 15.
W20260709 13:00:30.815236  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 77528.6us
I20260709 13:00:30.815999  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.817943  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.823295  1613 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:30.824705  6476 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.824687  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.830169  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:30.831244  1685 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:30.830216  1614 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:30.835361  1532 raft_consensus.cc:2410] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:30.815832  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:30.837904  1607 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:30.820242  6466 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:30.821250  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:30.822214  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:30.819068  6447 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.848733  1608 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:30.837256  5948 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:30.847504  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:30.854382  1541 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 7.
I20260709 13:00:30.867656  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:30.873452  1579 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:30.874336  6381 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.874979  6464 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:30.869892  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.868019  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:30.877324  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 100670us
I20260709 13:00:30.887523  5948 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.892338  6526 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.875384  6381 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.867415  6514 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.876173  6464 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:30.877873  6465 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:30.909613  6437 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.904953  1507 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.906404  6465 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:30.933152  6465 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:30.923096  6389 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.923403  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.923915  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.938406  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.939698  6476 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.940521  6476 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.924125  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:30.929900  6381 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:30.931275  6473 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.914696  6514 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.908310  6464 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:30.898028  5962 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.962080  6514 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.963070  5962 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:30.943646  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.969596  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:30.970245  1536 raft_consensus.cc:3060] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.970670  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:30.973088  1688 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:30.973549  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.974785  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.975843  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:30.980855  1582 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:30.975919  6381 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:30.982765  6381 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:30.981734  6464 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:30.983865  6356 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:30.988585  6356 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.989089  6356 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.990259  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:30.991165  1616 raft_consensus.cc:606] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:30.991477  1616 raft_consensus.cc:614] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:30.994652  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f65122cec34901839f22a448343dca"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:30.995280  1616 raft_consensus.cc:606] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:30.995631  1616 raft_consensus.cc:614] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:30.975994  1614 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:31.002105  6356 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.004135  1532 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:31.011657  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.013293  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.014273  1532 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:31.016618  6294 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:31.018347  6552 log.cc:927] Time spent T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.429s	user 0.002s	sys 0.000s
I20260709 13:00:31.020103  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2297) took 1090 ms. Trace:
I20260709 13:00:31.020421  6151 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:31.023264  6356 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.025826  6568 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.026386  6265 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:31.028640  1541 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:31.057861  1532 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
W20260709 13:00:31.033756  6554 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.436s	user 0.000s	sys 0.005s
I20260709 13:00:31.030798  1579 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.035004  6381 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:31.036329  1537 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:31.037153  6487 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:31.040424  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 143695us
I20260709 13:00:31.041061  6561 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:31.044945  6569 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:00:31.041527  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:31.020560  1538 rpcz_store.cc:276] 0709 13:00:29.929257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.929393 (+   136us) service_pool.cc:224] Handling call
0709 13:00:29.944480 (+ 15087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.407787 (+463307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.407820 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.408307 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.566948 (+158641us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:30.567003 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.567091 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.017401 (+450310us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:31.019594 (+  2193us) raft_consensus.cc:1685] finished
0709 13:00:31.019624 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.019911 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462947,"raft.queue_time_us":463075,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":5216000,"thread_start_us":158340,"threads_started":1,"wal-append.queue_time_us":180853}
I20260709 13:00:31.047857  6476 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:31.049002  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 91367.2us
I20260709 13:00:31.049088  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.080066  1534 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:31.021343  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.030556  6475 consensus_queue.cc:1059] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:31.070875  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.074241  1685 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:31.076862  1614 raft_consensus.cc:606] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:31.084192  1614 raft_consensus.cc:614] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:31.085134  1532 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:31.071381  6487 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:31.084904  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.081538  1536 raft_consensus.cc:2468] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 9.
I20260709 13:00:31.090015  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.075018  6561 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:31.021324  6151 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.091251  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.064375  6465 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.102977  1533 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:31.095705  6257 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:31.068715  6568 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.093945  1616 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:31.105557  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.107983  6151 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:31.108086  6568 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.109820  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.110641  1682 raft_consensus.cc:2393] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
W20260709 13:00:31.110524  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 79841.9us
I20260709 13:00:31.111346  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.095710  6561 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.113098  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.113950  6575 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.114522  6575 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.114694  6568 consensus_queue.cc:1059] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:31.115878  6568 raft_consensus.cc:3055] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:31.116277  6568 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:31.116694   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:31.116920  6575 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.117123  6568 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.118412  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.118754  6568 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:31.119266  1614 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:31.120548  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.120585  1504 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.121696  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.086371  6265 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.125100  6257 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.125669  6475 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:31.125841  6257 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:31.126111  6475 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.126494  6475 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:31.126773  6265 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:31.126442  6257 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.129027  6265 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.129820  2310 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:31.130203  1504 leader_election.cc:400] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 13:00:31.130483  1504 leader_election.cc:403] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.128468  6465 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:31.121346  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.132622  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.121208  1608 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:31.137899  1581 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.145674  2276 leader_election.cc:400] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 14. Current term is 15.
I20260709 13:00:31.145792  6496 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:31.146126  2276 leader_election.cc:403] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.144100  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.143723  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.150902  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:31.153163  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.153329  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.153522  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.138087  6265 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) with higher term. Message: Invalid argument: T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 8. Current term is 9.
I20260709 13:00:31.148725  6496 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:31.155967  6496 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.156378  6367 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 14. Current term is 15.
I20260709 13:00:31.156452  6257 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:31.157245  6367 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.158191  1688 raft_consensus.cc:2393] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:31.158135  1614 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:31.161957  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.167330  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.168013  1682 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:31.168723  1507 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.169764  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.170495  1616 raft_consensus.cc:2393] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 10: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:31.172043  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.173318  6265 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:31.173735  6265 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.174079  6265 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:31.165977  6561 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.175519  1537 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.181264  6561 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.181742  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.182859  6476 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:31.170753  2276 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:31.183266  6476 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.183758  6476 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:31.184804  6499 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:31.190423  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.192272  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.193178  1535 raft_consensus.cc:2410] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:31.192909  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.193387   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:31.194239  5999 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:31.194648  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.196062  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:31.194650  5999 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.198055  5999 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:31.200618  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.190698  6265 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.205576  6265 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:31.219676  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 81866.2us
I20260709 13:00:31.205503  6487 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.220528  1581 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.220991  6487 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.223071  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:31.223686  1684 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:31.224483  5962 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:31.225036  5962 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:31.225947  5962 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.206249  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:31.229043  1616 raft_consensus.cc:2368] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:31.209586  1610 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:31.212842  6356 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:31.230851  6356 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:31.231127  1684 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:31.231833  6356 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.236346  6356 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:31.234297  6514 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:31.239955  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.244621  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.248714  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:31.252673  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.253337  1688 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:31.265590  6561 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:31.266387  6561 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.258500  1616 raft_consensus.cc:1275] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:31.277923  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:31.283298  1616 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:31.273653  1615 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:31.290213  1537 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
W20260709 13:00:31.301183  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.303467  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:31.304047  1687 raft_consensus.cc:3060] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:31.304549  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 174586us
I20260709 13:00:31.308509  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:31.309366  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.321274  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.310882  6473 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:00:31.340844  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:31.344465  1504 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:31.347388  6475 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.348548  6495 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:31.348974  6495 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:31.349375  6495 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:31.350097  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.354033  1616 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
W20260709 13:00:31.360678  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 55032.8us
I20260709 13:00:31.368834  6566 tablet_copy_client.cc:323] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34321
I20260709 13:00:31.370160  6475 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.370500  6474 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.371181  6474 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.372507  6419 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:31.373190  6419 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:31.361472  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.355953  6514 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:31.397481  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:31.398702  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 46874.7us
I20260709 13:00:31.376206  6419 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:31.354213  6294 consensus_queue.cc:1048] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:31.401973  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.407202  1535 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:31.390893  6514 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.427250  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65855.5us
I20260709 13:00:31.432602  6282 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:31.429678  6476 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.438941  1682 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:31.444507  6558 log.cc:927] Time spent T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:00:31.466431  6446 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:31.448612  6581 log.cc:927] Time spent T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:00:31.429090  6514 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:31.450371  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.470147  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.471562  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.472453  6545 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:31.450907  1687 raft_consensus.cc:2468] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:31.460280  1612 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:31.468750  1614 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:31.521991  1532 raft_consensus.cc:2368] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:31.538985  1507 leader_election.cc:400] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:31.539506  1507 leader_election.cc:403] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:00:31.541368  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69922.2us
I20260709 13:00:31.542286  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.496348  6282 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:31.496760  5948 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.498462  6568 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:31.545991  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 209457us
I20260709 13:00:31.557513  5962 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.558094  5962 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.564623  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.571893  1535 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:31.561084  6282 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:31.563531  5962 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.588547  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.596995  6465 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.617030  6387 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:31.624373  6420 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:31.625027  6420 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.627260  6420 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:31.629001  6584 log.cc:927] Time spent T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:00:31.629956  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44878.8us
I20260709 13:00:31.631667  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.632156  6382 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:31.592697  5999 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.634217  2310 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:31.636615  5999 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:31.638988  6495 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.641374  6495 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:31.641609  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53078 (request call id 693) took 1536 ms (client timeout 2001 ms). Trace:
I20260709 13:00:31.619719  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.596989  6476 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.642992  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.654731  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.665962  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:31.676136  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 56512.5us
I20260709 13:00:31.676203  1611 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:31.678617  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:31.679380  1684 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
W20260709 13:00:31.675803  1615 rpcz_store.cc:269] 0709 13:00:30.104832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.104958 (+   126us) service_pool.cc:224] Handling call
0709 13:00:31.641322 (+1536364us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400322154. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:31.641503 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681106304}
I20260709 13:00:31.679479  1582 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.664536  6282 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.682404  1582 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.664965  6465 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:31.680786  1534 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:31.685925  6454 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:31.687317  6382 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.691642  6282 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:31.700393  6282 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:31.705991  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 74472us
I20260709 13:00:31.709389  6454 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:31.710376  6454 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.681299  6356 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:31.745361  1581 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:31.749229  6588 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.193s	user 0.000s	sys 0.003s
I20260709 13:00:31.755852  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:31.749277  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 214797us
I20260709 13:00:31.750905  6475 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:31.763949  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:31.767403  1507 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.770539  2308 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:31.768213  6495 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:31.772522  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:31.773463  6514 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.776049  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.776835  6487 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:31.777951  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:31.778510  1686 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:31.761868  6475 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.783767  6367 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:31.800336  6382 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:31.800397  6448 raft_consensus.cc:2804] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:31.783550  6514 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.784756  6495 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:31.788158  6475 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:31.792685  5918 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.784261  6420 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:00:31.833442  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.823645  6448 raft_consensus.cc:697] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:31.862419  1537 raft_consensus.cc:1275] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:31.862617  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.837467  5918 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.885520  1686 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
I20260709 13:00:31.893805  6592 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.894414  6592 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.896553  6474 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:31.897748  1581 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:31.898641  6356 raft_consensus.cc:2804] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:31.901731  6356 raft_consensus.cc:697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:31.902670  6356 consensus_queue.cc:237] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.918668  6593 consensus_queue.cc:1048] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:00:31.928793  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 106353us
I20260709 13:00:31.929836  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.931576  6382 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.935752  6448 consensus_queue.cc:237] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.937029  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:31.937937  6489 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:31.939180  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.939953  6489 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:31.945428  1532 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:31.948797  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:31.896350  1551 tablet_copy_service.cc:140] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Received BeginTabletCopySession request for tablet 8bbf1e27410e4984b453b68cb9b08bd6 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:52700)
I20260709 13:00:31.953962  1551 tablet_copy_service.cc:161] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Beginning new tablet copy session on tablet 8bbf1e27410e4984b453b68cb9b08bd6 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:52700: session id = c445b7b7d94f48f99a3599ddfc92f462-8bbf1e27410e4984b453b68cb9b08bd6
I20260709 13:00:31.954555  6465 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.955368  6465 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:31.956374  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:31.956959  1536 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:31.958525  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:31.958791  6561 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:31.959779  6487 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:31.960162  6487 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:31.960561  6487 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:31.962723  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:31.967419  1614 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:31.967621  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:31.879492  6495 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:31.972043  1551 tablet_copy_source_session.cc:215] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:31.979810  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.980077  2306 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:31.951792  6382 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:31.983711  6382 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:31.985795  6382 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:31.986937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:31.987793  1614 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:31.988754  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:31.989339  1609 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:31.991146  5918 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:31.996511  1532 raft_consensus.cc:3060] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:00:32.011657  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 53218.7us
I20260709 13:00:32.013058  1615 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:31.950888  6592 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.019232  1609 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:32.022959  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:32.067451  1607 raft_consensus.cc:2393] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:32.066399  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:32.025440  6464 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.102154  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:32.054896  1532 raft_consensus.cc:2468] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
W20260709 13:00:32.026008  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 60965.6us
I20260709 13:00:32.025909  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:32.108450  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:32.109139  2302 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:32.025247  5962 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.026355  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 138) took 16673 ms (client timeout 15000 ms). Trace:
W20260709 13:00:32.128378  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 175170us
I20260709 13:00:32.136004  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:32.118404  5962 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.142899  1532 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:32.113624  6464 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.145493  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:32.141661  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.148756  1533 raft_consensus.cc:2410] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:32.148941  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.149334  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.123692  6487 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.121078  6448 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:00:32.151167  1539 raft_consensus.cc:2393] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:32.144096  6420 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.157303  1615 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:32.158573  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 61977.3us
W20260709 13:00:32.159801  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 48499.8us
I20260709 13:00:32.160003  1534 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:32.161013  2310 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:32.165565  6487 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:32.170073  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:32.170665  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:32.168365  6382 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.180929  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet ff79ac342d91424db634ca7802846535 with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34342
W20260709 13:00:32.182864  6596 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.295s	user 0.004s	sys 0.000s
I20260709 13:00:32.183262  6566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf1e27410e4984b453b68cb9b08bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:32.186982  6464 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.187314  5962 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.190841  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:32.193501  1533 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:00:32.195115  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:32.195907  1534 raft_consensus.cc:2393] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:32.176656  6419 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.207783  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:32.211532   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:32.215304  6604 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:00:32.200804  6561 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:32.224709  6561 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.228549  6613 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:32.244899  1579 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:32.253286  6603 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 13:00:32.227422  6605 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:32.259881  6605 consensus_queue.cc:1243] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:32.260861  6602 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:32.261025  6427 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:32.261257  6602 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:32.262135  6602 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:32.265930  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55195.3us
I20260709 13:00:32.266644  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:32.221338  6419 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.280381  1507 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:32.267531  1613 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:32.287269  1682 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:32.287940  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:32.302846  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:32.303913  1683 raft_consensus.cc:2368] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:32.248989  6561 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:32.310487  6612 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.310925  1690 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:32.296635  6489 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:32.311720  6489 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.312103  6489 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:32.312345  6609 log.cc:927] Time spent T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:32.313508  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:32.319617  1656 leader_election.cc:400] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:32.292733  6446 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:32.324569  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:32.275540  6419 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:32.295250  6465 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:32.302743  5999 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:32.326279  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.327978  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.283457  6615 tablet_replica.cc:333] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:32.281450  6475 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.284498  6613 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:32.336551  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.353104  1535 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:32.279085  6495 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:00:32.340620  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:32.334213  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.353749  1607 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:00:32.345582  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:32.326622  6465 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:32.361016  1689 raft_consensus.cc:2368] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 16. Current term is 17.
I20260709 13:00:32.311031  6612 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.365329  6446 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:32.115310  1433 rpcz_store.cc:269] 0709 13:00:15.352821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.355977 (+  3156us) service_pool.cc:224] Handling call
0709 13:00:32.026118 (+16670141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:28.953660 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:28.994045 (+ 40385us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:28.994083 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:00:28.994104 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:28.995441 (+  1337us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:28.995503 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:28.995527 (+    24us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:29.110974 (+115447us) tablet.cc:701] Row locks acquired
0709 13:00:29.110996 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:00:29.111154 (+   158us) write_op.cc:270] Start()
0709 13:00:29.111272 (+   118us) write_op.cc:276] Timestamp: P: 1783602029111103 usec, L: 0
0709 13:00:29.111293 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:29.111998 (+   705us) log.cc:844] Serialized 6021 byte log entry
0709 13:00:30.097970 (+985972us) op_driver.cc:464] REPLICATION: finished
0709 13:00:30.260984 (+163014us) write_op.cc:301] APPLY: starting
0709 13:00:30.261067 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:30.405720 (+144653us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:30.405841 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:30.628531 (+222690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:30.670775 (+ 42244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:00:30.670848 (+    73us) write_op.cc:312] APPLY: finished
0709 13:00:30.671356 (+   508us) log.cc:844] Serialized 139 byte log entry
0709 13:00:30.671596 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.671862 (+   266us) write_op.cc:454] Released schema lock
0709 13:00:30.672884 (+  1022us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:30.673366 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.673854 (+   488us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":249,"mutex_wait_us":1277249,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":156645,"apply.run_cpu_time_us":23538,"apply.run_wall_time_us":412321,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":119907,"prepare.run_cpu_time_us":19294,"prepare.run_wall_time_us":344689,"raft.queue_time_us":311417,"raft.run_cpu_time_us":43684,"raft.run_wall_time_us":159712,"replication_time_us":971041,"thread_start_us":519306,"threads_started":4,"wal-append.queue_time_us":493709,"wal-append.run_cpu_time_us":41270,"wal-append.run_wall_time_us":2079961}]]}
I20260709 13:00:32.365789  6446 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:32.366096  6615 raft_consensus.cc:2243] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:32.367050  6615 raft_consensus.cc:2272] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:32.369122  6475 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.369828  1615 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:32.370849  1611 raft_consensus.cc:2368] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:32.371722  6617 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.372982  1436 catalog_manager.cc:5697] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 10 to 13, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 13 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.365658  6612 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.326233  6448 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:00:32.341615  5999 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
W20260709 13:00:32.389623  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.394024  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 72934.6us
W20260709 13:00:32.390098  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 82214us
I20260709 13:00:32.395022  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:32.375837  1436 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 9 to 11, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 11 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.335935  6454 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:00:32.340700  5948 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:32.398046  1436 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.358464  6592 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.399966  1436 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 8 to 9, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 9 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.395124  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:32.336169  6419 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:00:32.404398  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:32.378252  6465 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:32.400358  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.380844  6590 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.412671  1436 catalog_manager.cc:5697] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 2 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.410429  5918 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:32.434190  6622 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:00:32.434506  1436 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 10 to 11, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 11 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:32.436334  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 74432.7us
I20260709 13:00:32.449115  5918 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:32.448938  1436 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.450207  5918 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.451440  1436 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:32.453671  1436 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.413669  6382 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:00:32.407836  6592 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.472730  1436 catalog_manager.cc:5697] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:32.476626  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 67479.5us
I20260709 13:00:32.420567  6590 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.514688  6615 ts_tablet_manager.cc:1916] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:32.537871  1436 catalog_manager.cc:5697] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 4 to 7, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:32.562247  1436 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 7 to 11, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 11 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:32.594560  1685 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:00:32.594110  1436 catalog_manager.cc:5697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 4 to 10, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.598026  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.598721  1686 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
W20260709 13:00:32.599347  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 273466us
I20260709 13:00:32.548167  6622 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.474305  5999 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.607527  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.474464  6613 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:32.605353  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 195708us
I20260709 13:00:32.597388  6590 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.605301  1436 catalog_manager.cc:5697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 8 to 9, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:32.641989  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.642174  2306 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:00:32.609773  6627 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:00:32.606539  6526 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.537124  6446 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.653065  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.653987  1535 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 8.
I20260709 13:00:32.659423  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.621984  6476 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:32.660306  1683 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:32.668941  1536 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:32.674427  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:32.675200  1686 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:32.682360  1436 catalog_manager.cc:5697] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.687242  1436 catalog_manager.cc:5697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.615403  6561 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.618840  6489 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:32.702198  1436 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 4 to 10, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.705632  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:32.706398  1536 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:32.708743  1506 leader_election.cc:400] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10.
I20260709 13:00:32.709717  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:32.713600  1506 leader_election.cc:400] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 16. Current term is 17.
I20260709 13:00:32.713907  1506 leader_election.cc:403] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.714540  1536 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:32.639972  6622 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.724480  6617 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:32.699815  6636 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:32.734905  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 198577us
I20260709 13:00:32.732663  6592 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.738808  1537 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:32.716037  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:32.717077  1684 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:32.728539  1436 catalog_manager.cc:5697] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 6 to 9, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 9 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.686591  5918 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:32.756057  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:32.774998  1539 raft_consensus.cc:2393] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 13: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:32.776654  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:32.787163  1535 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:32.667105  6526 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.756686  6636 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:32.681160  6476 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.799278  1436 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 11 to 12, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:32.806396  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 92938.6us
I20260709 13:00:32.821666  1537 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:32.823402  1686 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:32.782145  6454 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.804775  1681 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:32.833469  1436 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 8 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.797030  6474 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:32.840512  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.775944  5962 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:00:32.842785  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:32.842708  1436 catalog_manager.cc:5697] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.838371  6454 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.853166  1537 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:32.857795  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.858530  1684 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 8.
I20260709 13:00:32.774580  5918 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:32.857190  6454 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.866134  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:32.866878  1533 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:32.843554  6474 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.809369  6612 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:32.848130  6618 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:32.893841  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 92747.5us
I20260709 13:00:32.892387  1436 catalog_manager.cc:5697] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 1 to 10. New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:32.896034  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.893692  6645 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:00:32.868530  6448 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:32.902918  6448 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:32.903420  6645 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 16. Current term is 17.
I20260709 13:00:32.903825  6476 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:32.905184  6448 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.871819  6566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56294 (request call id 665) took 2363 ms. Trace:
I20260709 13:00:32.906554  6561 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:32.906635  6566 rpcz_store.cc:276] 0709 13:00:30.477881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.481767 (+  3886us) service_pool.cc:224] Handling call
0709 13:00:30.669614 (+187847us) ts_tablet_manager.cc:934] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
0709 13:00:31.041616 (+372002us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d55b410ac 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5acaa 00007f8d55b5abd2 00007f8d5dbbf131
0709 13:00:32.103405 (+1061789us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:32.289494 (+186089us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:32.296780 (+  7286us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:32.731426 (+434646us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:32.731779 (+   353us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:32.732214 (+   435us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:32.837477 (+105263us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":57403,"spinlock_wait_cycles":11620096,"tablet-copy.queue_time_us":163951,"thread_start_us":602901,"threads_started":2}
I20260709 13:00:32.908648  6566 tablet_copy_client.cc:806] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:32.908715  6489 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:32.909446  6566 tablet_copy_client.cc:670] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:32.910357  6489 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:32.910866  6489 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.912462  6446 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:32.915633  6635 log.cc:927] Time spent T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:32.920114  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.921573  1689 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:32.865911  6590 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:32.936774  6653 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:32.937394  6653 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.940773  6218 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.941365  6218 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:32.892643  6474 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:32.946270  1582 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:32.961736  5918 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:32.963335  6526 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:32.964656  6489 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:32.966120  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:32.992061  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 116197us
I20260709 13:00:32.993057  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:32.994009  6651 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.994607  6651 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.995038  6651 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.995149  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:32.996714  6628 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:32.998139  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.998780  1683 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:32.999583  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.000660  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:32.999775  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:33.009080  1688 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:33.029385  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.035148  1538 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:33.032431  1688 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:32.985952  5962 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:32.952461  6590 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.058046  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.026696  6473 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:32.981635  6514 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:33.061789  1533 raft_consensus.cc:2468] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:33.063004  6632 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:33.069958  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 95888.1us
I20260709 13:00:33.063354  6653 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:33.064930  6465 consensus_meta.cc:287] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 13:00:33.064780  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:33.058733  1607 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:33.074208  2302 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:33.076411  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:33.075170  1653 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:33.080391  1506 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:33.082506  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:33.083137  1613 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:33.077623  6632 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.089270  6632 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:33.089942  6633 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:33.090521  6633 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:33.092635  6607 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.904s	user 0.005s	sys 0.000s
I20260709 13:00:33.083490  6653 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:33.093837  6653 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:33.094213  6653 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.096424  6218 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.071589  6636 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.097705  6636 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:33.102603  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.109241  1614 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:33.073460  6473 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:33.118258  6658 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:33.118854  6658 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:33.127193  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.067006  5962 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.119853  6658 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:33.144394  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.145303  1607 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:33.151046  6650 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.151788  6650 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.110186  6454 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.156419  6590 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.157240  1608 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:33.158195  6454 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.161173  6633 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:33.162194  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:33.111377  6649 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:00:33.169181  1614 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:33.170486  6474 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.170805  6473 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:33.175189  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.176141  6642 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 13:00:33.178032  6602 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:33.179742  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.077996  6465 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.180637  1687 raft_consensus.cc:2410] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:33.181319  6615 ts_tablet_manager.cc:1929] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:00:33.181854  6615 log.cc:1199] T ff79ac342d91424db634ca7802846535 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/ff79ac342d91424db634ca7802846535
I20260709 13:00:33.182169  6465 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:33.184262  5962 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.184556  6651 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.186964  6651 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.188506  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:33.189123  1687 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.190277  6650 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.194661  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:33.196935  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:33.197638  2302 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:33.198725  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:33.199703  6644 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:33.199947  1656 leader_election.cc:400] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:33.200356  1656 leader_election.cc:403] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.201300  6465 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:33.206403  1613 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:33.216306  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.232913  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.257339  1687 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:33.268263  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:33.275030  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 328881us
I20260709 13:00:33.222187  6644 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:33.292052  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:33.293344  6650 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:33.293987  6650 raft_consensus.cc:697] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:33.295126  6650 consensus_queue.cc:237] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.300210  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.300972  1687 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:33.305876  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:33.284389  6474 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.291145  6644 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:33.297674  6615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34342 (request call id 1) took 1156 ms. Trace:
W20260709 13:00:33.379822  6669 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:33.288528  6473 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:00:33.348436  6651 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:33.288838  6454 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:00:33.400748  1582 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:33.304560  6653 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:33.406123  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.407207  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.351912  6514 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:00:33.403923  6651 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.421779  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.413681  6624 raft_consensus.cc:2804] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:33.427166  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.428073  1533 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:33.418958  6448 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:33.418821  6651 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.434811  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:33.435638  1535 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:33.431824  6670 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:33.432633  6448 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.437031  6670 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.439024  6448 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:33.439252  6670 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:33.432129  6624 raft_consensus.cc:697] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:33.445750  6653 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:33.445632  6624 consensus_queue.cc:237] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.449458  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:33.456136  1688 raft_consensus.cc:1275] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:33.456055  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.382423  6615 rpcz_store.cc:276] 0709 13:00:32.130609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.159559 (+ 28950us) service_pool.cc:224] Handling call
0709 13:00:32.282817 (+123258us) ts_tablet_manager.cc:1151] Deleting tablet ff79ac342d91424db634ca7802846535
0709 13:00:32.282921 (+   104us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:32.984341 (+701420us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:33.181183 (+196842us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:33.275109 (+ 93926us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":100964,"thread_start_us":41641,"threads_started":1}
I20260709 13:00:33.481861  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:33.485224  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.486778  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.487067  6514 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:33.491703  2302 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:33.492769  1653 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:33.498205  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.498268  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:33.498957  1685 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:33.487841  6514 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.517630  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:33.518608  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:33.519434  6446 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:33.519841  6446 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.520161  6446 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:33.501009  6602 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:33.524748  6611 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:33.525182  6602 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:33.526103  6602 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.529412  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.529989  2275 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:33.531919  6545 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:33.532125  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.533041  1611 raft_consensus.cc:2393] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:33.533556  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:33.534308  1613 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 9: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:33.536334  1539 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:33.532334  6545 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.538388  6545 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:33.541805  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:33.542727  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.543432  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.545576  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.546602  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:33.547770  1612 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:00:33.548045  6454 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.550161  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.550771  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34874 (request call id 2619) took 1403 ms. Trace:
I20260709 13:00:33.551462  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:33.552958  6648 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:33.553488  6648 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.554665  6651 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.555238  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:33.546509  6464 consensus_queue.cc:1048] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:33.558342  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:33.556489  6652 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:33.559307  1534 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:33.563596  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:33.565268  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 46715.9us
I20260709 13:00:33.566606  1582 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:33.567647  6514 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.545607  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:33.595180  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.597450  1684 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:33.508159  1535 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:33.596349  1507 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:33.610773  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 44362.4us
W20260709 13:00:33.597430  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 66128.5us
I20260709 13:00:33.551146  1532 rpcz_store.cc:276] 0709 13:00:32.147019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.147174 (+   155us) service_pool.cc:224] Handling call
0709 13:00:32.154661 (+  7487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.161231 (+  6570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.161258 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.403877 (+242619us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b2c00000658. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 13:00:32.407121 (+  3244us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.600373 (+193252us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:32.740436 (+140063us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.550346 (+809910us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b18000253c0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d587f34bc 00007f8d55b4148b 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5b455 00007f8d58c43060 00007f8d58c55716 00007f8d58c66287
0709 13:00:33.550478 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.550561 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.550601 (+    40us) raft_consensus.cc:1685] finished
0709 13:00:33.550613 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.550721 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246595,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2354,"raft.queue_time_us":165622,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4228,"spinlock_wait_cycles":33849472,"thread_start_us":414760,"threads_started":3,"wal-append.queue_time_us":253492}
I20260709 13:00:33.613804  1685 raft_consensus.cc:2393] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 9: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:33.616452  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57984 (request call id 1979) took 1315 ms. Trace:
I20260709 13:00:33.616994  1682 rpcz_store.cc:276] 0709 13:00:32.300813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.313289 (+ 12476us) service_pool.cc:224] Handling call
0709 13:00:33.616155 (+1302866us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400392e54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:33.616358 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757468544}
I20260709 13:00:33.618479  1687 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:33.618942  1687 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:33.620412  1687 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.621909  1687 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:33.631718  1536 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:00:33.640592  1582 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:33.642179  1582 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:33.647737  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:33.651153  1612 raft_consensus.cc:2393] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 11: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:33.654132  6662 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:33.654693  6662 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:33.655084  6662 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:33.657545  6446 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.659509  1616 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 15: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:33.659405  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47272.8us
I20260709 13:00:33.668107  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:33.659319  6653 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.671983  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:33.675978  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.678414  1685 raft_consensus.cc:2410] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:33.705894  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:33.712276  1613 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:33.714448  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.667048  6514 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:33.723080  1687 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:00:33.726608  1687 pending_rounds.cc:85] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 6
I20260709 13:00:33.674237  6633 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:33.720069  6624 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:33.719167  6613 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:33.719771  6419 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:33.727156  1687 pending_rounds.cc:107] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:00:33.744189  1687 raft_consensus.cc:2889] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:33.747164  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 111157us
W20260709 13:00:33.746577  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 87972.7us
I20260709 13:00:33.729908  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet ff79ac342d91424db634ca7802846535 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:33.748955  1581 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:33.749336  1426 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 138859us
I20260709 13:00:33.706784  6653 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.750362  6526 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.750976  6638 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:33.750917  6644 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.755337  6630 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:00:33.760030  6656 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:33.758231  6526 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:33.759872  6667 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:00:33.760185  6566 tablet_copy_client.cc:538] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.765470  6526 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.766780  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.767393  1681 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:33.767640  6653 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:33.767859  6667 consensus_queue.cc:1243] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:33.770766  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:33.773154  6624 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:33.773546  6624 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.773855  6624 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:33.776477  6566 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 13:00:33.778081  1681 pending_rounds.cc:85] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 5
I20260709 13:00:33.778422  1681 pending_rounds.cc:107] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:00:33.778738  1681 raft_consensus.cc:2889] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:33.790537  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67125.5us
I20260709 13:00:33.808152  2275 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:33.812294  1683 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:33.808208  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 90606.7us
I20260709 13:00:33.817510  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:33.822077  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:33.861744  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 102948us
W20260709 13:00:33.873594  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 231519us
W20260709 13:00:33.876556  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 267100us
I20260709 13:00:33.879426  1582 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:33.879426  6651 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.900732  6356 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:33.901356  6685 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:00:33.907193  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.941821  6611 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:33.946408  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:33.949591  6684 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:33.949951  6473 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:33.950459  6473 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:33.952466  6677 log.cc:927] Time spent T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 13:00:33.947665  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 111244us
I20260709 13:00:33.910787  6666 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.956446  6690 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:33.957414  2306 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 14: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
W20260709 13:00:33.957720  6683 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:00:33.905762  6514 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.961040  6514 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.961690  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57984 (request call id 1986) took 1119 ms. Trace:
W20260709 13:00:33.962764  6679 log.cc:927] Time spent T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:00:33.880802  6545 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.957288  6630 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:33.962051  1686 rpcz_store.cc:276] 0709 13:00:32.842174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.842270 (+    96us) service_pool.cc:224] Handling call
0709 13:00:32.855103 (+ 12833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.861803 (+  6700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.861831 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.544702 (+682871us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b2c00004018. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 13:00:33.545132 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.660244 (+115112us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:33.660281 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.660348 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.961364 (+301016us) raft_consensus.cc:1685] finished
0709 13:00:33.961384 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.961610 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262,"raft.queue_time_us":6059,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":20150,"spinlock_wait_cycles":12840192,"thread_start_us":114721,"threads_started":1,"wal-append.queue_time_us":192072}
I20260709 13:00:33.975421  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:33.968446  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:33.974253  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:33.945392  6465 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:33.973091  6446 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:33.978371  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:33.968943  6611 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:33.980773  6545 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.981078  6622 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:33.981585  6594 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.966640  6602 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:33.951460  6473 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.988621  2302 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.993306  1683 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:33.972127  6630 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:34.002678  6644 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.003093  6602 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.006201  6662 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.967298  6624 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.009153  6686 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:34.015728  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.020684  1504 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:34.018827  1541 raft_consensus.cc:1240] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:34.029323  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:34.050998  1612 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.051255  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:34.034159  6473 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.027261  6686 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:33.991708  6611 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.028936  6655 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.029616  6514 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:33.992978  6465 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.026934  6356 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:34.057829  6602 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.058008  6356 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.055301  6622 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:34.061786  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 180273us
I20260709 13:00:34.064236  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:34.066360  6499 consensus_queue.cc:1059] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:00:34.070426  6499 raft_consensus.cc:3055] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:34.070783  6499 raft_consensus.cc:740] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:34.071697  6499 consensus_queue.cc:260] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.072862  6662 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.073572  6356 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:34.078598  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.081530  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:34.078964  5948 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:34.088745  1541 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:34.079257  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:34.069080  6622 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:34.080693  6499 raft_consensus.cc:3060] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:34.074110  6648 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.095780  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.095508  6647 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:34.096159  6624 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:34.097743  6465 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:34.110463  6682 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:00:34.110683  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:34.111338  1686 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:34.115054  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:34.115797  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.116535  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:34.117100  1685 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.118829  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:34.118685  6630 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.129619  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:34.130497  1616 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:34.132280  1685 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:34.132787  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:34.133765  1616 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15.
I20260709 13:00:34.143442  1686 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:34.089221  6662 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:34.146550  6650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.004s	sys 0.031s
W20260709 13:00:34.147310  6650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.004s	sys 0.031s
I20260709 13:00:34.149555  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:34.157891  6593 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:34.158514  6593 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.159549  2307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.163980  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:34.166807  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:34.149616  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:34.169827  6645 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.171401  6446 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:34.171907  6446 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:34.172785  6446 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.183564  1612 raft_consensus.cc:2468] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
W20260709 13:00:34.193890  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44420.5us
I20260709 13:00:34.194168  6561 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:34.195247  6561 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:34.152281  6630 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:34.226015  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 48495.2us
I20260709 13:00:34.199400  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.195266  1507 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15.
I20260709 13:00:34.227423  1507 leader_election.cc:403] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:34.228282  2276 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:34.237946  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.239033  1612 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:34.242096  1541 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:00:34.244349  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:34.232096  6645 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:34.261170  6704 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:00:34.289464  6593 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:34.292069  2273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.314507  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.270825  6621 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:00:34.304651  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.306452  6465 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.326996  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.327997  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.329097  2275 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:34.329882  6698 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.308904  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:34.252545  6487 raft_consensus.cc:2804] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:34.322058  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.323414  6686 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:34.335245  1537 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 15: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:34.360906  6487 raft_consensus.cc:697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:34.370291  6487 consensus_queue.cc:237] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.336278  6465 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.377249  1686 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 15.
W20260709 13:00:34.378751  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 131936us
I20260709 13:00:34.361943  6653 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:34.397118  6636 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:34.397392  6624 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:34.397938  6636 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.426163  1613 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
W20260709 13:00:34.492614  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 44957.4us
I20260709 13:00:34.497182  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:34.497812  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 106265us
I20260709 13:00:34.498317  1532 raft_consensus.cc:2368] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:34.501451  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.476794  6632 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.510996  6632 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.512259  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:34.513149  6632 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.513381  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.513907  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:34.514714  6709 log.cc:927] Time spent T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:00:34.493788  6621 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:00:34.522204  6624 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:34.524955  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:34.536580  1535 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:34.419669  6653 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.524562  6636 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.529502  6624 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:34.555477  6632 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:34.726430  6718 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:34.693892  6464 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:34.762239  6464 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.643986  6446 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:34.764631  6446 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.694662  6526 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:34.730096  1683 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:00:34.693238  6667 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:34.692435  6682 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:00:34.732865  6605 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:34.738185  6632 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:34.741997  6717 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:00:34.743841  6653 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.744061   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:34.744308  6626 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:34.692866  6647 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.754506  6645 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15.
I20260709 13:00:34.768594  6526 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.814850  6526 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.769001  6667 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.818261  6667 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:34.769817  6605 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.772378  6632 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.768165  6446 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.781978  6465 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.823231  6605 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.785678  6647 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.785319  6626 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.827014  6647 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.785843  6464 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.830086  6626 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.830578  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.831651  1534 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:34.854455  1538 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:34.859812  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:34.864636  1534 raft_consensus.cc:1240] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:00:34.868827  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
W20260709 13:00:34.875382  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 179910us
I20260709 13:00:34.879153  6446 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:34.880506  6667 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:34.883291  6667 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:34.885398  6667 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:34.888118  1683 raft_consensus.cc:1275] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:34.895756  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:34.892202  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:34.890262  1615 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:34.898468  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.907399  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.908627  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.909633  2310 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:34.910247  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.904031  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.909294  6687 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:00:34.908075  6476 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:00:34.915241  6476 consensus_queue.cc:1243] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer d3b488cf00f7497ea0bf5964b99f6e0e log is divergent from this leader: its last log entry 16.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:34.915295  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.915786  6476 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:34.916131  6476 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:34.917222  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.916970  6476 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.918195  6476 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.919970  6610 consensus_queue.cc:1059] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:34.921635  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.908582  6514 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:34.926738  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.896863  2302 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:00:34.927429  2302 pending_rounds.cc:85] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Aborting all ops after (but not including) 9
I20260709 13:00:34.927719  2302 pending_rounds.cc:107] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:00:34.928021  2302 raft_consensus.cc:2889] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.929913  1504 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
W20260709 13:00:34.899423  6716 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.157s	user 0.002s	sys 0.002s
I20260709 13:00:34.932535  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.933073  1581 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:34.906021  1610 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:34.936450  6474 consensus_queue.cc:1048] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:34.937965  6644 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.964905  6474 consensus_queue.cc:1243] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer 631fb66c0070402b8f78fd74633dae6f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:34.944151  1613 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:34.945461  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:34.966742  6723 log.cc:927] Time spent T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.210s	user 0.005s	sys 0.000s
I20260709 13:00:34.967231  6612 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:34.968473  1504 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:34.968528  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:34.965253  6644 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:34.971577  6644 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:34.946465  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:34.947101  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:34.947759  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:34.948582  6722 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.207s	user 0.006s	sys 0.000s
W20260709 13:00:34.950042  6719 log.cc:927] Time spent T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:00:34.955207  6621 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:34.965281  6703 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.726s	user 0.000s	sys 0.010s
I20260709 13:00:34.957994  6566 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:00:34.960698  1582 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:34.961748  1537 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:34.996981  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:34.997779  6613 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:35.005884  1688 raft_consensus.cc:3055] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.043022  1688 raft_consensus.cc:740] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:35.045576  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 48739.9us
W20260709 13:00:35.040266  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 79630.6us
I20260709 13:00:35.007014  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:34.979631  6294 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:00:35.036582  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.051183  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:35.054919  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:35.047992  2310 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:35.057586  1689 raft_consensus.cc:2368] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15.
I20260709 13:00:35.059227  1682 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:35.044132  1688 consensus_queue.cc:260] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.061026  1688 raft_consensus.cc:3060] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.985436  6621 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.048467  6496 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:35.081018  1689 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:00:35.082237  6726 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:00:35.079154  6670 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:35.083060  1690 raft_consensus.cc:1240] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:35.085533  1687 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:35.085850  6651 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.085929  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.120116  1685 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:35.086431  1686 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:00:35.087339  6623 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:35.089947  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:35.095098  6720 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.368s	user 0.000s	sys 0.006s
I20260709 13:00:35.131071  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:35.067590  6593 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:35.064992  6514 raft_consensus.cc:3055] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:35.057057  6613 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.056633  6622 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:35.099646  6476 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:35.117619  1689 pending_rounds.cc:85] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 8
I20260709 13:00:35.073328  6621 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:35.123837  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.137286  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34880 (request call id 2378) took 1637 ms. Trace:
I20260709 13:00:35.139024  1656 leader_election.cc:400] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:35.147487  1656 leader_election.cc:403] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.142005  1689 pending_rounds.cc:107] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:00:35.148047  1689 raft_consensus.cc:2889] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.123409  6496 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:35.147431  1539 rpcz_store.cc:276] 0709 13:00:33.499610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.537411 (+ 37801us) service_pool.cc:224] Handling call
0709 13:00:33.537695 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.538075 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.538106 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.010384 (+472278us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b2c00000658. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 13:00:34.010868 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.067341 (+ 56473us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.067384 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.067804 (+   420us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.964720 (+896916us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:35.137017 (+172297us) raft_consensus.cc:1685] finished
0709 13:00:35.137047 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.137215 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12,"raft.queue_time_us":682,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":54818304,"thread_start_us":55793,"threads_started":1,"wal-append.queue_time_us":125334}
I20260709 13:00:35.169193  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.177798  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.107997  6427 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:00:35.138089  6593 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:35.141036  6638 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.141242  6514 raft_consensus.cc:740] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:35.186246  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.187559  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.192075  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.126643  6670 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.193698  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.135967  6651 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.158602  6637 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:35.209894  1506 leader_election.cc:400] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15.
I20260709 13:00:35.209600  1653 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:35.195808  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.211545  2302 raft_consensus.cc:1240] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.185176  6566 tablet_bootstrap.cc:492] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 13:00:35.191143  6593 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:35.151556  6476 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.157266  6622 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.174254  6611 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:00:35.257211  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 297554us
I20260709 13:00:35.258204  1579 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:35.247641  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 43578.4us
I20260709 13:00:35.260418  1537 raft_consensus.cc:1275] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:35.208514  6628 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:35.277325  6489 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:00:35.282485  6496 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.283911  6489 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:35.284330  6489 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:35.287436  6670 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:35.253935  6652 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:35.262584  6592 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:35.292620  6592 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.294190  6622 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:35.294598  6592 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:35.296274  6566 ts_tablet_manager.cc:1403] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 1.520s	user 0.043s	sys 0.014s
W20260709 13:00:35.297333  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 51831.4us
I20260709 13:00:35.283433  6476 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:35.299988  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.308713  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:35.304702  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.311043  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:35.285246  6489 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.259624  6637 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:35.321275  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 63205.2us
I20260709 13:00:35.322152  1579 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:35.323621  1579 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:35.325541  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 64329.7us
I20260709 13:00:35.306684  1685 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
W20260709 13:00:35.335785  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.351184  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:35.351919  1614 raft_consensus.cc:606] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:35.352399  1614 raft_consensus.cc:614] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:35.321447  6637 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.275483  6648 consensus_queue.cc:1059] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:00:35.338058  6612 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.351233  1607 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:35.338147  6696 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.348878  5962 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:35.380625  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 118862us
I20260709 13:00:35.355795  6489 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.319257  6514 consensus_queue.cc:260] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.359865  6637 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:35.353791  6613 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:35.395054  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 68326.5us
W20260709 13:00:35.418445  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 87783.2us
I20260709 13:00:35.420214  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:35.423338  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.423844  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.429600  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:35.432282  6648 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:35.433813  6728 log.cc:927] Time spent T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:00:35.437500  6715 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.741s	user 0.000s	sys 0.007s
W20260709 13:00:35.440586  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.443229  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.447525  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.450521  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:35.456641  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:35.402063  6356 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:35.402799  6613 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:35.471572  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 72269.6us
I20260709 13:00:35.472793  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.477715  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.478677  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.480165  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.480551  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.482429  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:35.471175  6729 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:35.489208  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.490001  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.467190  6592 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.439704  6667 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:00:35.482110  6698 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:35.506304  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.478868  6356 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.518117  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:35.518939  1608 raft_consensus.cc:606] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:35.519132  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.521365  6647 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:35.507465  6744 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.505378  6698 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:35.482227  6613 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:35.732295  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.773100  6738 log.cc:927] Time spent T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:00:35.783398  6613 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:35.787298  6356 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:35.797434  6566 raft_consensus.cc:359] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.799196  6566 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 13:00:35.760216  6698 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.523607  6622 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:35.813968  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.740119  6633 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:35.821204  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 327075us
I20260709 13:00:35.767902  6647 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:35.823474  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.760320  6744 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.835003  6744 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:35.829901  6647 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.841910  6647 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:35.843855  6623 consensus_meta.cc:287] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:00:35.800011  6566 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:35.846837  6637 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.848150  6566 ts_tablet_manager.cc:1434] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.551s	user 0.010s	sys 0.000s
W20260709 13:00:35.848505  6566 ts_tablet_manager.cc:1467] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Tablet startup took 551ms
W20260709 13:00:35.829600  6621 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260709 13:00:35.858242  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:35.858124  6621 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.860210  1533 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 16: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:35.860811  6626 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.862757  6626 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.865473  6626 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:35.884986  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:35.885804  1688 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 15: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:35.907049  2310 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:35.911425  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:35.912047  1607 raft_consensus.cc:606] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:35.913415  1684 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:00:35.915910  6593 consensus_meta.cc:287] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.003s
I20260709 13:00:35.916568  6593 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:35.917670  6645 raft_consensus.cc:3055] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:35.918092  6645 raft_consensus.cc:740] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:35.918370  6743 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:35.918573  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 95245.6us
I20260709 13:00:35.918915  6645 consensus_queue.cc:260] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:35.915859  6746 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:35.920601  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.922040  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.923696  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.925300  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:35.926028  1607 raft_consensus.cc:606] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:35.866084  6621 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:35.927439  6632 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.927937  6743 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:35.941249  2310 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:35.931061  6645 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.949760  6637 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:35.944247  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:35.939668  6489 consensus_meta.cc:287] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
I20260709 13:00:35.952198  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.953191  5962 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:35.959551  1687 pending_rounds.cc:85] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Aborting all ops after (but not including) 9
I20260709 13:00:35.959988  1687 pending_rounds.cc:107] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:00:35.848852  6566 ts_tablet_manager.cc:1469] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Trace:
0709 13:00:30.477881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.481767 (+  3886us) service_pool.cc:224] Handling call
0709 13:00:30.669614 (+187847us) ts_tablet_manager.cc:934] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321)
0709 13:00:31.041616 (+372002us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d55b410ac 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5acaa 00007f8d55b5abd2 00007f8d5dbbf131
0709 13:00:32.103405 (+1061789us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:32.289494 (+186089us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:32.296780 (+  7286us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:32.731426 (+434646us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:32.731779 (+   353us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:32.732214 (+   435us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:32.837477 (+105263us) inbound_call.cc:177] Queueing success response
0709 13:00:33.519762 (+682285us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b180011cc20. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55ad8c0a 00007f8d5f218219 00007f8d55a02ed8 00007f8d55b5dde2 00007f8d5dbc2d23 00007f8d5dbc255d 00007f8d5dc5e3d8 00007f8d5dc8ff4e 00007f8d5dc74fdd
0709 13:00:33.776087 (+256325us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:35.296651 (+1520564us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:35.388398 (+ 91747us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:35.389063 (+   665us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":57403,"mutex_wait_us":11886,"raft.queue_time_us":2623,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":46713472,"tablet-copy.queue_time_us":163951,"tablet-download-pool.queue_time_us":18518,"tablet-download-pool.run_cpu_time_us":1586,"tablet-download-pool.run_wall_time_us":824333,"thread_start_us":602901,"threads_started":2}
I20260709 13:00:35.960376  1687 raft_consensus.cc:2889] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.946616  6743 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.967698  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.975068  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.966387  6637 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.980952  6651 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:35.967689  6758 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.976678  6632 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:35.986243  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 456153us
I20260709 13:00:35.986727  5962 raft_consensus.cc:993] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:35.988412  1681 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:00:35.988154  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.987278  5962 raft_consensus.cc:1081] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:35.998375  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:35.995762  6632 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:36.005746  6623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34352 (request call id 3) took 7631 ms. Trace:
I20260709 13:00:36.006261  6623 rpcz_store.cc:276] 0709 13:00:28.374112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.374263 (+   151us) service_pool.cc:224] Handling call
0709 13:00:28.436800 (+ 62537us) log.cc:844] Serialized 506 byte log entry
0709 13:00:28.822565 (+385765us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b540023eea0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bcbb26 00007f8d58bc549a 00007f8d58bc4714 00007f8d58ba4eaa 00007f8d58babd53 00007f8d58babcd9 00007f8d58babc69 00007f8d58babc31 00007f8d58baadfd 000000000038f354
0709 13:00:28.827289 (+  4724us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b540023eea0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc4142 00007f8d58ba4eaa 00007f8d58babd53 00007f8d58babcd9 00007f8d58babc69 00007f8d58babc31 00007f8d58baadfd 000000000038f354 000000000038f199 00007f8d55b5e475
0709 13:00:36.005628 (+7178339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72,"raft.queue_time_us":3683,"raft.run_cpu_time_us":8278,"raft.run_wall_time_us":682021,"spinlock_wait_cycles":15094400,"thread_start_us":40612,"threads_started":1,"wal-append.queue_time_us":38333,"wal-append.run_cpu_time_us":2412,"wal-append.run_wall_time_us":1067979}
I20260709 13:00:36.013394  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:35.997810  6743 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:36.027734  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.030864  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:36.034132  6760 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:00:35.996102  6698 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.036511  6698 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.037781  6593 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.043493  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:36.052512  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:36.052923  1656 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.057247  1681 raft_consensus.cc:2368] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 15. Current term is 16.
I20260709 13:00:35.998706  6696 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:36.066834  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:36.073293  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 85768.5us
I20260709 13:00:36.064478  6748 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.091082  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.093678  1612 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:36.095359  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:36.098201  6655 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:36.098721  6655 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.092474  6592 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:36.101994  6592 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.104046  6592 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.104456  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.105087  1538 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 11.
I20260709 13:00:36.105273  6655 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:36.106681  2306 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEARNER]: Advancing to term 13
I20260709 13:00:36.108156  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.111150  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.113489  1538 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:36.089534  6637 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:36.121608  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:36.122431  2302 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.125313  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:36.117647  2306 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEARNER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:36.130752  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.130990  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79180ee33a124de7a839155b4a30086e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:36.127314  6592 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:36.135145  6592 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.137300  6592 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:36.138782  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.139039  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.139847  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.141108  2302 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:36.140262  6651 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:36.142429  1551 tablet_copy_service.cc:342] P 0f82bbd9193f4b71a0c17a0357cf0ce9: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-8bbf1e27410e4984b453b68cb9b08bd6 received from {username='slave'} at 127.0.0.1:52700
I20260709 13:00:36.142946  1551 tablet_copy_service.cc:434] P 0f82bbd9193f4b71a0c17a0357cf0ce9: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-8bbf1e27410e4984b453b68cb9b08bd6 on tablet 8bbf1e27410e4984b453b68cb9b08bd6 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:36.142635  6651 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.148178  1536 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:36.117035  6655 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:36.120725  6545 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:36.149574  6655 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.148972  1541 raft_consensus.cc:2393] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 15: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:36.152388  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.131565  6476 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:36.154045  6655 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.154366  6476 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.155891  1532 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:36.117702  6687 consensus_queue.cc:1048] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:00:36.163364  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:36.163883  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.164250  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.164538  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.165236  1689 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:36.165439  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:36.166308  6765 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:00:36.164109  1685 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 16: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:36.175359  1610 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 4 to 10, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.178123  1613 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:36.181463  6545 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:36.182441  6545 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.185588  6740 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.186151  6740 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.187387  6651 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.186589  6476 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.188464  6740 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.190568  6514 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:36.191561  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.192942  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.193760  1541 raft_consensus.cc:2410] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:00:36.197633  6499 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 4 to 10, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:36.208547  6732 log.cc:927] Time spent T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.818s	user 0.005s	sys 0.000s
I20260709 13:00:36.207036  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.211504  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.212656  6630 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:36.214591  1504 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.214689  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:36.220180  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.220472  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.220739  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.215541  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.226410  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:36.226904  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:36.230769  6476 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.224773  6724 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.225245  6651 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.227850  6593 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:36.225831  6666 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:00:36.237655  1579 consensus_peers.cc:597] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32066347a26c4c6a94cbe8e9b624cb23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.234267  1504 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:36.240680  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f65122cec34901839f22a448343dca"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
W20260709 13:00:36.245072  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 112353us
I20260709 13:00:36.239229  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34874 (request call id 2650) took 1071 ms. Trace:
I20260709 13:00:36.246933  1607 raft_consensus.cc:606] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:36.247520  1607 raft_consensus.cc:614] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:36.246973  1533 rpcz_store.cc:276] 0709 13:00:35.167695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.167838 (+   143us) service_pool.cc:224] Handling call
0709 13:00:36.239042 (+1071204us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400073854. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:36.239157 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502483200}
I20260709 13:00:36.253979   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:36.266419  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.267246  6630 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:36.267706  6630 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.268136  6630 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.275252  1504 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:36.279409  6655 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.274034  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57982
I20260709 13:00:36.283563  1504 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:36.280014  1689 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:36.284432  1689 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.284545  6655 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:36.287408  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 67753.1us
I20260709 13:00:36.277783  1507 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.297425  1534 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:00:36.297797  1534 pending_rounds.cc:85] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting all ops after (but not including) 6
I20260709 13:00:36.297999  1534 pending_rounds.cc:107] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:00:36.298207  1534 raft_consensus.cc:2889] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.299194  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.275820  6592 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:36.300982  6592 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:36.301334  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe01230b6e6e4a119346bdaa29d78b55" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.301862  6592 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.303738  6655 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.305622  1682 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:00:36.300977  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.309427  6666 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:36.325168  6611 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:36.328109  1507 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.331545  1689 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.332594  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.338665  1682 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:36.344245  1506 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.353104  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.356580  1538 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:00:36.359314  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:36.358467  1533 raft_consensus.cc:2955] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 4 to 10, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.360999  1689 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:36.360502  1614 raft_consensus.cc:3055] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:36.363694  1614 raft_consensus.cc:740] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:36.348536  6476 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.368016  6630 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.370240  6630 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.372803  6638 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:36.375559  6464 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:36.349787  6650 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:36.347918  6495 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.382027   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:36.383720  6514 raft_consensus.cc:993] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:36.383567  1614 consensus_queue.cc:260] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.384270  6514 raft_consensus.cc:1081] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:36.385010  1614 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.386482  6655 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.387019  6655 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.389467  6655 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.392637  2275 leader_election.cc:400] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 15. Current term is 16.
I20260709 13:00:36.395893  2275 leader_election.cc:403] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.396376  6610 raft_consensus.cc:993] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:36.397290  6610 raft_consensus.cc:1081] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:36.397989  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:36.398727  2310 raft_consensus.cc:2393] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 16: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:36.399490  6151 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 15. Current term is 16.
I20260709 13:00:36.401163  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.404436  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.405892  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.406369  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.407800  6645 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:36.407902  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:36.406471  1538 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.412328  1432 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.413980  1432 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.425581  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57982
I20260709 13:00:36.426433  1653 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:36.430228  1683 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:36.430902  1683 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:36.439229  1538 raft_consensus.cc:2468] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:36.440506  1656 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.421321  1541 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:36.456460  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:36.459622  2304 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:36.466495  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34880
I20260709 13:00:36.467162  1533 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:36.467684  1533 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.420105  1432 catalog_manager.cc:5697] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.470446  6223 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:36.479351  1614 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:00:36.465576  6605 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:36.470643  6630 raft_consensus.cc:2804] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:36.483023  6223 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.479686  6526 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 13:00:36.490780  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 210) took 24948 ms (client timeout 15000 ms). Trace:
I20260709 13:00:36.496474  1533 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.492957  1683 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.483686  6632 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:36.498183  1687 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 16. Current term is 17. Ops: []
W20260709 13:00:36.493979  1436 rpcz_store.cc:269] 0709 13:00:11.545313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.545572 (+   259us) service_pool.cc:224] Handling call
0709 13:00:36.487897 (+24942325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:33.502452 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:33.503034 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:33.503083 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:33.503102 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:33.504933 (+  1831us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:33.505042 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:33.505068 (+    26us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:00:33.506813 (+  1745us) tablet.cc:701] Row locks acquired
0709 13:00:33.506863 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:00:33.507029 (+   166us) write_op.cc:270] Start()
0709 13:00:33.507186 (+   157us) write_op.cc:276] Timestamp: P: 1783602033506960 usec, L: 0
0709 13:00:33.507219 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:00:33.737599 (+230380us) log.cc:844] Serialized 8729 byte log entry
0709 13:00:34.080372 (+342773us) op_driver.cc:464] REPLICATION: finished
0709 13:00:34.098815 (+ 18443us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d55b410ac 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d5c681ef0
0709 13:00:34.271496 (+172681us) write_op.cc:301] APPLY: starting
0709 13:00:34.271585 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:34.322845 (+ 51260us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:34.322889 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:34.733544 (+410655us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:34.733921 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 13:00:34.733967 (+    46us) write_op.cc:312] APPLY: finished
0709 13:00:34.734481 (+   514us) log.cc:844] Serialized 196 byte log entry
0709 13:00:34.734692 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.734924 (+   232us) write_op.cc:454] Released schema lock
0709 13:00:34.735001 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:34.735385 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.735413 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11903,"reported_tablets":51,"spinlock_wait_cycles":16768,"child_traces":[["op",{"apply.queue_time_us":189430,"apply.run_cpu_time_us":32934,"apply.run_wall_time_us":463874,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95955,"num_ops":22,"prepare.queue_time_us":296439,"prepare.run_cpu_time_us":15631,"prepare.run_wall_time_us":351698,"raft.queue_time_us":97448,"raft.run_cpu_time_us":22189,"raft.run_wall_time_us":160281,"replication_time_us":572970,"spinlock_wait_cycles":4873472,"thread_start_us":572066,"threads_started":4,"wal-append.queue_time_us":128975,"wal-append.run_cpu_time_us":25769,"wal-append.run_wall_time_us":1879448}]]}
I20260709 13:00:36.513248  1533 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.492486  6630 raft_consensus.cc:697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:36.525777  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:36.526439  1684 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.527724  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:36.529239  6630 consensus_queue.cc:237] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.531658  6223 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.526443  6499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52904 (request call id 0) took 2797 ms. Trace:
I20260709 13:00:36.539600  6499 rpcz_store.cc:276] 0709 13:00:33.704650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.704783 (+   133us) service_pool.cc:224] Handling call
0709 13:00:33.983279 (+278496us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b540010c0a0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc8520 00007f8d58c51b42 00007f8d58c50800 00007f8d58c499fa 00007f8d5dc114c9 00007f8d5718dc54 00007f8d5718dbe2 00007f8d5718db11 00007f8d5718da8c 00007f8d5718cd42
0709 13:00:34.101555 (+118276us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b4c00486800. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d56f17a20 00007f8d56f28a29 00007f8d56eee644 00007f8d56f15f2d 00007f8d56f15b93 00007f8d58ba41af 00007f8d58ba3f3e 00007f8d58c29888 00007f8d58c4675c 00007f8d58c4776a 00007f8d58c4691b
0709 13:00:34.114499 (+ 12944us) log.cc:844] Serialized 501 byte log entry
0709 13:00:34.898614 (+784115us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:34.950755 (+ 52141us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b540010c0a0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc4142 00007f8d58ba4eaa 00007f8d58babd53 00007f8d58babcd9 00007f8d58babc69 00007f8d58babc31 00007f8d58baadfd 000000000038f354 000000000038f199 00007f8d55b5e475
0709 13:00:36.502188 (+1551433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10778,"raft.queue_time_us":24022,"raft.run_cpu_time_us":2413,"raft.run_wall_time_us":458803,"spinlock_wait_cycles":172429696,"thread_start_us":253669,"threads_started":1,"wal-append.queue_time_us":383216,"wal-append.run_cpu_time_us":8957,"wal-append.run_wall_time_us":1406777}
I20260709 13:00:36.545290  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1bb16b93f1fe47b4be38ae591c62b564 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:36.545739  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:36.554574  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 07fbe913c7484df18b86408c13eabaad: Illegal state: Replica d3b488cf00f7497ea0bf5964b99f6e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:36.553947  1432 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 12, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.557788  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.556097  1432 catalog_manager.cc:5697] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.498482  6526 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.560112  1432 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.561561  1432 catalog_manager.cc:5697] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 11 to 13, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.573067  6655 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.573668  6655 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.575915  6655 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:36.580724  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.597539  2304 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:00:36.598934  1653 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:36.601454  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.602460  1615 raft_consensus.cc:2410] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:00:36.563308  1432 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 12, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.605509  6637 raft_consensus.cc:2804] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:36.614241  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:36.504240  6632 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.647178  1684 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:36.609869  6698 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:36.638510  6637 raft_consensus.cc:697] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:36.613067  6751 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:36.682395  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.670392  6464 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.689231  6652 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:36.692517  6464 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.694968  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.706280  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.707001  1533 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
I20260709 13:00:36.710124  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:36.694180  6637 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:36.717748  6789 log.cc:927] Time spent T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:00:36.720070  1682 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:36.712836  6751 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:36.723255  6782 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:00:36.725481  6632 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.727741  6751 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.728211  6751 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.733048  6464 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.736899  1532 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:36.737180  2306 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:00:36.748701  6788 log.cc:927] Time spent T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:00:36.756361  1614 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:36.756820  1614 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:36.757555  1614 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.758868  1614 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.761003  6526 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.763281  6761 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:00:36.770658  6612 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:36.771111  6612 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:36.773655  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.774333  1689 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:36.775326  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.785377  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:36.786861  6476 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:36.788666  5962 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:36.786365  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 46306.2us
I20260709 13:00:36.796397  1613 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:36.771927  6612 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.683164  1432 catalog_manager.cc:5697] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 9 to 11, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 11 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.801823  6612 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:36.804999  6756 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:36.807720  6644 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:36.808317  6644 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:36.810516  6644 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.838752  1683 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.840749  1614 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:36.844508  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:36.846275  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.846915  1541 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:36.850122  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.850862  1538 raft_consensus.cc:2393] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 17: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:36.803970  1432 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 13, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.862526  1541 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 17.
I20260709 13:00:36.865952  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.868271  6623 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:36.870041  1432 catalog_manager.cc:5697] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 12 to 14, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.875226  6702 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:36.875984  6702 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:36.877175  6702 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.881470  6464 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:36.882249  6464 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.892092  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.832705  6724 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:36.903827  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.889889  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:36.904826  1532 raft_consensus.cc:2368] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14.
I20260709 13:00:36.902295  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:36.907364  1582 leader_election.cc:400] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14.
I20260709 13:00:36.907685  1582 leader_election.cc:403] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.914620  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:36.885712  6751 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.909446  6724 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:36.930365  6724 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.932469  6751 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.935173  6661 raft_consensus.cc:1064] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 13:00:36.932508  1615 raft_consensus.cc:2368] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 17. Current term is 18.
I20260709 13:00:36.938189  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:36.938887  1682 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.888756  1432 catalog_manager.cc:5697] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.943823  1432 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 11 to 15, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.945463  1432 catalog_manager.cc:5697] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 15, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.937824  6661 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:36.923890  1656 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:36.954048  6630 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.956193  6464 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:36.957093  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.957901  1683 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 17: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:36.920105  6454 raft_consensus.cc:3060] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.957118  1656 leader_election.cc:400] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 17. Current term is 18.
I20260709 13:00:36.959827  1656 leader_election.cc:403] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.951140  1432 catalog_manager.cc:5697] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 14, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.964442  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:36.975695  2308 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEARNER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:36.970376  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:36.971238  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:36.976511  1541 raft_consensus.cc:3060] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.916527  6613 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:36.982929  6797 ts_tablet_manager.cc:933] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:36.983633  1541 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
W20260709 13:00:36.985162  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 119523us
I20260709 13:00:36.976608  1539 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
I20260709 13:00:36.987283  1582 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:36.992645  1611 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 17.
I20260709 13:00:36.997793  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:36.999693  1683 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:37.002553  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 154203us
I20260709 13:00:37.001967  6526 raft_consensus.cc:2804] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:37.007020  6526 raft_consensus.cc:697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:37.009209  6448 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:37.009697  6448 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:37.010074  6448 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:37.007854  6526 consensus_queue.cc:237] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:37.012679  1432 catalog_manager.cc:5697] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.014467  1432 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 11 to 14, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 14 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:36.994900  6613 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:37.019266  6613 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:37.025398  1614 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:37.031951  1682 raft_consensus.cc:2468] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
I20260709 13:00:36.996963  6476 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:37.034505  6740 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 17. Current term is 18.
I20260709 13:00:37.058159  6795 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:00:37.061787  6792 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:00:37.065925  6793 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:00:37.076733  6794 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.003s
I20260709 13:00:37.078100  6454 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14.
I20260709 13:00:37.081843  6650 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:37.049232  1432 catalog_manager.cc:5697] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 6 to 12, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.102980  1432 catalog_manager.cc:5697] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 12, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 12 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:37.105376  1540 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:37.105376  1615 raft_consensus.cc:1275] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:37.108605  6613 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:37.110031  6744 consensus_queue.cc:1048] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:37.242616  6803 log.cc:927] Time spent T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:00:37.327139  6780 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:37.173976  6448 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:37.107523  1432 catalog_manager.cc:5697] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 9 to 12, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 12 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:37.332060  6797 tablet_copy_client.cc:323] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 13:00:37.382293  1615 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:37.398689   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.422209  6448 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:37.430616  6743 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:37.462682  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 72253.3us
I20260709 13:00:37.469426  1540 raft_consensus.cc:3060] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.484552  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:37.487527  1540 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:37.494463  1539 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:00:37.527208  1532 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
W20260709 13:00:37.554921  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 64673.7us
W20260709 13:00:37.555027  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 89808.3us
I20260709 13:00:37.439996  1432 catalog_manager.cc:5697] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 6 to 7, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.557845  6813 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 13:00:37.590535  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 57943.6us
I20260709 13:00:37.616974  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:37.621919  1687 raft_consensus.cc:2393] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 17: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:37.622843  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet 32066347a26c4c6a94cbe8e9b624cb23 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 13:00:37.623530  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet 32066347a26c4c6a94cbe8e9b624cb23 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-32066347a26c4c6a94cbe8e9b624cb23
W20260709 13:00:37.633523  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 77142.1us
W20260709 13:00:37.634982  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 134074us
I20260709 13:00:37.648998  1582 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:37.659492  6514 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:37.667310  1613 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:00:37.660053  6514 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:37.669497  6514 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:37.671490  1681 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:37.681438  6495 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 8 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:37.704895  1541 raft_consensus.cc:1275] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:00:37.750460  1626 tablet_copy_source_session.cc:215] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:37.647774  6637 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:00:37.757083  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61524.9us
I20260709 13:00:37.768018  1607 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:37.770645  6696 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:37.771325  6740 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:37.839105  6757 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.900857  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61430.6us
W20260709 13:00:37.908108  6801 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.438s	user 0.000s	sys 0.010s
I20260709 13:00:37.911466  2304 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:37.869700  6820 consensus_queue.cc:1048] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:00:37.958259  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47885.3us
W20260709 13:00:37.958465  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 318602us
W20260709 13:00:37.980553  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 314247us
W20260709 13:00:37.969009  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 201735us
I20260709 13:00:37.918274  6632 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:00:37.920115  6757 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:38.060482  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 48525.8us
W20260709 13:00:38.062489  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54607.6us
W20260709 13:00:38.073572  6830 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:38.075071  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32066347a26c4c6a94cbe8e9b624cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.113996  1539 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:00:38.129971  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 53946.4us
W20260709 13:00:38.146005  6836 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:38.148939  6837 log.cc:927] Time spent T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:38.155848  6696 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:00:38.232760  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 149929us
W20260709 13:00:38.252805  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 108481us
I20260709 13:00:38.249644  2304 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:38.241674  6757 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:38.277334  6632 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.277931  6632 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.280000  6632 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:38.366469  6844 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:38.429512  6464 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:38.501281  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 61428.4us
W20260709 13:00:38.514679  6847 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:38.609331  6454 raft_consensus.cc:493] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:38.610117  6454 raft_consensus.cc:515] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:38.511670  6464 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:38.624719  6757 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:38.789824  6748 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:38.747761  6813 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:38.874964  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 126716us
I20260709 13:00:38.771241  6630 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:38.865785  6613 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:38.863329  6757 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.903842  6613 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:38.880812  6813 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.927150  6464 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:38.916519  6661 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.928155  6454 leader_election.cc:290] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:38.882988  6630 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.941346  6813 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:38.941547  6630 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:38.933938  6613 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:38.939133  6757 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:38.881170  6748 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.949757  6748 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:38.950513  6856 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:38.951264  6856 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:38.944299  6864 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:38.955379  6864 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.958299  6864 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:38.959465  6856 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:38.973225  6852 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:38.973982  6645 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:38.974757  6645 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.982892  6645 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:38.997000  6628 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:38.997606  6628 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:38.999670  6628 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.002867  6774 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.010162  6829 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.010816  6829 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.015425  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.016847  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.016948  6652 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:39.015473  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.018496  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.021351  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.018510  1538 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 17.
I20260709 13:00:39.030189  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.031510  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:38.939875  6661 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.043612  6661 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.003718  6774 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.067149  6774 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.106058  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:39.000172  6628 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:39.127065  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 250207us
W20260709 13:00:39.182037  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47784.1us
W20260709 13:00:39.182296  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48291.9us
I20260709 13:00:39.184152  1656 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:39.109820  6645 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.189980  6645 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.109776  6644 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.192617  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.193073  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:39.193260  1532 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:39.194792  6815 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:39.195966  6815 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:39.196323  6815 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.196653  6815 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:39.197074  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.116240  6835 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.207188  1687 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:39.123940  6748 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.224671  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:39.231704  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.001s
W20260709 13:00:39.232055  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.001s
I20260709 13:00:39.217566  6661 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:39.241393  2276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.004s	sys 0.005s
W20260709 13:00:39.247434  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 260513us
I20260709 13:00:39.249074  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.230068  6666 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.180823  6628 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.225792  6868 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.250392  1682 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:39.252918  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.254786  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:39.241767  2276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.005s	sys 0.005s
W20260709 13:00:39.257074  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 815566us
I20260709 13:00:39.192641  6644 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.223580  6835 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.332683  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.242901  6829 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.242643  6661 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.246816  6526 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 13:00:39.333649  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.003s
W20260709 13:00:39.334335  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.017s	sys 0.003s
I20260709 13:00:39.249673  6866 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 13:00:39.333166  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.009s
I20260709 13:00:39.230486  6748 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:39.341048  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 88929us
W20260709 13:00:39.342114  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.009s
I20260709 13:00:39.352139  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
W20260709 13:00:39.341133  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 93069.8us
I20260709 13:00:39.348089  1684 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:39.253944  6476 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:00:39.374805  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.377588  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.390156  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.390987  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.391100  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.391402  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.349470  6638 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.391589  1611 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 17.
I20260709 13:00:39.341414  6610 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.349594  6686 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.403882  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.340463  6870 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:39.408368  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.402904  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:39.258837  6666 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.359017  6687 raft_consensus.cc:493] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.420457  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.401136  6859 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.374356  6812 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.389015  6637 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.410621  6834 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.422830  6686 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.423300  6628 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.410694  6613 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.430483  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:39.422039  2274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.010s	sys 0.018s
W20260709 13:00:39.531951  2274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.010s	sys 0.019s
I20260709 13:00:39.431309  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff79ac342d91424db634ca7802846535" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:39.377734  6845 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.388254  6811 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:39.347303  6526 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.418799  6610 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.400928  6797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56290 (request call id 766) took 2448 ms. Trace:
I20260709 13:00:39.329887  6868 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.425621  6863 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.602792  6863 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.605110  6661 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.605967  6863 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.518879  6637 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.609917  6666 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.566836  6613 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.611308  6835 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:39.612015  6613 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:39.612121  6835 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.530565  6834 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.612709  6835 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.613452  6644 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.494719  6687 raft_consensus.cc:515] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.614647  6835 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:39.615442  6687 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.619356  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.619956  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.620513  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.621043  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.622208  6610 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.625891  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.629415  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:39.629701  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:39.632282  6862 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.635170  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.636791  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.638604  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.643138  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.410810  6819 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.538245  6464 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:39.584553  6632 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:39.585500  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 182678us
I20260709 13:00:39.585960  6686 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:39.586112  6876 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:39.421411  6638 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.587661  6696 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
W20260709 13:00:39.588161  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 68528.7us
I20260709 13:00:39.667490  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.423890  6870 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.354296  6866 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.518959  6746 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:39.602205  6868 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.650825  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:39.669140  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:39.655632  6857 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:39.668010  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.664366  6878 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:39.580932  6797 rpcz_store.cc:276] 0709 13:00:36.939902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.940034 (+   132us) service_pool.cc:224] Handling call
0709 13:00:36.983308 (+ 43274us) ts_tablet_manager.cc:934] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
0709 13:00:38.070169 (+1086861us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:38.545859 (+475690us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:38.627344 (+ 81485us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:39.252386 (+625042us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:39.334760 (+ 82374us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:39.374375 (+ 39615us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:39.388721 (+ 14346us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":151065,"tablet-copy.queue_time_us":42428,"thread_start_us":237869,"threads_started":2}
I20260709 13:00:39.748685  1607 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:39.681779  6526 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.683427  6815 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.572151  6845 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.689509  6632 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.692247  6464 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.694180  6638 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.694777  6696 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.730657  6811 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.874327  6696 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.838742  6797 tablet_copy_client.cc:806] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:39.876444  6797 tablet_copy_client.cc:670] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:39.698688  6819 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.878085  6464 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.879798  6819 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:39.704236  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 72969.6us
W20260709 13:00:39.744828  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 48090.1us
I20260709 13:00:39.905557  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:39.761767  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:39.664433  6876 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.632972  6862 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.537102  6795 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:00:39.831490  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 169780us
I20260709 13:00:39.501864  6859 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.609961  6637 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:39.910054  1690 raft_consensus.cc:1240] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:39.747936  6857 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.929505  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:39.501658  6812 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:39.881716  6811 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:39.939309  6882 log.cc:927] Time spent T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:39.942692  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.945519  6859 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.921412  6876 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.949757  6870 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:39.755147  6878 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.951967  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.952601  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.953634  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.954383  1615 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:39.955034  6866 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:39.955149  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.956709  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:39.961719  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.923674  6819 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:39.910005  6861 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:39.963166  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.051855  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.964697  6857 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:39.970474  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.067s	sys 0.136s
I20260709 13:00:39.996196  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:40.054334  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.067s	sys 0.136s
I20260709 13:00:40.044279  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.044282  1538 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:40.054482  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.038422  6813 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:40.055200  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:39.969604  6808 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:39.969874  6725 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:39.966295  6696 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:39.970616  6834 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:40.071806  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 98741us
W20260709 13:00:40.054713  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 645771us
I20260709 13:00:40.082716  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.089869  1582 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:39.743793  6746 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:39.937871  6795 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:40.122027  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.126547  1540 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:40.127856   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:40.141295  1688 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.026s	sys 0.014s
W20260709 13:00:40.141767  1688 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.026s	sys 0.014s
I20260709 13:00:40.145828  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.143409  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:40.121786  6834 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.162350  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.167523  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.170078  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.173763  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.119131  6696 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.117440  6813 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:40.192358  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49026.7us
I20260709 13:00:40.197989  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:40.193171  6628 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:40.200434  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.202414  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.281385  1607 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:40.118739  6725 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.288659  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.289249  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.288174  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.103343  6861 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:40.318549  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.320686  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.274621  6476 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.324585  6884 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.335621  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.337316  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.325459  6884 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.342612  6884 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.338126  1608 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:40.374827  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.375583  1616 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:40.376507  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.381259  6868 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:40.382251  6645 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.275424  6628 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:40.407320  1579 leader_election.cc:304] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:40.397562  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.030s	sys 0.059s
W20260709 13:00:40.408311  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.031s	sys 0.059s
I20260709 13:00:40.411244  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.412432  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.412920  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.413224  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.411873  1682 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:40.414287  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.415493  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.416898  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.418557  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.392990  6632 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:40.428751  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.434324  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:40.448539  6666 raft_consensus.cc:2749] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:40.449230  6887 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:40.413566  6628 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:40.450124  6878 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.453035  6820 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:40.454005  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.453142  1579 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:40.455552  6871 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:40.419078  6868 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.457912  6868 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.458782  1579 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:40.459470  6628 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:40.460697  6871 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:40.463572  1579 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:40.473160  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:40.493218  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57982 (request call id 2466) took 1116 ms. Trace:
I20260709 13:00:40.475449  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.485603  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbc1ad76ba949aba54340f33a210d0d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.489145  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:40.488309  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.490366  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:40.497803  1609 raft_consensus.cc:606] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:40.498255  1609 raft_consensus.cc:614] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:40.498138  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.478482  1613 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:40.407927  6815 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:40.493733  1690 rpcz_store.cc:276] 0709 13:00:39.376747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.376897 (+   150us) service_pool.cc:224] Handling call
0709 13:00:39.410985 (+ 34088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.938563 (+527578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.492981 (+554418us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540035c354. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:40.493158 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098561408}
W20260709 13:00:40.503556  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 415122us
I20260709 13:00:40.506721  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:40.464165  6876 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.496680  6628 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.511480  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:40.465595  6871 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:40.471191  6748 leader_election.cc:290] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.517227  6795 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.472473  6875 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:40.502741  6862 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.527755  6748 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:40.528162  6748 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:40.528573  6748 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.529951  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:40.530565  1609 raft_consensus.cc:606] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:40.511282  6661 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.535780  6696 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.537900  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.533531  6875 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.545240  6725 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.546952  6812 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:40.549786  6875 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.550755  6861 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.567056  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.534300  6746 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.570936  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.572706  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.573638  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.582137  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:40.588587  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:40.590404  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
W20260709 13:00:40.592099  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 80696.2us
I20260709 13:00:40.594259  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.598428  1507 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:40.600031  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.601514  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.601514  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.554863  6748 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:40.605662  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.591981  6761 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:40.586675  6876 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.607139  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.608629  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.591081  6875 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:40.609720  1504 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:40.609956  1608 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:40.610960  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:40.612293  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.621716  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:40.623459  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.624156  1688 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:40.600200  6774 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:40.625764  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.626453  1689 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:40.620273  6797 tablet_copy_client.cc:538] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:40.629774  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.621258  6740 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.622967  6645 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:40.636394  6740 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.625665  6826 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:40.626911  6813 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:40.638893  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:40.620990  6628 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:40.643667  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 2272) took 1399 ms. Trace:
I20260709 13:00:40.644111  6628 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:40.621533  6761 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.631832  6774 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:40.626861  6878 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:40.644207  1610 rpcz_store.cc:276] 0709 13:00:39.243993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.244134 (+   141us) service_pool.cc:224] Handling call
0709 13:00:39.244427 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.501138 (+256711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.501178 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:39.501221 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:39.501249 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.643431 (+1142182us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002b5054. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4be01 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:40.643476 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.643592 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589987200}
I20260709 13:00:40.647584  6761 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.649799  6605 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.656493  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.656219  6605 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.658475  6605 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.660504  6748 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:40.650564  6774 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:40.665889  6740 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.671729  6790 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:40.672199  6630 raft_consensus.cc:493] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.653883  6878 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.673378  6878 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:40.672842  6630 raft_consensus.cc:515] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:40.653515  6811 consensus_meta.cc:287] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.000s
I20260709 13:00:40.644589  6628 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:40.673285  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:40.676994  6630 leader_election.cc:290] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:40.678982  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.693168  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:40.695153  1616 raft_consensus.cc:2468] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:00:40.696395  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:40.696938  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46810 (request call id 2667) took 1029 ms. Trace:
I20260709 13:00:40.697245  1615 rpcz_store.cc:276] 0709 13:00:39.667441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.667786 (+   345us) service_pool.cc:224] Handling call
0709 13:00:40.696769 (+1028983us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54003732d4. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4f2fa 00007f8d5dc10b17 00007f8d5718b6d4 00007f8d5718b662 00007f8d5718b591 00007f8d5718b50c 00007f8d5718a7c2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:40.696885 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496976256}
I20260709 13:00:40.712249  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:40.711071  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 82079.3us
I20260709 13:00:40.714141  1653 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:40.715373  1653 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:40.767613  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 52338.8us
W20260709 13:00:40.818557  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 106139us
I20260709 13:00:40.672829  6761 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:40.695814  6903 raft_consensus.cc:493] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.712056  6861 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:40.863636  6815 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.866096  6740 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:40.927090  6894 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:40.929394  6761 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:40.699087  6811 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:40.949581  6901 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.941179  6605 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:40.949326  6863 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.017477  6863 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:41.025067  6605 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.941635  6696 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:41.035015  6696 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:40.956881  6774 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.046600  6774 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.049391  6774 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.004518  6901 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.052148  6901 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.055497  6761 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.057569  6761 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.954092  6861 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.068354  6861 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.083423  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.084419  2310 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:40.947705  6903 raft_consensus.cc:515] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.072297  6907 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.092437  6903 leader_election.cc:290] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.015367  6811 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.091745  6907 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.096966  6907 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:40.991747  6894 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.100185  6894 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.104282  6863 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:41.133880  6907 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.134501  6907 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.129160  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:41.136658  6907 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:41.140209  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.141674  6866 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:41.142222  6866 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.142661  6866 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:41.146427  6696 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.105997  6605 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.132690  6878 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.158203  6878 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:40.936631  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 116312us
I20260709 13:00:41.182225  6863 raft_consensus.cc:493] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:41.187558  6903 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.184262  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.205947  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.207470  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:41.206686  6870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.075s	sys 0.165s
I20260709 13:00:41.224632  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.213313  6748 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.221081  6644 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.236631  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:41.231868  6870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.076s	sys 0.165s
I20260709 13:00:41.225854  6815 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:41.235954  6744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.016s	sys 0.006s
I20260709 13:00:41.214661  6903 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.245378  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.207513  6863 raft_consensus.cc:515] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.246773  6630 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.250600  1656 leader_election.cc:304] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.251402  6630 raft_consensus.cc:2749] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.236984  6907 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:41.243881  6744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.016s	sys 0.007s
I20260709 13:00:41.249073  6748 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:41.253818  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.255177  6797 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 13:00:41.274766  6903 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:41.279881  6628 consensus_meta.cc:287] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.004s
I20260709 13:00:41.291718  6790 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:41.385672  6790 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.387988  1536 raft_consensus.cc:1240] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:41.388693  6811 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.389904  6811 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.391153  6841 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:41.302654  6863 leader_election.cc:290] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.348568  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.350312  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.352842  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:41.363478  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 109576us
I20260709 13:00:41.371946  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:41.289222  6628 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.373749  6696 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.375204  6744 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.392679  6834 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.381510  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.304155  6866 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.404397  6696 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.404922  6834 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.407493  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.407850  6834 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.348376  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.412039  6790 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:41.392202  6841 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.413158  6845 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.422631  6861 raft_consensus.cc:493] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:41.407626  6696 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.423822  6628 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.428169  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.428537  6855 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.429385  6855 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.431398  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.397652  6811 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.432551  1615 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 17.
I20260709 13:00:41.433902  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.438197  6903 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.441113  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.445283  6744 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:41.446401  6905 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.447045  6841 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.447232  6905 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:41.448137  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 162763us
I20260709 13:00:41.423471  6861 raft_consensus.cc:515] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.457903  6861 leader_election.cc:290] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.458652  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.460106  6855 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.467141  6866 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.468756  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.468861  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:41.469838  2308 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:41.472764  1538 raft_consensus.cc:1240] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:41.473626  6905 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:41.481334  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:41.482692  6744 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:41.483300  6744 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:41.483747  6744 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.484355  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.491003  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:41.482673  2308 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 16.
I20260709 13:00:41.498296  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.504673  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.510012  6821 consensus_queue.cc:1059] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:41.513813  1538 raft_consensus.cc:2393] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 15: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:41.514235  1581 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.519304  6845 raft_consensus.cc:2749] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.522459  1538 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:41.512159  6821 raft_consensus.cc:3055] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:41.529930  6821 raft_consensus.cc:740] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:41.532141  6855 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:41.533034  6855 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:41.533618  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 52542.9us
I20260709 13:00:41.535630  6855 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.531534  6821 consensus_queue.cc:260] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.539006  6915 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.542132  6821 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.542418  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51296 (request call id 39) took 1012 ms. Trace:
I20260709 13:00:41.543071  1609 rpcz_store.cc:276] 0709 13:00:40.529683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.529832 (+   149us) service_pool.cc:224] Handling call
0709 13:00:41.541956 (+1012124us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4c004b9400. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d56f17a20 00007f8d56f28a29 00007f8d56eee644 00007f8d56f15f2d 00007f8d56f15b93 00007f8d58c45c92 00007f8d58c4584a 00007f8d5dc1360a 00007f8d571997d4 00007f8d57199762 00007f8d57199691
0709 13:00:41.542173 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004288}
I20260709 13:00:41.543795  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:41.544343  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 141533us
I20260709 13:00:41.549539  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.550410  2306 raft_consensus.cc:1240] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:41.551060  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.551910  1536 raft_consensus.cc:2468] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:41.553932  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.555338  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.556139  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.557539  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.553978  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:41.559845  6872 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:41.539696  6915 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.560405  6872 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:41.560982  6872 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:41.562033  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.563616  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:41.564613  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 64626.9us
I20260709 13:00:41.556368  1536 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 18: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:41.560021  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.552947  1581 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.567880  6638 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.571226  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.572513  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.572595  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:41.582423  1581 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.583068  6916 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.584038  6916 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.584554  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.586624  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.587072  6916 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.584036  6859 raft_consensus.cc:2749] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.605741  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.610349  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.611109  1612 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:41.500509  6744 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.612929  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.613960  6744 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:41.614259  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.615671  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.612082  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.616964  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:41.599612  6915 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.618974  6914 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:41.619239  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.619452  6914 raft_consensus.cc:493] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.619369  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.620113  6914 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.622964  6638 consensus_queue.cc:1059] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:41.624441  6870 raft_consensus.cc:3055] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:41.624790  6870 raft_consensus.cc:740] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:41.626202  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.625958  6870 consensus_queue.cc:260] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.627446  6870 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.629935  1506 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.586895  2275 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.635612  6861 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:41.639362  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:41.632439  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45879.6us
I20260709 13:00:41.641616  1582 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.645859  1540 raft_consensus.cc:1240] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:41.646072  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab255080f74412f87943c46e12f9f06" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:41.649542  1579 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.650730  6857 consensus_queue.cc:1059] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:41.651477  6638 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.651886  6857 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.652274  6638 raft_consensus.cc:3055] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:41.652673  6638 raft_consensus.cc:740] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:41.652722  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:41.653720  6638 consensus_queue.cc:260] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.662691  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.664862  6638 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:41.676126  6862 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.670650  2275 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.681751  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.683604  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.684767  1504 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.688344  6861 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.680678  6821 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.666819  6872 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.704768  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea53f766b5a4fd081983e46c7fd5da9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:41.706722  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 138704us
I20260709 13:00:41.707286  1504 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.708840  1504 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.710168  6454 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:41.711905  6454 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:41.713683  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.719811  6454 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:41.720647  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 91016.2us
I20260709 13:00:41.721621  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.714150  6916 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:41.722572  6916 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:41.707053  1609 raft_consensus.cc:606] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:41.723803  6916 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.724499  1609 raft_consensus.cc:614] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:41.714819  6829 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:41.716493  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 53856.1us
I20260709 13:00:41.728119  2275 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.733049  6821 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.733150  2276 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.734851  6855 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.737620  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.738756  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d3893a9300428592d3ce769b91a4db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.739068  6868 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.739748  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.740579  1690 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
I20260709 13:00:41.741353  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.741436  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.742672  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.739145  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.744251  2302 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:41.744735  1689 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:00:41.747604  6872 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:41.749274  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 107778us
I20260709 13:00:41.749804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:41.752678  1581 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.753593  6857 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.716627  1435 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 7 to 10, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:41.717905  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.758848  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:41.760432  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.760732  1609 raft_consensus.cc:606] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:41.760901  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:41.762144  6914 raft_consensus.cc:515] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.763279  2308 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:41.756441  2275 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.763698  6865 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:41.765012  6811 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:41.765048  6872 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.765578  6811 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:41.765937  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:41.766695  1609 raft_consensus.cc:606] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:41.765493  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:41.770226  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.768711  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.771453  1612 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.770545  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.702255  6862 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.772347  6872 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:41.773883  6821 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:41.772284  6863 consensus_queue.cc:1059] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:00:41.774219  6872 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:41.777256  6872 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:41.779599  6829 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:41.766812  6811 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.786278   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:41.789196  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.783392  6829 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:41.794250  6829 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.797130  6857 raft_consensus.cc:993] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:41.797724  6845 raft_consensus.cc:1081] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:41.792773  6915 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:41.799526  6845 raft_consensus.cc:993] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:41.800041  6845 raft_consensus.cc:1081] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:41.800981  6811 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:41.804555  1532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34880
I20260709 13:00:41.806593  1532 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.806974  1532 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.810403  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f171d98ea4aedbd87b5f98c2c0127" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:41.804858  6862 raft_consensus.cc:993] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:41.810742  1581 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.813103  1537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34880
I20260709 13:00:41.816351  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1246638ecc3b4bf59847dec07f61fd3d" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.822039  1537 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.822463  1537 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:41.828403  6744 raft_consensus.cc:3055] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:41.829082  6744 raft_consensus.cc:740] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:41.830266  6744 consensus_queue.cc:260] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.836859   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:41.805475  6454 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.864969  6454 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.862717  2304 consensus_queue.cc:237] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.871579  1537 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.849272  1532 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.850749  6862 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.874966  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.875056  6862 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.792250  6914 leader_election.cc:290] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:41.855909  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 85871.1us
I20260709 13:00:41.862171  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.846514  6872 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.851451  6725 raft_consensus.cc:1081] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:41.875726  1613 raft_consensus.cc:3055] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:41.856137  1423 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1bb16b93f1fe47b4be38ae591c62b564 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c445b7b7d94f48f99a3599ddfc92f462 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:41.877804  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.882949  1537 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:41.885892  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 95097.3us
I20260709 13:00:41.886945  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.887032  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.888808  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.889076  6866 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:41.890266  6866 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:41.890519  1541 raft_consensus.cc:1240] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:41.890735  6866 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.892006  1538 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 13: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:41.893703  6696 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:41.896205  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:41.897521  6845 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.897662  6829 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.899981  1612 raft_consensus.cc:2468] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:41.883581  1613 raft_consensus.cc:740] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:41.901046  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.901098  1532 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.908388  6865 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.909505  6725 consensus_queue.cc:1059] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:41.910559  6725 raft_consensus.cc:3055] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:41.910718  6872 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.910982  6725 raft_consensus.cc:740] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:41.911736  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:41.912360  1689 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:41.912072  6725 consensus_queue.cc:260] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.914000  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.914805  1615 raft_consensus.cc:3055] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:41.913570  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:41.920822  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:41.915261  1615 raft_consensus.cc:740] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:41.898662  6857 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.939517  6862 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.927297  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:41.932389  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.945197  1613 consensus_queue.cc:260] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.932833  6744 raft_consensus.cc:3060] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.946355  1613 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:41.933997  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 45345us
I20260709 13:00:41.949101  1506 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:41.950160  6774 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.950666  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:41.951593  6774 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:41.956067  1540 raft_consensus.cc:1240] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Rejecting Update request from peer c445b7b7d94f48f99a3599ddfc92f462 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:41.959228  6829 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Requested vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:41.937819  6866 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.960191  1615 consensus_queue.cc:260] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.962134  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:41.962332  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46818 (request call id 2288) took 1680 ms. Trace:
I20260709 13:00:41.963564  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:41.962792  1614 rpcz_store.cc:276] 0709 13:00:40.203567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.392356 (+188789us) service_pool.cc:224] Handling call
0709 13:00:40.696923 (+304567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.697398 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.697440 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.697949 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.527311 (+829362us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800017c20. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b40e07 00007f8d5e99bab9 00007f8d55b5d69b 00007f8d55b5b93f 00007f8d55b5dc02 00007f8d587e520b 00007f8d587ead23 00007f8d587eb0d1 00007f8d58c06a0f
0709 13:00:41.698345 (+171034us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.702612 (+  4267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.769657 (+ 67045us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.769693 (+    36us) raft_consensus.cc:1685] finished
0709 13:00:41.769703 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.883896 (+114193us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54003732d0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4a8ad 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2 00007f8d56f8648c 00007f8d56f858c6 00007f8d56f8526f
0709 13:00:41.883999 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94214,"raft.queue_time_us":125,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5344,"spinlock_wait_cycles":728206080,"thread_start_us":132764,"threads_started":1,"wal-append.queue_time_us":1029061}
I20260709 13:00:41.964393  6872 consensus_queue.cc:1059] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:41.965561  6914 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:41.913143  6725 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:41.965960  6914 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:41.967121  6914 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:41.968643  6914 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:41.974635  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 65360us
I20260709 13:00:41.975917  1615 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.976239  6916 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:41.976950  6916 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:41.979729  6916 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.962369  6866 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:41.989574  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.991022  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:41.990461  1607 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:41.996209  1689 raft_consensus.cc:2468] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 17.
I20260709 13:00:41.990413  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.003409  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61d39ca56d420fbee59be16467e2ec" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.005373  2275 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:42.007680  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.008879  1614 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 11.
I20260709 13:00:42.019371  6757 raft_consensus.cc:493] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:42.020183  6757 raft_consensus.cc:515] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.022539  6757 leader_election.cc:290] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:42.005908  6829 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:42.024927  6841 raft_consensus.cc:2804] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:42.024756  6829 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.025518  6841 raft_consensus.cc:697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:42.026538  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:42.027616  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.009887  1435 catalog_manager.cc:5697] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 7 to 10, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.039855  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:42.049319  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.050187  1614 raft_consensus.cc:1240] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:42.054100  2276 leader_election.cc:304] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:42.064656  6223 raft_consensus.cc:2804] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:42.065280  6223 raft_consensus.cc:697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:42.066329  6223 consensus_queue.cc:237] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.026568  6841 consensus_queue.cc:237] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.076159  1681 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:42.081898  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:42.074368  6811 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:42.090376  1533 raft_consensus.cc:1240] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:42.088404  6645 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:42.082700  6829 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:42.091696  6645 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:42.099435  1609 raft_consensus.cc:1275] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:42.097499  6645 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.108002  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 139) took 8066 ms. Trace:
I20260709 13:00:42.113013  6901 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:42.113651  6901 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.115842  6901 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.117762  6872 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:42.127172  6872 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.129467  6872 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:42.101307  6811 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.132402  6638 consensus_queue.cc:1059] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:42.134020  6638 raft_consensus.cc:3055] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:42.134465  6638 raft_consensus.cc:740] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:42.135468  6638 consensus_queue.cc:260] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.146735  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.096298  6821 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:00:42.160511  1613 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:42.161702  1615 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
W20260709 13:00:42.163214  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 86029us
I20260709 13:00:42.167470  1615 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:42.167657  1507 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:42.195405  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.199826  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 137927us
W20260709 13:00:42.204353  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.208561  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:42.216585  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 49024.6us
I20260709 13:00:42.175058  6901 raft_consensus.cc:493] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:42.163277  6863 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:42.228313  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:42.231226  1614 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:42.108516  1432 rpcz_store.cc:276] 0709 13:00:33.952118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.952373 (+   255us) service_pool.cc:224] Handling call
0709 13:00:42.007078 (+8054705us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:37.974752 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:37.975348 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:37.975388 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:00:37.975408 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:37.977174 (+  1766us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:37.977234 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:37.977264 (+    30us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:00:37.978957 (+  1693us) tablet.cc:701] Row locks acquired
0709 13:00:37.978978 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:00:37.979128 (+   150us) write_op.cc:270] Start()
0709 13:00:37.979244 (+   116us) write_op.cc:276] Timestamp: P: 1783602037979077 usec, L: 0
0709 13:00:37.979266 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:37.979956 (+   690us) log.cc:844] Serialized 8193 byte log entry
0709 13:00:38.382154 (+402198us) op_driver.cc:464] REPLICATION: finished
0709 13:00:38.748177 (+366023us) write_op.cc:301] APPLY: starting
0709 13:00:38.784660 (+ 36483us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:39.003842 (+219182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:39.003978 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:39.946473 (+942495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:39.946796 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 13:00:39.946849 (+    53us) write_op.cc:312] APPLY: finished
0709 13:00:39.947337 (+   488us) log.cc:844] Serialized 188 byte log entry
0709 13:00:40.403581 (+456244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.403804 (+   223us) write_op.cc:454] Released schema lock
0709 13:00:40.412040 (+  8236us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:40.512176 (+100136us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.513925 (+  1749us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5675,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":238439,"apply.run_cpu_time_us":173299,"apply.run_wall_time_us":1817424,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":183207,"prepare.run_cpu_time_us":14340,"prepare.run_wall_time_us":38065,"raft.queue_time_us":107413,"raft.run_cpu_time_us":35408,"raft.run_wall_time_us":229157,"replication_time_us":383198,"thread_start_us":702781,"threads_started":5,"wal-append.queue_time_us":660684,"wal-append.run_cpu_time_us":14501,"wal-append.run_wall_time_us":2184415}]]}
I20260709 13:00:42.224633  6811 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:42.234256  6661 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:42.174851  6915 consensus_queue.cc:1048] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
W20260709 13:00:42.212821  6797 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 13:00:42.250174  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:42.251085  2308 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:42.249804  1507 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:42.256870  2304 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 LEADER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:42.230890  6638 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:42.264672  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396314c408674415abb66b1625b8a308" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:42.253988  6866 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:42.268249  6863 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.270555  6863 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.271659  6645 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.274181  6645 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:42.276458  1687 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:42.277597  6926 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:42.278443  6926 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.252954  6661 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:42.234511  6901 raft_consensus.cc:515] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.295984  6661 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.297186  6901 leader_election.cc:290] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:42.272022  6863 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:42.310863  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:42.311327  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:42.312012  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:42.294852  6797 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:42.317827  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:42.322631  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.323350  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:42.326016  1684 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 15: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:42.290658  6865 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:42.328125  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57982
I20260709 13:00:42.328843  1682 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:42.329311  1682 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.330521  6863 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.333376  6863 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.340517  6865 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:42.341576  6865 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.345597  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:42.346959  1581 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:42.352193  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 91088us
I20260709 13:00:42.355633  2306 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:42.355243  6857 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:42.373556  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 172880us
I20260709 13:00:42.380986  6744 consensus_queue.cc:1059] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:42.382431  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:42.383584  6454 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:42.384086  1581 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:42.371937  6862 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.385998  6857 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:42.386607  6857 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:42.388571  6845 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.388657  6863 raft_consensus.cc:3055] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:42.390039  6863 raft_consensus.cc:740] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:42.390597  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:42.391644  6696 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:42.393110  6797 tablet_bootstrap.cc:492] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 13:00:42.394351  6863 consensus_queue.cc:260] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.394372  6797 ts_tablet_manager.cc:1403] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 1.151s	user 0.054s	sys 0.024s
I20260709 13:00:42.400323  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:42.375521  1682 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:42.437572  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d2293f596d4cefaf1a169b3a79ba46" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:42.436707  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:42.444538  1682 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.450943  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:42.435271  6926 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.440657  6454 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:42.463569  1656 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:42.456679  6939 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:42.467983  6939 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:42.468405  6939 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.460508  6811 consensus_queue.cc:1059] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:00:42.478152  6866 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:00:42.482452  6863 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:42.487216  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.487003  6901 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.491021  6744 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.492376  6811 consensus_queue.cc:1243] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer c445b7b7d94f48f99a3599ddfc92f462 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:00:42.494043  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 211837us
I20260709 13:00:42.492969  6811 raft_consensus.cc:3055] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:42.497269  6811 raft_consensus.cc:740] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:42.499398  6811 consensus_queue.cc:260] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:42.506803  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 45412.8us
I20260709 13:00:42.509647  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:42.510286  1609 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.513105  6797 raft_consensus.cc:359] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:42.517416  6797 raft_consensus.cc:740] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 13:00:42.519929  6797 consensus_queue.cc:260] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:42.516640  6939 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:42.527784  1615 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:42.522567  1616 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:42.472121  6857 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:42.537914  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 74423.5us
I20260709 13:00:42.539647  6857 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:42.500708  6811 raft_consensus.cc:3060] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:42.540258  1656 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:42.541779  1656 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:42.543139  6926 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.543812  6926 consensus_queue.cc:1059] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:42.544878  6926 raft_consensus.cc:3055] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:42.545337  6926 raft_consensus.cc:740] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:42.546320  6926 consensus_queue.cc:260] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.545063  1612 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:42.552762  6863 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.554136  6829 consensus_queue.cc:1059] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:42.568215  6926 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:42.575006  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.519793  6915 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 8 to 11, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:42.578526  1609 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:42.588320  1614 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:42.589257  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:42.590013  1612 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 15: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:42.592489  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9059b4be41c340278068c13696d1000e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:42.594367  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 59757.5us
I20260709 13:00:42.597045  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:42.597575  1537 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:42.599076  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea39a99a63554d4dbb26f49a38585b4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.600657  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.600741  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.600203  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.638652  6797 ts_tablet_manager.cc:1434] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.240s	user 0.004s	sys 0.004s
W20260709 13:00:42.638906  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 106185us
I20260709 13:00:42.734967  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:42.743110  1609 raft_consensus.cc:3055] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:42.743548  1609 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:42.704103  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.706465  6861 raft_consensus.cc:3055] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:42.746146  1616 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:00:42.749819  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 147273us
I20260709 13:00:42.747197  1609 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:42.757053  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 207764us
W20260709 13:00:42.771938  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.772020  1609 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.778957  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.780349  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.749565  6861 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:42.792068  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.794855  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:42.757869  6926 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:42.797222  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:42.798614  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:42.799530  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a3569684e442e0a362c5e9412961ec" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:42.800062  1688 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:42.756978  6931 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:00:42.803767  1611 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 12: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:42.804813  1689 raft_consensus.cc:1240] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:42.805822  1682 raft_consensus.cc:1240] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:42.809295  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.821353  6946 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.824945  1688 raft_consensus.cc:2468] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:42.828576  6916 consensus_queue.cc:1059] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:42.829638  6811 raft_consensus.cc:3055] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:42.830027  6811 raft_consensus.cc:740] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:42.830847  6811 consensus_queue.cc:260] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.804791  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:42.834894  1507 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:42.839430  1609 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
W20260709 13:00:42.841158  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.840677  6859 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:42.849670  6811 raft_consensus.cc:3060] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:42.852856  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:42.853538  1533 raft_consensus.cc:3060] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.853001  6951 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:42.840987  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 69045.6us
W20260709 13:00:42.861222  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.869637  2275 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:42.872370  1581 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:42.872500  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 79380.6us
I20260709 13:00:42.873315  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:42.873301  6861 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.874223  6790 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:42.874684  6861 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:42.876667  6947 log.cc:927] Time spent T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:00:42.876847  6638 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.877804  6926 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.879871  6926 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.880738  6951 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:42.881664  6951 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.883476  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f362fd54b48400ba3c9fb8b8a405a93 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.885187  1681 raft_consensus.cc:1275] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:42.888125  1681 raft_consensus.cc:1275] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:42.893859  1533 raft_consensus.cc:2468] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:42.894011  1609 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:42.834378  6939 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:42.893989  6790 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.898419  6914 consensus_queue.cc:1048] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:42.898921  6790 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:42.900264  1423 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1bb16b93f1fe47b4be38ae591c62b564 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c445b7b7d94f48f99a3599ddfc92f462 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:42.902366  1656 leader_election.cc:304] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:42.903388  6937 raft_consensus.cc:2749] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.904400   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.908321  6223 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:42.909828  6790 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:42.910382  1614 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:42.895437  6946 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:42.911707  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.903861  1656 leader_election.cc:304] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:42.913147  6937 raft_consensus.cc:2749] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:42.913918  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:42.914657  6937 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:42.915038  1656 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:42.916201  6937 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:42.896451  1681 raft_consensus.cc:2955] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:42.917980  6645 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:42.924067  6870 consensus_queue.cc:1059] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:42.925273  6953 raft_consensus.cc:3055] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:42.925661  6953 raft_consensus.cc:740] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:42.927564  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-32066347a26c4c6a94cbe8e9b624cb23 received from {username='slave'} at 127.0.0.1:53078
I20260709 13:00:42.928267  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-32066347a26c4c6a94cbe8e9b624cb23 on tablet 32066347a26c4c6a94cbe8e9b624cb23 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:42.926556  6953 consensus_queue.cc:260] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.929350  6865 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:42.930505  6953 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.941459  1581 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:42.942417  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:42.945932  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:42.946729  1616 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 15.
I20260709 13:00:42.945490  1534 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 15.
W20260709 13:00:42.960865  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44784.5us
I20260709 13:00:42.961447  1609 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:00:42.965581  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:42.967564  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:42.960318  6859 raft_consensus.cc:2804] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:42.983748  6859 raft_consensus.cc:697] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:42.984687  6859 consensus_queue.cc:237] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:42.988364  6866 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:43.012539  6946 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:43.013227  6946 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:43.013957  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.015285  6946 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:43.016516  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55005.8us
I20260709 13:00:43.017447  1656 leader_election.cc:304] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:43.018325  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.963814  6223 consensus_queue.cc:1048] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:00:43.001722  6937 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.033653  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:43.019078  6821 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:43.052266  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.048389  6950 raft_consensus.cc:2749] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.051977  6821 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.049175  6937 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:43.065769  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:43.066815  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.090524  1656 leader_election.cc:304] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.095073  1656 leader_election.cc:304] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.096944  1656 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.091056  6937 raft_consensus.cc:3060] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.104785  6757 raft_consensus.cc:2749] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.066228  6946 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:43.113823  6645 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:43.115970  2302 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:43.089622  6821 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:43.098779  1506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43205 timed out after 1.536s (SENT) [suppressed 6 similar messages]
I20260709 13:00:43.094448  6926 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.114877  6938 raft_consensus.cc:2749] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.118230  6950 raft_consensus.cc:2804] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:43.116377  6645 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.149111  6645 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.097988  6901 consensus_queue.cc:1059] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:00:43.138298  6661 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
W20260709 13:00:43.164633  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 67710.1us
I20260709 13:00:43.162694  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:43.168308  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.142809  6916 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:43.171828  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.154132  6937 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.158824  6638 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:43.179848  1684 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:43.160331  6950 raft_consensus.cc:697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:43.191845  6638 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.194406  6638 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:43.204377  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.205256  1533 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
I20260709 13:00:43.176723  6927 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:43.208329  6927 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:43.208818  6961 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:43.209337  6927 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.210764  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.180450  6916 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.212100  6953 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:43.213028  6953 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:43.213635  6953 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.213973  6916 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.215823  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:43.216524  1607 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:43.217399  6950 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
W20260709 13:00:43.191530  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 92797.8us
W20260709 13:00:43.241729  6962 log.cc:927] Time spent T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:00:43.243009  6964 log.cc:927] Time spent T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 13:00:43.244107  6926 raft_consensus.cc:3055] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:43.244570  6926 raft_consensus.cc:740] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:43.245472  6926 consensus_queue.cc:260] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.187469  6661 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.251535  6661 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:43.257887  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.264914  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.266793  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:43.268621  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:43.270991  2308 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 18: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:43.265725  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.278676  6821 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.280567  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:43.283207  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.283674  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.283867  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.284931  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.286468  1682 raft_consensus.cc:1240] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:43.257757  6865 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:43.269424  2302 raft_consensus.cc:1217] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:00:43.287828  6865 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:43.297365  6968 log.cc:927] Time spent T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:00:43.298828  6865 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:43.296578  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.299486  1683 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:43.295713  1689 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:43.325081  1683 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:43.326766  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:43.330135  6937 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:43.333299  1507 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.334406  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.335515  6939 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:43.335934  6939 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:43.336333  6939 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.338215  6868 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.343670  6821 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:43.346187  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.347232  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.347750  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:43.347962  1683 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.348112  1681 raft_consensus.cc:1240] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:43.348439  1537 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.350303  1681 raft_consensus.cc:1240] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:43.352110  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.352439  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.352770  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.353488  1681 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.355243  1537 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:00:43.356086  1683 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:43.357329  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:43.361663  1612 raft_consensus.cc:3060] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.359444  2276 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:43.373941  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.390141  1612 raft_consensus.cc:2468] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:00:43.400177  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.400846  1683 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:00:43.401388  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.401816  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.402513  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6d9fb4551488e978e5e62c1c59485" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.403587  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.402894  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.404894  6953 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.406225  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.407232  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.404975  1685 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:00:43.411089  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.411245  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:43.414754  2308 raft_consensus.cc:2393] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 18: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:43.411324  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:43.370558  6926 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.373265  6970 raft_consensus.cc:2804] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:43.409926  1612 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:43.428297  6811 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:43.436072  6972 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.436754  6972 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.438828  6970 raft_consensus.cc:697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:43.439093  6972 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.439899  6970 consensus_queue.cc:237] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.442106  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.442859  1533 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 10.
I20260709 13:00:43.444350  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:43.446066  1537 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
I20260709 13:00:43.448411  6661 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:43.456403  6915 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.457695  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.471123  1681 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 10.
I20260709 13:00:43.443121  6944 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.462399  1432 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 4 to 10, term changed from 11 to 12, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to <none>, VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:43.477985  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:43.466207  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 221) took 30175 ms (client timeout 15000 ms). Trace:
I20260709 13:00:43.471889  6661 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.409653  6953 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:43.496501  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:43.488152  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.480926  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:43.499006  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.502501  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.495875  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:43.476632  6915 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.510110  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.516489  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.517846  1432 catalog_manager.cc:5697] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 11, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.519449  6645 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.521552  6661 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.522450  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:43.523524  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet ff79ac342d91424db634ca7802846535 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:34342
I20260709 13:00:43.523896  1688 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:43.524586  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.526379  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.527417  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:43.528128  1534 raft_consensus.cc:2393] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 13: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:43.529834  1687 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 12.
I20260709 13:00:43.492712  6944 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.535248  6944 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.535329  6967 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.503897  6757 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:43.504009  6901 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.540905  6953 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:43.541460  6953 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:43.541814  6926 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:43.541472  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.542311  6953 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.543219  6937 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.548400  1614 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 18.
W20260709 13:00:43.552357  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.517860  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.567028  1540 raft_consensus.cc:1240] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:43.567741  1607 raft_consensus.cc:2468] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:43.566834  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.573777  1534 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
I20260709 13:00:43.578810  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.579437  1687 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
I20260709 13:00:43.585098  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.545114  6915 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:43.478902  1435 rpcz_store.cc:269] 0709 13:00:13.290846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.296413 (+  5567us) service_pool.cc:224] Handling call
0709 13:00:13.488387 (+191974us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb5090 00007f8d58c53f3a 00007f8d5ea0a1cc 00007f8d5eb0837e 00007f8d5cfc92a4 00007f8d5cfc9232 00007f8d5cfc9161 00007f8d5cfc90dc 00007f8d5cfc8392 00007f8d56f8648c 00007f8d56f858c6
0709 13:00:43.466111 (+29977724us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:42.301831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:42.302472 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:42.302528 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:00:42.302544 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:42.303089 (+   545us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:42.303168 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:42.303210 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:42.303665 (+   455us) tablet.cc:701] Row locks acquired
0709 13:00:42.303704 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:00:42.303876 (+   172us) write_op.cc:270] Start()
0709 13:00:42.304015 (+   139us) write_op.cc:276] Timestamp: P: 1783602042303811 usec, L: 0
0709 13:00:42.304049 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:00:42.371421 (+ 67372us) log.cc:844] Serialized 929 byte log entry
0709 13:00:42.790233 (+418812us) op_driver.cc:464] REPLICATION: finished
0709 13:00:42.933293 (+143060us) write_op.cc:301] APPLY: starting
0709 13:00:42.933383 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:42.935342 (+  1959us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:42.935455 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:42.970994 (+ 35539us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:42.971256 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:42.971324 (+    68us) write_op.cc:312] APPLY: finished
0709 13:00:42.971600 (+   276us) log.cc:844] Serialized 33 byte log entry
0709 13:00:42.971785 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.971876 (+    91us) write_op.cc:454] Released schema lock
0709 13:00:42.971930 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:42.972324 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.972357 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73019,"reported_tablets":51,"spinlock_wait_cycles":168927104,"child_traces":[["op",{"apply.queue_time_us":142741,"apply.run_cpu_time_us":5274,"apply.run_wall_time_us":39013,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":165047,"prepare.run_cpu_time_us":13574,"prepare.run_wall_time_us":157672,"raft.queue_time_us":266903,"raft.run_cpu_time_us":51245,"raft.run_wall_time_us":104663,"replication_time_us":485984,"spinlock_wait_cycles":39808,"thread_start_us":529880,"threads_started":4,"wal-append.queue_time_us":125157}]]}
I20260709 13:00:43.590842  1507 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.573541  6937 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:43.580475  6927 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.605422  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.605631  1506 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.555392  6939 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.614110  6661 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:43.614193  1506 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.587162  6944 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:43.520103  1432 catalog_manager.cc:5697] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 12 to 13, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 13 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:43.594607  6696 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:43.618383  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:43.599864  6865 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:43.592661  6870 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:00:43.636114  6774 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:43.618839  6868 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:43.638244  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.639065  6774 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:43.624825  6696 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.640316  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.631151  1537 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:43.618500  6938 raft_consensus.cc:2749] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.633636  6916 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:43.641903  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.644443  1533 raft_consensus.cc:1275] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:43.614821  6661 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:43.643460  6696 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.626502  6944 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.651098  6944 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.653193  6661 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.656141  6774 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:43.608129  6937 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.660432  6870 consensus_queue.cc:1048] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:00:43.667945  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.668952  1688 raft_consensus.cc:2393] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:43.669101  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet ff79ac342d91424db634ca7802846535 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:43.671437  6696 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.630477  6865 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:43.681519  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.683418  1506 leader_election.cc:304] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:43.688338  1506 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.661764  6944 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.688338  1582 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:43.683301  6865 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.690574  6829 raft_consensus.cc:2749] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.691645  1432 catalog_manager.cc:5697] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 16, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 16 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:43.700249  6696 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.701578  1432 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 7 to 14, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:43.697259  6971 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.692726  6862 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.728475  6971 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.729344  1432 catalog_manager.cc:5697] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 14 to 17, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.730525  6971 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:43.724795  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.731531  1687 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.731179  1432 catalog_manager.cc:5697] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.715497  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:43.727514  6986 log.cc:927] Time spent T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:00:43.734143  6939 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.726881  6937 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:43.736269  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:43.738818  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.739395  1540 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 18.
I20260709 13:00:43.743994  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:43.744401  6937 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.744935  6937 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.745782  6696 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.746258  6696 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.749496  6937 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:43.752238  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.761796  6915 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.762893  6971 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:43.763520  6971 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.763960  6971 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.768151  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:43.768826  1685 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:43.698259  6944 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.772047  1614 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:43.772593  6865 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.722630  6774 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:43.775121  1533 raft_consensus.cc:3060] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.759268  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.777415  1537 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:43.778133  6944 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:43.778790  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:43.807509  2308 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:43.808558  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.809360  1687 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 19.
I20260709 13:00:43.810329  6944 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.810729  6944 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.811074  6944 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.771973  1432 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index -1 to 10, term changed from 7 to 13, VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:43.785742  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.788251  6926 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:43.816322  6926 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:43.817324  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 129093us
I20260709 13:00:43.818641  1506 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:43.818975  6926 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:43.792801  6859 raft_consensus.cc:1064] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 13:00:43.819365  6916 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:43.783586  1533 raft_consensus.cc:2468] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 19.
I20260709 13:00:43.758355  6696 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.797049  6811 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:43.801113  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:43.801935  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:43.822280  6859 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.823249  1540 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.828356  6696 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:43.828750  6696 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.829095  6696 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:43.830914  1540 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
I20260709 13:00:43.832787  1581 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:43.833578  6638 raft_consensus.cc:2804] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:43.834082  6638 raft_consensus.cc:697] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:43.834885  6638 consensus_queue.cc:237] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.843119  2308 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:43.793790  6862 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:43.857321  6865 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.860098  6915 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:43.861234  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:43.861886  2308 raft_consensus.cc:1813] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Handling vote request from an unknown peer 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:43.862402  2308 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 12: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:43.869272  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:43.869437  1532 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:43.870148  6821 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:43.870867  6821 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:43.871753  6821 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:43.872938  6916 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:43.876412  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:43.881628  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61159.7us
I20260709 13:00:43.883203  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:43.886603  6811 raft_consensus.cc:2764] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:00:43.893460  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:43.894167  1687 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.905437  6865 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:43.912778  6696 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:43.918442  6915 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:43.928918  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:43.929669  1533 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:43.953591  1687 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 11.
W20260709 13:00:43.955070  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 349732us
I20260709 13:00:43.955904  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:43.957085  6993 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.973446  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:44.006966  1614 raft_consensus.cc:1275] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:44.008785  1687 raft_consensus.cc:3060] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:43.960700  6696 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:44.061962  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 103323us
W20260709 13:00:44.062969  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 54607.3us
I20260709 13:00:44.063862  1656 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:44.066365  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.067186  1533 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:44.068993  1685 raft_consensus.cc:2393] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 13: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:44.068236  6865 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.072194  6865 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.073292  6954 consensus_queue.cc:1048] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:00:44.075631  6865 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:44.067750  6946 raft_consensus.cc:2804] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:44.078486  6946 raft_consensus.cc:697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:44.079391  6946 consensus_queue.cc:237] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.108582  1685 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:44.109936  1688 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:44.080060  6944 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:44.113425  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.113816  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.118470  1685 raft_consensus.cc:2368] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 18. Current term is 19.
I20260709 13:00:44.106142  6953 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.123481  1687 raft_consensus.cc:2468] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:44.128645  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:44.150803  6862 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:44.157333  1616 raft_consensus.cc:1240] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:00:44.176546  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.178766  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.180684  1682 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 18.
W20260709 13:00:44.174901  6994 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:00:44.189203  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:44.190254  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:44.188325  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:44.191571  1533 raft_consensus.cc:2368] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:44.155860  6953 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.220749  1506 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:44.162897  6971 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:44.206962  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 94144us
I20260709 13:00:44.238245  1612 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 18.
I20260709 13:00:44.244257  6868 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.233105  6927 consensus_queue.cc:1059] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:00:44.266252  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 60994.6us
I20260709 13:00:44.269367  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:44.270268  1537 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 18.
I20260709 13:00:44.269558  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:44.272392  1688 raft_consensus.cc:2368] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 18. Current term is 19.
I20260709 13:00:44.239578  6946 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:00:44.274166  2310 raft_consensus.cc:1240] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 19 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:44.263522  1581 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:44.287591  6638 raft_consensus.cc:2804] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:44.285633  6944 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:44.298830  1537 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:44.297639  6638 raft_consensus.cc:697] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:44.322547  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:44.322906  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:44.323504  1611 raft_consensus.cc:1813] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Handling vote request from an unknown peer 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:44.323915  1611 raft_consensus.cc:2368] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:44.324148  1616 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:44.324518  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:44.324761  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:44.325933  2310 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:44.364342  6999 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:44.364809  1541 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:44.368520  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:44.369032  1656 leader_election.cc:400] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:44.369346  1656 leader_election.cc:403] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:44.370297  1684 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:44.371325  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:44.369232  1532 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
I20260709 13:00:44.361838  6868 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.359113  6953 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:44.377714  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.378396  1687 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 18.
I20260709 13:00:44.380352  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:44.386093  1506 leader_election.cc:400] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 18. Current term is 19.
I20260709 13:00:44.369225  6971 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 19 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:44.349030  6870 consensus_queue.cc:1059] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:00:44.404619  1506 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:44.383533  6936 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.382622  1581 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:44.408919  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:44.413897  1535 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.375156  6862 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:00:44.427318  6868 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:44.418951  6926 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:00:44.433480  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:44.440572  7004 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:44.442716  7004 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.443174  7004 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.446674  1608 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:44.391054  6865 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:44.397737  6638 consensus_queue.cc:237] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.467309  6870 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:44.492283  1539 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:00:44.496716  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 63342.3us
I20260709 13:00:44.498107  1656 leader_election.cc:400] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:44.498574  1656 leader_election.cc:403] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:44.500259  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:44.517387  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:44.513381  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 99844.3us
I20260709 13:00:44.504562  6865 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:44.520725  1582 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:44.475157  6859 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:00:44.512988  6946 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 14. Current term is 15.
I20260709 13:00:44.505285  6821 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:00:44.516126  6811 raft_consensus.cc:3055] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:44.524933  7006 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.516777  7004 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.546016  6811 raft_consensus.cc:740] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
W20260709 13:00:44.558774  1423 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1bb16b93f1fe47b4be38ae591c62b564 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c445b7b7d94f48f99a3599ddfc92f462 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:44.551254  6774 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:44.545926  7010 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:44.594734  1535 raft_consensus.cc:2468] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 19.
I20260709 13:00:44.566187  6774 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.611209  7010 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.615962  7010 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.614549  2276 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:44.618980  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 72692.9us
I20260709 13:00:44.564522  6916 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:44.616997  6774 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.658833  1538 raft_consensus.cc:1275] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:44.665583  7004 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:44.677795  1612 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:44.678411  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:44.686230  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 181562us
I20260709 13:00:44.686889  7036 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:44.692513  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:44.668063  6821 raft_consensus.cc:2804] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:44.697413  6821 raft_consensus.cc:697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 19 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:44.698403  6821 consensus_queue.cc:237] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:44.699221  7008 raft_consensus.cc:3055] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:44.699637  7008 raft_consensus.cc:740] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:44.701251  6993 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:44.701649  6993 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:44.703994  1506 leader_election.cc:400] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 election: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 18. Current term is 19.
I20260709 13:00:44.704336  1506 leader_election.cc:403] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:00:44.705847  6927 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205) with higher term. Message: Invalid argument: T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 for earlier term 18. Current term is 19.
I20260709 13:00:44.710162  6936 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 12. Current term is 13.
I20260709 13:00:44.719830  1690 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:44.650095  6811 consensus_queue.cc:260] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:44.725683  7025 consensus_queue.cc:1048] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:00:44.771862  7016 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:00:44.738754  7008 consensus_queue.cc:260] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:44.791328  6774 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.767262  6811 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.768930  6638 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.806357  1539 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 19: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:44.812197  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 83194.3us
W20260709 13:00:44.820879  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 241899us
I20260709 13:00:44.831094  1690 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:44.841287  6696 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:44.846834  7010 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.848208  1689 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 19: Already voted for candidate 631fb66c0070402b8f78fd74633dae6f in this term.
I20260709 13:00:44.850392  2310 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:44.812490  6638 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.854187  6638 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:44.855270  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.855881  1690 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:44.857545  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:44.869639  6638 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:44.900384  6638 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.900921  6774 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:44.900946  6638 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.907840  6916 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.908501  6916 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:44.910636  6916 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:44.920917  7010 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:44.922605  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:44.929611  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:44.930435  1690 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:44.950122  7014 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:00:44.975190  7029 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:00:44.995639  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 180109us
I20260709 13:00:45.005060  1537 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Rejecting Update request from peer 631fb66c0070402b8f78fd74633dae6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:45.011204  1536 raft_consensus.cc:1275] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:45.014061  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
W20260709 13:00:45.014904  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 74581.9us
I20260709 13:00:45.018807  1687 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:45.064355  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:45.066247  1607 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 19: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:45.063438  1687 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:45.073549  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 76963.3us
I20260709 13:00:45.080569   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.090608  7054 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:45.071463  6865 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:00:45.115129  7056 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.119997  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:45.120332  7056 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:45.121508  1612 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 15.
I20260709 13:00:45.122768  7056 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:45.110010  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:45.128647  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:45.129254  1611 raft_consensus.cc:2393] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in current term 19: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:45.129498  1688 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:45.094110  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:45.132860  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:45.065354  6938 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:00:45.065493  7036 consensus_queue.cc:1048] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:00:45.135962  7052 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:45.145218  7052 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.145607  7052 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:45.134797  7055 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:45.149186  7055 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.149575  7055 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:45.161651  6993 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:45.163515  6993 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.171818  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:45.117561  6638 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:45.199393  7052 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:45.206025  7019 log.cc:927] Time spent T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
I20260709 13:00:45.209249  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53078 (request call id 863) took 1096 ms. Trace:
I20260709 13:00:45.209739  1614 rpcz_store.cc:276] 0709 13:00:44.112665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.112777 (+   112us) service_pool.cc:224] Handling call
0709 13:00:44.113059 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.261426 (+148367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.261456 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.458870 (+197414us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b2c00005fb8. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d57544a11 00007f8d57554372 00007f8d58c86a01 00007f8d58c4b43a 00007f8d58c4a83e 00007f8d5dc0f419 00007f8d57186bd4 00007f8d57186b62 00007f8d57186a91 00007f8d57186a0c 00007f8d57185cc2
0709 13:00:44.459322 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.649075 (+189753us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:44.649124 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.649198 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.205322 (+556124us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d559e6db1 00007f8d55a84c85 00007f8d55a856a2 00007f8d587f71db 00007f8d587f2aaf 00007f8d587e686e 00007f8d587e5bb6 00007f8d587e57d8 00007f8d587ef221 00007f8d587ef1d9 00007f8d587ef169
0709 13:00:45.208989 (+  3667us) raft_consensus.cc:1685] finished
0709 13:00:45.209018 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.209178 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61494,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":965,"spinlock_wait_cycles":73336064,"thread_start_us":337294,"threads_started":2,"wal-append.queue_time_us":295980}
I20260709 13:00:45.222242  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:45.223096  1537 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:45.227185  1535 raft_consensus.cc:1275] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:00:45.230193  7050 log.cc:927] Time spent T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:00:45.176852  6938 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.232868  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:45.234205  6638 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:45.236007  7059 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:45.239110  7055 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:45.236153  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 103250us
I20260709 13:00:45.244076  1507 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:45.253726  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:45.254362  1685 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.257568  1582 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
W20260709 13:00:45.241344  7053 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:00:45.271450  7033 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
I20260709 13:00:45.273391  7052 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:45.255839  7055 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:45.259986  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:45.284601  1689 raft_consensus.cc:3060] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:45.261277  1537 raft_consensus.cc:2393] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 16: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:45.262636  7040 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.293228  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312ab9d000ac4b1c82c590d2ea787c2d" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:45.294394  1539 raft_consensus.cc:3060] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.295502  1685 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:45.297492  1581 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:45.302451  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:45.295856  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:45.291929  7025 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.309690  1689 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:45.311930  1581 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:45.325155  1539 raft_consensus.cc:2468] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:45.338569  1539 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:45.323118  7008 raft_consensus.cc:3060] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:45.312755  7054 raft_consensus.cc:2804] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:45.360566  7054 raft_consensus.cc:697] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:45.361420  7054 consensus_queue.cc:237] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:45.316928  7032 raft_consensus.cc:2804] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:45.413458  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:45.322592  6859 consensus_queue.cc:1048] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:00:45.412894  7032 raft_consensus.cc:697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:45.473834  7032 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:45.479089  7066 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:00:45.492725  7053 log.cc:927] Time spent T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:00:45.502548  7029 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:00:45.506759  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 47830.8us
W20260709 13:00:45.509727  7062 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
W20260709 13:00:45.522758  7064 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:45.532769  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 72914.6us
W20260709 13:00:45.533262  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 57658.1us
W20260709 13:00:45.549924  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50202us
I20260709 13:00:45.557188  1532 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:45.570973  6661 raft_consensus.cc:493] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:45.609450  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 140) took 3051 ms. Trace:
I20260709 13:00:45.627086  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:45.627746  1616 raft_consensus.cc:606] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:45.628154  1616 raft_consensus.cc:614] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:45.630120  7067 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:45.610469  1432 rpcz_store.cc:276] 0709 13:00:42.553893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.560414 (+  6521us) service_pool.cc:224] Handling call
0709 13:00:45.605066 (+3044652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:44.094707 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:44.095331 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:44.095372 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:00:44.095387 (+    15us) tablet.cc:662] Decoding operations
0709 13:00:44.098116 (+  2729us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:44.098186 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:44.098217 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:00:44.098905 (+   688us) tablet.cc:701] Row locks acquired
0709 13:00:44.098925 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:44.099076 (+   151us) write_op.cc:270] Start()
0709 13:00:44.099204 (+   128us) write_op.cc:276] Timestamp: P: 1783602044099025 usec, L: 0
0709 13:00:44.099227 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:44.099937 (+   710us) log.cc:844] Serialized 3310 byte log entry
0709 13:00:44.577325 (+477388us) op_driver.cc:464] REPLICATION: finished
0709 13:00:44.945340 (+368015us) write_op.cc:301] APPLY: starting
0709 13:00:44.948713 (+  3373us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:45.109108 (+160395us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:45.109214 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:45.266632 (+157418us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:45.266858 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:00:45.266925 (+    67us) write_op.cc:312] APPLY: finished
0709 13:00:45.267349 (+   424us) log.cc:844] Serialized 81 byte log entry
0709 13:00:45.268422 (+  1073us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.268564 (+   142us) write_op.cc:454] Released schema lock
0709 13:00:45.268631 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:45.269069 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.269095 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21067,"reported_tablets":14,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":353004,"apply.run_cpu_time_us":13629,"apply.run_wall_time_us":328318,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":204607,"prepare.run_cpu_time_us":17616,"prepare.run_wall_time_us":103493,"raft.queue_time_us":220667,"raft.run_cpu_time_us":37380,"raft.run_wall_time_us":284015,"replication_time_us":464617,"spinlock_wait_cycles":13696,"thread_start_us":574120,"threads_started":4,"wal-append.queue_time_us":169288}]]}
I20260709 13:00:45.592043  7021 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 13:00:45.719549  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 142704us
I20260709 13:00:45.618520  6661 raft_consensus.cc:515] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:45.777205  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3306db491bf34b228d1100fd9c826528"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:45.778057  1611 raft_consensus.cc:606] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:45.778497  1611 raft_consensus.cc:614] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:45.833150  1507 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:45.834692  7009 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:45.826908  6870 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:45.839495  6870 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:45.842355  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:45.842945  1689 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:45.844097  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:45.844887  7017 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:45.845271  7017 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:45.845642  7017 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.845853  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49094
I20260709 13:00:45.848325  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:45.848894  1607 raft_consensus.cc:606] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:45.849213  1607 raft_consensus.cc:614] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:45.853531  6661 leader_election.cc:290] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:45.858498  6870 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:45.859885  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:45.866508  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:45.867249  1540 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:45.873373  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:45.874778  7049 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.876853  7049 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:45.879115  7049 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:45.892109  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:45.895660  7008 consensus_meta.cc:287] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:00:45.896497  1612 raft_consensus.cc:1275] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:00:45.896831  1612 pending_rounds.cc:85] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting all ops after (but not including) 12
I20260709 13:00:45.897037  1612 pending_rounds.cc:107] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:00:45.897298  1612 raft_consensus.cc:2889] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.900918  1507 leader_election.cc:304] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:45.902019  7049 raft_consensus.cc:2749] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:45.908411  7073 log.cc:927] Time spent T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:00:45.910702  7062 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 13:00:45.911798  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:45.912446  1616 raft_consensus.cc:606] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:45.912750  1616 raft_consensus.cc:614] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:45.915975  7017 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:45.919677  7017 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:45.924274  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:45.930984  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:45.931771  1541 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 14: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
I20260709 13:00:45.933908  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:45.934655  1609 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 13.
I20260709 13:00:45.958863  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f362fd54b48400ba3c9fb8b8a405a93" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:45.961688  7033 log.cc:927] Time spent T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.341s	user 0.007s	sys 0.010s
I20260709 13:00:45.965870  1541 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:45.971793  1437 catalog_manager.cc:5697] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 7 to 9, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.986362  1437 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 10 to 13, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:45.989481  7017 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:45.990613  6894 consensus_queue.cc:1048] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:45.997272  1688 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:46.005532  1581 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:45.998751  1507 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:46.012368  6870 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.016878  6870 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:46.019217  6870 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:46.021358  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:46.023008  6862 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:46.023552  6862 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:46.024003  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:46.024438  6862 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.026473  1582 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:46.027366  1437 catalog_manager.cc:5697] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 9 to 12, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.028127  6999 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:46.029505  1437 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.030761  1437 catalog_manager.cc:5697] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 10 to 11, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 11 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.041620  1688 raft_consensus.cc:1275] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:46.032131  1437 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 9 to 12, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.038182  7039 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:46.050307  7039 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.050693  7039 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.061506  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9"
dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
mode: GRACEFUL
new_leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:51296
I20260709 13:00:46.062238  1612 raft_consensus.cc:606] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Received request to transfer leadership to TS 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:46.080087  6914 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:46.080746  6914 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:46.082834  6914 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:46.061195  6696 consensus_queue.cc:1048] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:46.088209   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:46.090005   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:46.100353  1538 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:46.098342  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:46.108850  1689 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:46.110960  7008 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:46.113935  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:46.114696  1612 raft_consensus.cc:2393] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
I20260709 13:00:46.128825  7081 tablet_replica.cc:333] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:00:46.139173  6638 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:46.141487  7081 raft_consensus.cc:2243] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.142616  7081 raft_consensus.cc:2272] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.145768  7081 ts_tablet_manager.cc:1916] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:46.098265  1437 catalog_manager.cc:5697] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 8 to 9, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.193918  6870 raft_consensus.cc:993] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: : Instructing follower 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:46.194459  6870 raft_consensus.cc:1081] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Signalling peer 0f82bbd9193f4b71a0c17a0357cf0ce9 to start an election
I20260709 13:00:46.205401  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
 from {username='slave'} at 127.0.0.1:34880
I20260709 13:00:46.206549  1538 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.208274  1538 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.221573  1437 catalog_manager.cc:5697] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.223212  1437 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: config changed from index 10 to 4, term changed from 12 to 11, leader changed from <none> to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196), VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) added. New cstate: current_term: 11 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:46.230762  1437 catalog_manager.cc:5697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 1 to 12, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.201043  7039 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:46.233289  1534 raft_consensus.cc:2368] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 13. Current term is 14.
I20260709 13:00:46.232558  1437 catalog_manager.cc:5697] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.234376  7039 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:46.235038  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:46.235581  1611 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.237015  1437 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 11 to 15, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.252913  1437 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 12 to 16, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.255695  1437 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } }
I20260709 13:00:46.257005  1437 catalog_manager.cc:5697] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.266052  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:46.268008  2308 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.268937  2276 leader_election.cc:400] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 13. Current term is 14.
I20260709 13:00:46.269384  2276 leader_election.cc:403] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:46.271095  1437 catalog_manager.cc:5697] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 5 to 7, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.278036  1437 catalog_manager.cc:5697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.289633  1437 catalog_manager.cc:5697] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 6 to 12, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.324070  2308 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:46.325532  1437 catalog_manager.cc:5697] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.400777  1611 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:46.400322  1437 catalog_manager.cc:5697] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 7 to 9, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.389526  6915 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321) with higher term. Message: Invalid argument: T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 for earlier term 13. Current term is 14.
I20260709 13:00:46.410125  1437 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 10 to 12, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.413053  1437 catalog_manager.cc:5697] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 9 to 12, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 12 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:46.428825  1504 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:46.414829  7081 ts_tablet_manager.cc:1929] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:00:46.483875  7081 log.cc:1199] T 1bb16b93f1fe47b4be38ae591c62b564 P 631fb66c0070402b8f78fd74633dae6f: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-2-root/wals/1bb16b93f1fe47b4be38ae591c62b564
W20260709 13:00:46.500017  7089 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:46.501410  7093 raft_consensus.cc:476] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Not starting pre-election -- already a leader
W20260709 13:00:46.503587  7086 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
W20260709 13:00:46.510839  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 82109.9us
I20260709 13:00:46.489017  6927 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:00:46.525885  7084 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:00:46.543475  1538 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.568266  1538 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:46.562553  7091 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:00:46.559388  6927 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:46.574354  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 1bb16b93f1fe47b4be38ae591c62b564 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
W20260709 13:00:46.577335  1425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 54562.5us
W20260709 13:00:46.578099  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 50302.8us
I20260709 13:00:46.581211  6927 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:46.590039  7092 log.cc:927] Time spent T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:00:46.597157  7088 log.cc:927] Time spent T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:00:46.606986  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 82296.6us
I20260709 13:00:46.619547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:46.620464  1616 raft_consensus.cc:3055] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:46.620843  1616 raft_consensus.cc:740] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:46.632041  1541 raft_consensus.cc:1240] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:46.632174  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:46.634804  1682 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.636052  7028 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.636597  7028 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.642822  1616 consensus_queue.cc:260] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.666124  1616 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.672497  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:46.678740  1423 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet 1bb16b93f1fe47b4be38ae591c62b564 with cas_config_opid_index 4 failed: Not found: failed to reset TS proxy: No leader found: Tablet 1bb16b93f1fe47b4be38ae591c62b564 consensus state has no leader
I20260709 13:00:46.647228  7028 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:46.695694  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 47340.1us
W20260709 13:00:46.693799  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 54958.7us
I20260709 13:00:46.705015  1682 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:46.721957  1682 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:46.727427  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:46.728092  1687 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 14.
I20260709 13:00:46.729997  1616 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in term 9.
I20260709 13:00:46.738458  6862 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:46.735826  1507 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:46.756331  6811 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:46.756892  6811 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Leader. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:46.757735  6811 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.765810  1538 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:46.766889  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:46.802711  7018 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:46.791060  7095 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:46.809922  7095 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.811874  7095 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:46.839787  7095 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.868837  7095 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:46.872777  1538 raft_consensus.cc:1240] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Rejecting Update request from peer d3b488cf00f7497ea0bf5964b99f6e0e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:00:46.881865  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:46.977025  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 119530us
W20260709 13:00:46.979475  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 127521us
I20260709 13:00:46.980284  6862 consensus_queue.cc:1059] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:46.981385  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:46.981314  6862 raft_consensus.cc:3055] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:46.984161  6862 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:46.985083  6862 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:46.987654  6862 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:47.033007  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:47.042410  7116 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:47.094376  1432 catalog_manager.cc:5697] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 17 to 19, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.096725   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:47.097424  1432 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 4 to 10, term changed from 11 to 12, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193), VOTER 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) evicted. New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:47.099139  1432 catalog_manager.cc:5697] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 13 to 16, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.113327  1432 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index -1 to 9, term changed from 11 to 15, VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:47.115021  1432 catalog_manager.cc:5697] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 8 to 11, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 12 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.116917  1611 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:47.118566  6811 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:47.116771  1432 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 15 to 16, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:47.136143  1432 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.152809  7011 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.153430  7011 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:47.155738  7011 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:47.158118  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:47.158782  1540 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 19.
I20260709 13:00:47.160969  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:47.161988  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:47.162614  1612 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 19.
I20260709 13:00:47.164036  7011 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:47.164472  7011 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.164793  7011 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:47.168661  2308 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:47.172108  6927 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:47.173254  7011 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:47.175318  7011 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:47.178471  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:47.179886  1612 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:47.179261  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:47.184559  1540 raft_consensus.cc:3060] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:47.246945  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 with delete_type TABLET_DATA_TOMBSTONED (TS 631fb66c0070402b8f78fd74633dae6f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49094
I20260709 13:00:47.248092  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 141) took 1280 ms. Trace:
I20260709 13:00:47.248827  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f362fd54b48400ba3c9fb8b8a405a93 with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:34342
I20260709 13:00:47.248576  1432 rpcz_store.cc:276] 0709 13:00:45.968106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.968908 (+   802us) service_pool.cc:224] Handling call
0709 13:00:47.248001 (+1279093us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.146455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.147055 (+   600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.147096 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:00:47.147117 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:47.148047 (+   930us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.148111 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.148144 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:47.149088 (+   944us) tablet.cc:701] Row locks acquired
0709 13:00:47.149114 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:00:47.149281 (+   167us) write_op.cc:270] Start()
0709 13:00:47.149404 (+   123us) write_op.cc:276] Timestamp: P: 1783602047149235 usec, L: 0
0709 13:00:47.149430 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.163073 (+ 13643us) log.cc:844] Serialized 2898 byte log entry
0709 13:00:47.166358 (+  3285us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.166840 (+   482us) write_op.cc:301] APPLY: starting
0709 13:00:47.166932 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.171359 (+  4427us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.171452 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.188590 (+ 17138us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.196805 (+  8215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:00:47.196853 (+    48us) write_op.cc:312] APPLY: finished
0709 13:00:47.197123 (+   270us) log.cc:844] Serialized 73 byte log entry
0709 13:00:47.201478 (+  4355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.201606 (+   128us) write_op.cc:454] Released schema lock
0709 13:00:47.201665 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:47.203345 (+  1680us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.203380 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33128,"reported_tablets":9,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":10892,"apply.run_wall_time_us":36461,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29218,"num_ops":7,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":3846,"prepare.run_wall_time_us":19074,"replication_time_us":16767}]]}
I20260709 13:00:47.262162  1528 tablet_service.cc:1558] Processing DeleteTablet for tablet ff79ac342d91424db634ca7802846535 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:34342
W20260709 13:00:47.269390  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50788 (request call id 222) took 14629 ms (client timeout 15000 ms). Trace:
I20260709 13:00:47.271809  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 1bb16b93f1fe47b4be38ae591c62b564 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:47.281283  1688 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:47.291313  7115 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:47.293455  7123 tablet_replica.cc:333] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:47.294569  7123 raft_consensus.cc:2243] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:47.295499  7123 raft_consensus.cc:2272] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:47.310751  1540 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 20.
I20260709 13:00:47.312179  1656 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:47.269703  1612 raft_consensus.cc:2468] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 20.
I20260709 13:00:47.316609  6926 raft_consensus.cc:2804] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:00:47.270397  1437 rpcz_store.cc:269] 0709 13:00:32.638410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.658313 (+ 19903us) service_pool.cc:224] Handling call
0709 13:00:47.262406 (+14604093us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:46.739874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:46.768417 (+ 28543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:46.768452 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:00:46.768470 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:46.770090 (+  1620us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:46.770172 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:46.770200 (+    28us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:00:46.771763 (+  1563us) tablet.cc:701] Row locks acquired
0709 13:00:46.771782 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:46.771919 (+   137us) write_op.cc:270] Start()
0709 13:00:46.772042 (+   123us) write_op.cc:276] Timestamp: P: 1783602046771871 usec, L: 0
0709 13:00:46.772064 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:46.818753 (+ 46689us) log.cc:844] Serialized 8744 byte log entry
0709 13:00:46.964388 (+145635us) op_driver.cc:464] REPLICATION: finished
0709 13:00:46.978441 (+ 14053us) write_op.cc:301] APPLY: starting
0709 13:00:46.981517 (+  3076us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.011663 (+ 30146us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.011781 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.071516 (+ 59735us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.071836 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 13:00:47.071884 (+    48us) write_op.cc:312] APPLY: finished
0709 13:00:47.072364 (+   480us) log.cc:844] Serialized 196 byte log entry
0709 13:00:47.072558 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.072759 (+   201us) write_op.cc:454] Released schema lock
0709 13:00:47.072825 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:47.073251 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.073286 (+    35us) write_op.cc:454] Released schema lock
0709 13:00:47.176073 (+102787us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b54000f3f54. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58c4832a 00007f8d58bcdf14 00007f8d58bcdec3 00007f8d58bcde38 00007f8d58bcddf3 00007f8d58bcd0dc 00007f8d58bf6e16 00007f8d58bdecbb 00007f8d58bc939d 00007f8d58bccd75
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":13785,"apply.run_cpu_time_us":28249,"apply.run_wall_time_us":94778,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95955,"num_ops":22,"prepare.queue_time_us":67605,"prepare.run_cpu_time_us":33107,"prepare.run_wall_time_us":170830,"raft.queue_time_us":5840,"raft.run_cpu_time_us":7054,"raft.run_wall_time_us":31427,"replication_time_us":189073,"spinlock_wait_cycles":2288512,"thread_start_us":126450,"threads_started":4,"wal-append.queue_time_us":133668}]]}
I20260709 13:00:47.337466  1439 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 8 to 11, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 11 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.324184  6926 raft_consensus.cc:697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 20 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
W20260709 13:00:47.355957  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 209) took 61069 ms (client timeout 15000 ms). Trace:
W20260709 13:00:47.356479  1438 rpcz_store.cc:269] 0709 12:59:46.286209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.286445 (+   236us) service_pool.cc:224] Handling call
0709 13:00:47.355463 (+61069018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31556,"reported_tablets":50}
I20260709 13:00:47.364364  1612 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:47.365732  6926 consensus_queue.cc:237] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:47.376708  7115 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:47.463085  7123 ts_tablet_manager.cc:1916] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:47.547803  1438 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:47.669291  1433 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 10 to 13, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:47.671553  1433 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 11 to 16, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:47.691566  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 245) took 34929 ms (client timeout 15000 ms). Trace:
I20260709 13:00:47.691917  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:49094
I20260709 13:00:47.694165  7123 ts_tablet_manager.cc:1929] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:00:47.694641  7123 log.cc:1199] T 2f362fd54b48400ba3c9fb8b8a405a93 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/2f362fd54b48400ba3c9fb8b8a405a93
I20260709 13:00:47.695056  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 1bb16b93f1fe47b4be38ae591c62b564 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:47.696245  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet 2f362fd54b48400ba3c9fb8b8a405a93 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:47.701115  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet ff79ac342d91424db634ca7802846535 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
W20260709 13:00:47.691969  1439 rpcz_store.cc:269] 0709 13:00:12.761873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.762096 (+   223us) service_pool.cc:224] Handling call
0709 13:00:47.691479 (+34929383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.354293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.355184 (+   891us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.355248 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:00:47.355277 (+    29us) tablet.cc:662] Decoding operations
0709 13:00:47.355757 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.355837 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.355881 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:47.356123 (+   242us) tablet.cc:701] Row locks acquired
0709 13:00:47.356150 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:00:47.356365 (+   215us) write_op.cc:270] Start()
0709 13:00:47.356515 (+   150us) write_op.cc:276] Timestamp: P: 1783602047356305 usec, L: 0
0709 13:00:47.356547 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.357367 (+   820us) log.cc:844] Serialized 541 byte log entry
0709 13:00:47.384339 (+ 26972us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.408550 (+ 24211us) write_op.cc:301] APPLY: starting
0709 13:00:47.410981 (+  2431us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.505437 (+ 94456us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.520668 (+ 15231us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.537519 (+ 16851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.537668 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:00:47.537742 (+    74us) write_op.cc:312] APPLY: finished
0709 13:00:47.537920 (+   178us) log.cc:844] Serialized 25 byte log entry
0709 13:00:47.538078 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.538152 (+    74us) write_op.cc:454] Released schema lock
0709 13:00:47.538191 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:47.538541 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.538568 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17328,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":6675,"apply.run_cpu_time_us":3744,"apply.run_wall_time_us":129978,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":874,"prepare.run_cpu_time_us":3605,"prepare.run_wall_time_us":26711,"replication_time_us":25963}]]}
I20260709 13:00:47.833653  1609 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 20 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:00:47.836372  7034 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:47.876175  1538 raft_consensus.cc:1275] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:00:47.879431  7011 consensus_queue.cc:1048] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:47.960795  1434 catalog_manager.cc:5697] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:47.964908  1434 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 9 to 12, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 12 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:47.975432  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 211) took 15598 ms (client timeout 15000 ms). Trace:
W20260709 13:00:47.990232  1433 rpcz_store.cc:269] 0709 13:00:32.377425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.390590 (+ 13165us) service_pool.cc:224] Handling call
0709 13:00:47.975360 (+15584770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.726083 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.726588 (+   505us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.726626 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:00:47.726639 (+    13us) tablet.cc:662] Decoding operations
0709 13:00:47.727024 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.727076 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.727100 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:47.727395 (+   295us) tablet.cc:701] Row locks acquired
0709 13:00:47.727412 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:00:47.727542 (+   130us) write_op.cc:270] Start()
0709 13:00:47.727662 (+   120us) write_op.cc:276] Timestamp: P: 1783602047727494 usec, L: 0
0709 13:00:47.727679 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.728217 (+   538us) log.cc:844] Serialized 929 byte log entry
0709 13:00:47.729993 (+  1776us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.730476 (+   483us) write_op.cc:301] APPLY: starting
0709 13:00:47.730567 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.731949 (+  1382us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.732048 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.733280 (+  1232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.733449 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:47.733504 (+    55us) write_op.cc:312] APPLY: finished
0709 13:00:47.733703 (+   199us) log.cc:844] Serialized 33 byte log entry
0709 13:00:47.733914 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.734005 (+    91us) write_op.cc:454] Released schema lock
0709 13:00:47.734047 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:47.735020 (+   973us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.735055 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18705,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":275,"apply.run_cpu_time_us":3851,"apply.run_wall_time_us":4510,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":2404,"prepare.run_wall_time_us":2404,"replication_time_us":2180}]]}
I20260709 13:00:48.062078  1435 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 13 to 14, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.065253  1435 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 13 to 14, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.066896  1435 catalog_manager.cc:5697] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.068094  1435 catalog_manager.cc:5697] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 7 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.070339  1435 catalog_manager.cc:5697] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.071485  1435 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 13, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.072579  1435 catalog_manager.cc:5697] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 16 to 19, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 19 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.073836  1435 catalog_manager.cc:5697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 10 to 15, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.075351  1435 catalog_manager.cc:5697] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
W20260709 13:00:48.083818  1434 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 246) took 16183 ms (client timeout 15000 ms). Trace:
W20260709 13:00:48.084376  1434 rpcz_store.cc:269] 0709 13:00:31.900734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.901052 (+   318us) service_pool.cc:224] Handling call
0709 13:00:48.009120 (+16108068us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.009154 (+    34us) write_op.cc:454] Released schema lock
0709 13:00:48.083744 (+ 74590us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.991015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.991608 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.991640 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:00:47.991657 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:47.992062 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.992108 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.992133 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:47.992517 (+   384us) tablet.cc:701] Row locks acquired
0709 13:00:47.992533 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:00:47.992684 (+   151us) write_op.cc:270] Start()
0709 13:00:47.992794 (+   110us) write_op.cc:276] Timestamp: P: 1783602047992641 usec, L: 0
0709 13:00:47.992823 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.993386 (+   563us) log.cc:844] Serialized 929 byte log entry
0709 13:00:47.995255 (+  1869us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.995678 (+   423us) write_op.cc:301] APPLY: starting
0709 13:00:47.995758 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.997065 (+  1307us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.997152 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.998462 (+  1310us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.998612 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:47.998656 (+    44us) write_op.cc:312] APPLY: finished
0709 13:00:47.998837 (+   181us) log.cc:844] Serialized 33 byte log entry
0709 13:00:47.998993 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.999073 (+    80us) write_op.cc:454] Released schema lock
0709 13:00:47.999109 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":185070,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":3692,"apply.run_wall_time_us":3691,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2637,"prepare.run_wall_time_us":2636,"replication_time_us":2311}]]}
I20260709 13:00:48.090262  1677 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bb16b93f1fe47b4be38ae591c62b564 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:49094
I20260709 13:00:48.094890  1425 catalog_manager.cc:5028] TS 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): tablet 1bb16b93f1fe47b4be38ae591c62b564 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:48.098431  1435 catalog_manager.cc:5697] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 13, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.100183  1435 catalog_manager.cc:5697] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.101615  1435 catalog_manager.cc:5697] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 9 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.103645  1435 catalog_manager.cc:5697] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.105913  1435 catalog_manager.cc:5697] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 14, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 14 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.108198  1435 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 13 to 14, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.109725  1435 catalog_manager.cc:5697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 11 to 12, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.119911  1435 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 16, leader changed from 631fb66c0070402b8f78fd74633dae6f (127.0.107.195) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } }
I20260709 13:00:48.387238  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50804 (request call id 247) took 1328 ms. Trace:
I20260709 13:00:48.387658  1435 rpcz_store.cc:276] 0709 13:00:47.059118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.059298 (+   180us) service_pool.cc:224] Handling call
0709 13:00:48.387172 (+1327874us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:48.148853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:48.149401 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:48.149440 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:00:48.149462 (+    22us) tablet.cc:662] Decoding operations
0709 13:00:48.150962 (+  1500us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:48.151023 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:48.151054 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:00:48.152386 (+  1332us) tablet.cc:701] Row locks acquired
0709 13:00:48.152407 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:00:48.152628 (+   221us) write_op.cc:270] Start()
0709 13:00:48.158804 (+  6176us) write_op.cc:276] Timestamp: P: 1783602048152583 usec, L: 0
0709 13:00:48.158837 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:00:48.159515 (+   678us) log.cc:844] Serialized 6746 byte log entry
0709 13:00:48.162171 (+  2656us) op_driver.cc:464] REPLICATION: finished
0709 13:00:48.162589 (+   418us) write_op.cc:301] APPLY: starting
0709 13:00:48.162690 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:48.171088 (+  8398us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:48.171185 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:48.303017 (+131832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:48.314164 (+ 11147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:00:48.314220 (+    56us) write_op.cc:312] APPLY: finished
0709 13:00:48.314618 (+   398us) log.cc:844] Serialized 156 byte log entry
0709 13:00:48.317911 (+  3293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.318093 (+   182us) write_op.cc:454] Released schema lock
0709 13:00:48.318158 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:48.318553 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.318587 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24670,"reported_tablets":51,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":20780,"apply.run_wall_time_us":155892,"cfile_cache_hit":68,"cfile_cache_hit_bytes":70958,"num_ops":17,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":4954,"prepare.run_wall_time_us":10967,"replication_time_us":3221,"spinlock_wait_cycles":41856}]]}
I20260709 13:00:48.394889  1687 consensus_queue.cc:237] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:48.430315  6944 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.430881  6944 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:48.433678  6944 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:48.433979  2308 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:48.435597  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:48.435923  7034 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:48.436489  1538 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:48.437974  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:48.438778  6944 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:48.439196  6944 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.439554  6944 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:48.439654   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.449648  1432 catalog_manager.cc:5697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 reported cstate change: term changed from 8 to 9, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.451683  6944 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:48.455451  1538 raft_consensus.cc:1275] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:00:48.459208  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 100660us
I20260709 13:00:48.486609  1435 catalog_manager.cc:5697] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 13 to 20, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 20 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.486526  7011 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:48.489156  2310 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:48.494149  7138 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:48.502549  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:48.521591  7138 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:48.532279  7138 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:48.532930  1682 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:48.530241  7140 consensus_queue.cc:1048] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:48.534981  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:48.535990  1611 raft_consensus.cc:2368] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 15. Current term is 16.
I20260709 13:00:48.538697  1656 leader_election.cc:400] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 15. Current term is 16.
I20260709 13:00:48.539044  1656 leader_election.cc:403] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.541025  6944 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:48.544310  7138 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:00:48.550432  1538 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:48.546504  1434 catalog_manager.cc:5697] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 4 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:48.564291  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 73648.6us
I20260709 13:00:48.588812  7138 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617) with higher term. Message: Invalid argument: T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f for earlier term 15. Current term is 16.
I20260709 13:00:48.605937  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:48.606801  1540 raft_consensus.cc:2393] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 15: Already voted for candidate 0f82bbd9193f4b71a0c17a0357cf0ce9 in this term.
W20260709 13:00:48.607720  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 88748us
I20260709 13:00:48.609875  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:48.615456  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50794 (request call id 212) took 1180 ms. Trace:
I20260709 13:00:48.616034  1437 rpcz_store.cc:276] 0709 13:00:47.434984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.435104 (+   120us) service_pool.cc:224] Handling call
0709 13:00:48.615374 (+1180270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72863,"reported_tablets":51}
I20260709 13:00:48.622154  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:48.623107  1540 raft_consensus.cc:3060] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:48.653220  1540 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
W20260709 13:00:48.621798  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 97947.6us
I20260709 13:00:48.663628  1682 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:48.668377  1582 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:48.669061  1611 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:48.680090  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 86979us
W20260709 13:00:48.665681  7136 log.cc:927] Time spent T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:48.728780  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a5f5933777f457e99f4a6b1781ec12b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:48.745965  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 77669.8us
I20260709 13:00:48.733861  6944 raft_consensus.cc:2804] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:48.779691  6944 raft_consensus.cc:697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:48.780791  6944 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:48.831843  1541 raft_consensus.cc:2955] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:48.891523  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 52640.9us
W20260709 13:00:48.912563  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 143473us
W20260709 13:00:48.923799  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 133562us
I20260709 13:00:48.967321  2310 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:48.972500  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 180209us
W20260709 13:00:48.982127  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 68554.5us
W20260709 13:00:49.052079  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 73853.2us
I20260709 13:00:49.077597  7163 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:49.172400  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 105130us
W20260709 13:00:49.190212  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 86084.4us
I20260709 13:00:49.197386  1538 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:00:49.218266  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 229017us
W20260709 13:00:49.221359  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 114878us
W20260709 13:00:49.481873  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 259803us
I20260709 13:00:49.483978  7174 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:49.485163  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 265298us
W20260709 13:00:49.512403  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 313282us
W20260709 13:00:49.534200  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 463575us
I20260709 13:00:49.536542  1688 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:00:49.537611  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 286486us
I20260709 13:00:49.601147  2310 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:49.602526  1688 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer 0f82bbd9193f4b71a0c17a0357cf0ce9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:49.655921  7157 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:49.656554  7157 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:49.657383  7149 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:49.657924  7149 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:49.660526  7149 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:49.660796  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:49.662456  1688 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:49.663280  7157 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:49.664553  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:00:49.667760  7168 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
W20260709 13:00:49.672938  7186 log.cc:927] Time spent T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:00:49.626324  7176 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:00:49.678383  6638 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.676306  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:43278
I20260709 13:00:49.679370  1541 raft_consensus.cc:606] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:49.685638  7170 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:49.686313  7170 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:49.688923  7179 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:49.689673  7170 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:49.690661  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:49.697032  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:49.697286  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:43278
I20260709 13:00:49.697821  1541 raft_consensus.cc:606] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:49.699066  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:49.702000  1581 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:49.703512  7191 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:49.710919  1653 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:49.716149  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:49.721570  7011 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:49.723426  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:49.723485  1434 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34152 (request call id 145) took 1184 ms. Trace:
I20260709 13:00:49.735522  1581 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:49.738734  7170 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:49.725600  1434 rpcz_store.cc:276] 0709 13:00:48.538748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.538872 (+   124us) service_pool.cc:224] Handling call
0709 13:00:49.723422 (+1184550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:48.611943 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:48.753727 (+141784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:48.761812 (+  8085us) write_op.cc:435] Acquired schema lock
0709 13:00:48.763806 (+  1994us) tablet.cc:662] Decoding operations
0709 13:00:48.800463 (+ 36657us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:48.800524 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:48.800557 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:48.800756 (+   199us) tablet.cc:701] Row locks acquired
0709 13:00:48.800771 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:00:48.800922 (+   151us) write_op.cc:270] Start()
0709 13:00:48.801031 (+   109us) write_op.cc:276] Timestamp: P: 1783602048800872 usec, L: 0
0709 13:00:48.801054 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:48.801663 (+   609us) log.cc:844] Serialized 536 byte log entry
0709 13:00:49.066669 (+265006us) op_driver.cc:464] REPLICATION: finished
0709 13:00:49.229442 (+162773us) write_op.cc:301] APPLY: starting
0709 13:00:49.485788 (+256346us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:49.654088 (+168300us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:49.680358 (+ 26270us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:49.681198 (+   840us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:49.681396 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:00:49.681465 (+    69us) write_op.cc:312] APPLY: finished
0709 13:00:49.681702 (+   237us) log.cc:844] Serialized 25 byte log entry
0709 13:00:49.681913 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:49.682011 (+    98us) write_op.cc:454] Released schema lock
0709 13:00:49.682066 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:49.683028 (+   962us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:49.683067 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2707,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":142166,"apply.run_cpu_time_us":21429,"apply.run_wall_time_us":463700,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":4799,"prepare.run_cpu_time_us":3250,"prepare.run_wall_time_us":196771,"replication_time_us":262897,"thread_start_us":102201,"threads_started":1}]]}
I20260709 13:00:49.752522  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a5f5933777f457e99f4a6b1781ec12b with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46804
I20260709 13:00:49.773416  2310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391"
dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:53448
I20260709 13:00:49.774158  2310 raft_consensus.cc:606] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:49.777580  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:49.786613  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5f5933777f457e99f4a6b1781ec12b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" is_pre_election: true
I20260709 13:00:49.810542  2310 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.824030  7191 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.806728  7184 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:00:49.829607  7115 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.836918  1435 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.856794  2306 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.876865  7161 raft_consensus.cc:993] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:49.877431  7161 raft_consensus.cc:1081] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:49.877036  7164 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:49.880700  7164 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } attrs { replace: true } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:49.883730  1437 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 10 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New cstate: current_term: 13 leader_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.884445  7164 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:49.887887  1685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57984
I20260709 13:00:49.888460  1685 raft_consensus.cc:493] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:49.888916  1685 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.892509  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:49.888360  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:49.896633  1507 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:49.898561  7164 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:49.908987  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 56963.1us
I20260709 13:00:49.914474  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:49.915249  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 121439us
I20260709 13:00:49.920957  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f65122cec34901839f22a448343dca"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:43278
I20260709 13:00:49.921516  1538 raft_consensus.cc:606] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:49.925420  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db"
dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
mode: GRACEFUL
new_leader_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:43278
I20260709 13:00:49.926124  1537 raft_consensus.cc:606] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Received request to transfer leadership to TS 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:49.926448  7201 tablet_replica.cc:333] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:00:49.927526   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:49.928563  1685 raft_consensus.cc:515] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:49.929384   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:49.930586  1685 leader_election.cc:290] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:49.931586  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:49.943936  1537 raft_consensus.cc:3055] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:49.944401  1537 raft_consensus.cc:740] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:49.944514  7191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46804 (request call id 83) took 1322 ms. Trace:
I20260709 13:00:49.945254  1537 consensus_queue.cc:260] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:49.946496  1537 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.933933  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96265149c6c844b48c46f6df62cc9162" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:49.944487  7150 raft_consensus.cc:993] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:49.948487  1609 raft_consensus.cc:3060] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.934909  1690 raft_consensus.cc:2955] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.958101  7155 raft_consensus.cc:1081] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:49.959514  1609 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:49.961658  1656 leader_election.cc:304] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:49.962406  7011 raft_consensus.cc:2804] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:49.962968  7011 raft_consensus.cc:697] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:49.963462  7201 raft_consensus.cc:2243] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.964269  7201 raft_consensus.cc:2272] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.963901  7011 consensus_queue.cc:237] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:49.967274  7201 ts_tablet_manager.cc:1916] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:49.968307  1537 raft_consensus.cc:2468] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:49.971561  1685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:55612
I20260709 13:00:49.972157  1685 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:49.972720  1685 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.972208  1689 raft_consensus.cc:2955] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:49.945279  7191 rpcz_store.cc:276] 0709 13:00:48.653504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.664464 (+ 10960us) service_pool.cc:224] Handling call
0709 13:00:48.678940 (+ 14476us) log.cc:844] Serialized 501 byte log entry
0709 13:00:49.518749 (+839809us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b540006cfa0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bcbb26 00007f8d58bc549a 00007f8d58bc4714 00007f8d58ba4eaa 00007f8d58babd53 00007f8d58babcd9 00007f8d58babc69 00007f8d58babc31 00007f8d58baadfd 000000000038f354
0709 13:00:49.520151 (+  1402us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b1800445c60. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:49.585137 (+ 64986us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540006cfa0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d58bb4571 00007f8d58bc4142 00007f8d58ba4eaa 00007f8d58babd53 00007f8d58babcd9 00007f8d58babc69 00007f8d58babc31 00007f8d58baadfd 000000000038f354 000000000038f199 00007f8d55b5e475
0709 13:00:49.655690 (+ 70553us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4c004b9240. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d56f17a20 00007f8d56f28a29 00007f8d56f2913f 00007f8d56eed2ab 00007f8d56f1af3c 00007f8d56f1b3fe 00007f8d571a850b 00007f8d58ba7381 00007f8d58ba526b 00007f8d58babd53 00007f8d58babcd9
0709 13:00:49.944418 (+288728us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65993,"raft.queue_time_us":143361,"raft.run_cpu_time_us":10535,"raft.run_wall_time_us":1230728,"spinlock_wait_cycles":109445888,"thread_start_us":196017,"threads_started":1,"wal-append.queue_time_us":352667}
I20260709 13:00:50.006090  7115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34342 (request call id 5) took 1481 ms. Trace:
I20260709 13:00:50.008481  7115 rpcz_store.cc:276] 0709 13:00:48.524950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.525083 (+   133us) service_pool.cc:224] Handling call
0709 13:00:48.587020 (+ 61937us) log.cc:844] Serialized 501 byte log entry
0709 13:00:48.841273 (+254253us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b1800479da0. stack: 00007f8d55b2c343 00007f8d55b2c240 00007f8d554bb1d4 00007f8d5f1f9304 00007f8d5f1f9299 00007f8d5ea26de1 00007f8d5ea335b1 00007f8d55b5e3f3 00007f8d55b607c1 00007f8d55b60779 00007f8d55b60709 00007f8d55b606d1 00007f8d55b5f9cd 000000000038f354 000000000038f199 00007f8d55b4183a
0709 13:00:50.005987 (+1164714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16729,"raft.queue_time_us":38407,"raft.run_cpu_time_us":1480,"raft.run_wall_time_us":48156,"spinlock_wait_cycles":13102848,"thread_start_us":174762,"threads_started":2,"wal-append.queue_time_us":215379,"wal-append.run_cpu_time_us":1539,"wal-append.run_wall_time_us":1001569}
I20260709 13:00:50.012217  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32066347a26c4c6a94cbe8e9b624cb23 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:50.014390  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8bbf1e27410e4984b453b68cb9b08bd6 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:50.031742  7164 raft_consensus.cc:993] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:50.048592  7144 raft_consensus.cc:1081] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
W20260709 13:00:50.052376  7197 log.cc:927] Time spent T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:50.060420  1685 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:50.067215  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:50.067834  2306 raft_consensus.cc:3055] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:50.068085  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:50.069478  1538 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.071842  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57984
I20260709 13:00:50.072399  1682 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:50.072734  1682 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.068116  2306 raft_consensus.cc:740] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:50.077755  1685 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:50.081489  2306 consensus_queue.cc:260] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:50.084095  2306 raft_consensus.cc:3060] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.086126  1538 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:50.087294  1656 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f; no voters: 
I20260709 13:00:50.101671  1682 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:50.102437  2306 raft_consensus.cc:2468] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:50.105156  7140 raft_consensus.cc:2804] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:50.105688  7140 raft_consensus.cc:697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:50.109340  7163 raft_consensus.cc:993] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:50.110006  7166 raft_consensus.cc:1081] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:50.106528  7140 consensus_queue.cc:237] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:50.119160  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57984
I20260709 13:00:50.119779  1689 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:50.120121  1689 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.129390  1689 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:50.136402  1682 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:50.140338  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:50.140884  1612 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.147835  1612 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:50.149273  1432 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index 9 to 10, VOTER 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) evicted. New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.156662  1604 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bbf1e27410e4984b453b68cb9b08bd6 with delete_type TABLET_DATA_TOMBSTONED (TS d3b488cf00f7497ea0bf5964b99f6e0e not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46804
I20260709 13:00:50.161468  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:50.162101  1538 raft_consensus.cc:3055] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:50.162374  1538 raft_consensus.cc:740] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:50.162415  1656 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:50.163017  1538 consensus_queue.cc:260] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:50.170518  1538 raft_consensus.cc:3060] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.171006  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:50.171813  1537 raft_consensus.cc:3055] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:50.172152  1537 raft_consensus.cc:740] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:50.172860  1689 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:50.172899  1537 consensus_queue.cc:260] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:50.176416  1537 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.180495  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:50.181052  2306 raft_consensus.cc:3060] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.190027  2306 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:50.172299  7138 raft_consensus.cc:2804] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:50.193761  1538 raft_consensus.cc:2468] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:50.194103  7138 raft_consensus.cc:697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:50.191823  1653 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:00:50.195459  7139 raft_consensus.cc:2804] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:50.195158  7138 consensus_queue.cc:237] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:50.195878  7139 raft_consensus.cc:697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:50.196772  7139 consensus_queue.cc:237] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:50.212359  7201 ts_tablet_manager.cc:1929] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:00:50.212953  7201 log.cc:1199] T 5a5f5933777f457e99f4a6b1781ec12b P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/5a5f5933777f457e99f4a6b1781ec12b
I20260709 13:00:50.215273  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 5a5f5933777f457e99f4a6b1781ec12b (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:50.216480  7201 tablet_replica.cc:333] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:00:50.217643  7201 raft_consensus.cc:2243] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.226984  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 32066347a26c4c6a94cbe8e9b624cb23 with delete_type TABLET_DATA_TOMBSTONED (TS 0f82bbd9193f4b71a0c17a0357cf0ce9 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:34342
I20260709 13:00:50.218617  7201 raft_consensus.cc:2272] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.232077  7201 ts_tablet_manager.cc:1916] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:50.238214  1537 raft_consensus.cc:2468] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:50.242239  1435 catalog_manager.cc:5697] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 9 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 10 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.246556  1435 catalog_manager.cc:5697] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 11 to 12, leader changed from c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 12 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.274261  7209 tablet_replica.cc:333] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:50.277388  1435 catalog_manager.cc:5697] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 13 to 14, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 14 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.281212  7209 raft_consensus.cc:2243] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.282450  7209 raft_consensus.cc:2272] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.286269  7209 ts_tablet_manager.cc:1916] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:50.287274  1435 catalog_manager.cc:5697] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 9 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 10 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.303332  7201 ts_tablet_manager.cc:1929] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:00:50.320847  7201 log.cc:1199] T 8bbf1e27410e4984b453b68cb9b08bd6 P d3b488cf00f7497ea0bf5964b99f6e0e: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-1-root/wals/8bbf1e27410e4984b453b68cb9b08bd6
I20260709 13:00:50.322460  1426 catalog_manager.cc:5028] TS d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): tablet 8bbf1e27410e4984b453b68cb9b08bd6 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:50.325666  7163 raft_consensus.cc:993] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: : Instructing follower 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:50.326248  7163 raft_consensus.cc:1081] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Signalling peer 631fb66c0070402b8f78fd74633dae6f to start an election
I20260709 13:00:50.329706  1685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f65122cec34901839f22a448343dca"
dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
 from {username='slave'} at 127.0.0.1:57984
I20260709 13:00:50.330351  1685 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:50.330730  1685 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.342208  1685 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:50.357934  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9"
I20260709 13:00:50.358062  1685 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:50.358564  1538 raft_consensus.cc:3055] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:50.358878  1538 raft_consensus.cc:740] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f82bbd9193f4b71a0c17a0357cf0ce9, State: Running, Role: LEADER
I20260709 13:00:50.358974  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:50.359508  1612 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.359618  1538 consensus_queue.cc:260] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:50.366432  1612 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:50.367713  1656 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:50.367945  1538 raft_consensus.cc:3060] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.375557  1538 raft_consensus.cc:2468] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 10.
I20260709 13:00:50.369129  7169 raft_consensus.cc:2804] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:50.370698  7209 ts_tablet_manager.cc:1929] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 13:00:50.380401  1612 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:50.378486  7169 raft_consensus.cc:697] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:50.379837  7209 log.cc:1199] T 32066347a26c4c6a94cbe8e9b624cb23 P 0f82bbd9193f4b71a0c17a0357cf0ce9: Deleting WAL directory at /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601864268336-431-0/minicluster-data/ts-0-root/wals/32066347a26c4c6a94cbe8e9b624cb23
I20260709 13:00:50.384302  1538 raft_consensus.cc:1275] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:50.382138  7138 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:00:50.386989  1426 catalog_manager.cc:5028] TS 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): tablet 32066347a26c4c6a94cbe8e9b624cb23 (table test-workload [id=1e34fbe609e9487882b5ca35c2718a57]) successfully deleted
I20260709 13:00:50.387022  7140 consensus_queue.cc:1048] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.384300  7169 consensus_queue.cc:237] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:50.419826  1435 catalog_manager.cc:5697] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 9 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 10 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.532449  1538 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:50.534262  7151 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.573714  2306 raft_consensus.cc:1275] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:50.575621  7151 consensus_queue.cc:1048] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.636085  1537 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:50.645018  7151 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:00:50.693259  1540 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:50.697031  2306 raft_consensus.cc:1275] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:50.697644  7138 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.698838  7151 consensus_queue.cc:1048] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:50.753417  1611 raft_consensus.cc:1275] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:50.755458  7138 consensus_queue.cc:1048] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.790302  1423 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 1bb16b93f1fe47b4be38ae591c62b564 with cas_config_opid_index 4: aborting the task: latest config opid_index 10; task opid_index 4
I20260709 13:00:50.895377  1534 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:50.896806  7011 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.930589   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:50.942075  1612 raft_consensus.cc:1275] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:50.950380  7151 consensus_queue.cc:1048] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:51.287739   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:00:51.298302  1582 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:00:51.321556  1582 consensus_peers.cc:597] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.387805  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 75714.5us
W20260709 13:00:51.391784  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.407157  1582 consensus_peers.cc:597] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.418818  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.423550  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.441784  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.452734  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.482383  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.488348  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet f7d180faf3bc4436ad4c3b4b4805e7b9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.492323  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.496591  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.530242  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.639743   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:00:51.638053  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.622385  1582 consensus_peers.cc:597] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.657858   431 tablet_replica.cc:333] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
W20260709 13:00:51.668403  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.673822   431 raft_consensus.cc:2243] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:51.657903  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.676143   431 raft_consensus.cc:2272] T 8ab255080f74412f87943c46e12f9f06 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:51.689927  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.713979  1506 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 61480.8us
W20260709 13:00:51.725023  1582 consensus_peers.cc:597] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.725970  1582 consensus_peers.cc:597] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.731050  1582 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.741262  1582 consensus_peers.cc:597] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.755759  1689 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
W20260709 13:00:51.764612  1582 consensus_peers.cc:597] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.765492  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.770117  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.778894   431 tablet_replica.cc:333] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
W20260709 13:00:51.751569  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.783308  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.796051  1582 consensus_peers.cc:597] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.812940  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.815093  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.824051  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.825872  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.829675   431 raft_consensus.cc:2243] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:51.842113  1653 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25da6efa74464e65b8319c8230d379fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.847098   431 raft_consensus.cc:2272] T 57b6d9fb4551488e978e5e62c1c59485 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:51.862810  1612 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:51.867835   431 tablet_replica.cc:333] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:51.892037   431 raft_consensus.cc:2243] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:51.893962   431 raft_consensus.cc:2272] T 1bea0da863664ef78c27cd81d07e53d9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:51.899237  7140 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:51.899842  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.903553  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.933586   431 tablet_replica.cc:333] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:51.935242   431 raft_consensus.cc:2243] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:51.937103   431 raft_consensus.cc:2272] T 7fb908b69c2e4ea19d87384e95f694ce P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:51.937834  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.950886   431 tablet_replica.cc:333] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:51.960333   431 raft_consensus.cc:2243] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:51.961408   431 raft_consensus.cc:2272] T fe01230b6e6e4a119346bdaa29d78b55 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:51.971637  7185 raft_consensus.cc:2955] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:51.974725   431 tablet_replica.cc:333] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:51.992017   431 raft_consensus.cc:2243] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:51.996372  1611 raft_consensus.cc:2955] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:52.024559   431 raft_consensus.cc:2272] T 79180ee33a124de7a839155b4a30086e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.027983   431 tablet_replica.cc:333] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.029958   431 raft_consensus.cc:2243] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.031251   431 raft_consensus.cc:2272] T 5a5f5933777f457e99f4a6b1781ec12b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.066859   431 tablet_replica.cc:333] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.073809   431 raft_consensus.cc:2243] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.082363   431 raft_consensus.cc:2272] T 31d2293f596d4cefaf1a169b3a79ba46 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.087517   431 tablet_replica.cc:333] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.090757   431 raft_consensus.cc:2243] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.091688   431 raft_consensus.cc:2272] T d1a3569684e442e0a362c5e9412961ec P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.100801   431 tablet_replica.cc:333] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.100363  1435 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 9, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:52.101997   431 raft_consensus.cc:2243] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.114938   431 raft_consensus.cc:2272] T c877c15208b54931ba86acd6c47658c2 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.118394   431 tablet_replica.cc:333] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.119410   431 raft_consensus.cc:2243] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.120170   431 raft_consensus.cc:2272] T 96265149c6c844b48c46f6df62cc9162 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.129722  1611 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:52.147374   431 tablet_replica.cc:333] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
W20260709 13:00:52.161883  1579 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33d9e592d41d477fb881a9c29cc45de1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:52.172667  1685 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:52.174464  7174 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:52.205291  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:52.212847  7241 log.cc:927] Time spent T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:52.220956   431 raft_consensus.cc:2243] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.222533   431 raft_consensus.cc:2272] T c43a3d11aec04f86a107e64e2a5bc263 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.221634  7174 raft_consensus.cc:2955] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:52.228396  7230 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.229051  7230 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.241668  7230 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.245767  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.248252  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faff66e63c5547ae8e8132a1465a5a30" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.251960  1506 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.253384  7230 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:52.262194  7231 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.262946  7231 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.265888  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.267513  7229 raft_consensus.cc:493] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.268373  7229 raft_consensus.cc:515] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.271492  7229 leader_election.cc:290] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.278903  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.275374  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3f11a4a382403ca1e1f14d5fd731db" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.270943  1685 raft_consensus.cc:2955] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:52.296294  7231 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.310315  1506 leader_election.cc:304] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.312415  7231 raft_consensus.cc:2749] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.321604  1611 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:52.323072  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4058bbcb74442ac872f33138d7075c8" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.324934  1506 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.326216  7231 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.316089   431 tablet_replica.cc:333] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.331923   431 raft_consensus.cc:2243] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.337212   431 raft_consensus.cc:2272] T f4058bbcb74442ac872f33138d7075c8 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.367103  7230 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.367949  7230 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.371984  7230 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.374190  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.381098   431 tablet_replica.cc:333] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.382627  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a88b4c57e043e39d00e6e3f02b64fe" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.385160  1434 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 12, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.399792   431 raft_consensus.cc:2243] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.401103   431 raft_consensus.cc:2272] T 312ab9d000ac4b1c82c590d2ea787c2d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.414045  1506 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:52.418365  7247 ts_tablet_manager.cc:933] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.420285  7231 raft_consensus.cc:2749] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.429611   431 tablet_replica.cc:333] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.431452   431 raft_consensus.cc:2243] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.432646   431 raft_consensus.cc:2272] T 1246638ecc3b4bf59847dec07f61fd3d P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:52.437178  1579 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377): Couldn't send request to peer c445b7b7d94f48f99a3599ddfc92f462. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef459e67de67444fad0fff119d7885c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:52.441051  7229 raft_consensus.cc:493] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.441745  7229 raft_consensus.cc:515] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.443536  1685 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:52.444999  7174 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:52.445935  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:52.446128  7229 leader_election.cc:290] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.446193  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.448897  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f65122cec34901839f22a448343dca" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.453631  7229 raft_consensus.cc:493] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:52.454672  7229 raft_consensus.cc:515] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.458979  7230 raft_consensus.cc:493] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:52.459686  7230 raft_consensus.cc:515] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.462000  7230 leader_election.cc:290] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.465135  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.465538  7229 leader_election.cc:290] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.467908  1506 leader_election.cc:304] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.469252  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.469354  7229 raft_consensus.cc:2749] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.475191   431 tablet_replica.cc:333] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.476691  7247 tablet_copy_client.cc:323] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43205
I20260709 13:00:52.480993  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f37c8720262488fbc2c2923a7e60e16" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.481079  1698 tablet_copy_service.cc:140] P 631fb66c0070402b8f78fd74633dae6f: Received BeginTabletCopySession request for tablet 25da6efa74464e65b8319c8230d379fc from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:55612)
I20260709 13:00:52.481978  1698 tablet_copy_service.cc:161] P 631fb66c0070402b8f78fd74633dae6f: Beginning new tablet copy session on tablet 25da6efa74464e65b8319c8230d379fc from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:55612: session id = c445b7b7d94f48f99a3599ddfc92f462-25da6efa74464e65b8319c8230d379fc
I20260709 13:00:52.489840  1506 leader_election.cc:304] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:52.491318  7230 raft_consensus.cc:2749] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:52.492086  7230 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.492630  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710eea1b85d441dcabbb12e33e31ae6b" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.492758  7230 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.498142  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.499095  7230 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.500712   431 raft_consensus.cc:2243] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.503407   431 raft_consensus.cc:2272] T 048bebee007041bf8db6f1bdbcf60a16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.505509  1506 leader_election.cc:304] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:52.510622  7231 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.511346  7231 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.513665  7231 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.513927   431 tablet_replica.cc:333] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.514274  7231 raft_consensus.cc:2749] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.515046   431 raft_consensus.cc:2243] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.509315  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7b3cac6dd7435096e3efbed87d6eda" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.515754   431 raft_consensus.cc:2272] T f5f65122cec34901839f22a448343dca P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.517340  7144 raft_consensus.cc:493] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:52.517777  1506 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.517939  7144 raft_consensus.cc:515] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.523387  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.523387  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.525771  7229 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:52.526427  7229 raft_consensus.cc:493] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.526989  7229 raft_consensus.cc:515] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.529958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.531837  1506 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.532956  1698 tablet_copy_source_session.cc:215] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:52.533978  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4588cb2170964d9888521712ee881700" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.535322  7231 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:52.538786  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.539229  1507 leader_election.cc:304] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.540666  7230 raft_consensus.cc:2749] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:52.543123  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da6efa74464e65b8319c8230d379fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.544457  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed37d8a3924f28925dbe22d17e11b3" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.537412  7229 leader_election.cc:290] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.549886  1506 leader_election.cc:304] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.520475  7144 leader_election.cc:290] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.551805  7236 raft_consensus.cc:2955] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:52.563542  1682 raft_consensus.cc:2955] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } } }
I20260709 13:00:52.551288  7144 raft_consensus.cc:2749] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.583506  7144 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.584213  7144 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.587728  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.590274  7144 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.592043  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf1e27410e4984b453b68cb9b08bd6" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.593773  1504 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:52.594625  7229 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.601946  7144 raft_consensus.cc:493] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.602618  7144 raft_consensus.cc:515] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.633770  7229 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.616582  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.614485   431 tablet_replica.cc:333] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.638145   431 raft_consensus.cc:2243] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.616075  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4ac1b152f343b3b3d211b9061e8c4e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.635682  7229 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.619477  7144 leader_election.cc:290] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.649950  1434 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: config changed from index -1 to 10, NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.661969  7229 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.662549  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.663466  1506 leader_election.cc:304] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.664642  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94c71168cb04e9eaa1fdc0b7a131d9c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.666457  1506 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.667661  7229 raft_consensus.cc:2749] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.668354  7229 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.670022   431 raft_consensus.cc:2272] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.675345  7250 ts_tablet_manager.cc:933] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:52.681456  7144 raft_consensus.cc:493] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.709298  7144 raft_consensus.cc:515] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.711881  7144 leader_election.cc:290] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.685379  7229 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.714048  7229 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.694240  7231 raft_consensus.cc:493] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.716578  7231 raft_consensus.cc:515] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.718765  7231 leader_election.cc:290] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.720436  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.721518  7230 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.722097  7230 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.724190  7230 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.726563  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.727270  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.728513  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339ceb86dfa74bca9b98f5bc6947143e" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.731035  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.733096  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3306db491bf34b228d1100fd9c826528" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.734902  7229 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.735850  1506 leader_election.cc:304] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.737046  7231 raft_consensus.cc:2749] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:52.738216  1506 leader_election.cc:304] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.739296  7231 raft_consensus.cc:2749] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.748816  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.756460  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fd8c1bd97c403fbac13cb4d6f34e1c" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.757076  7231 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.757740  7231 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.759303  1504 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:52.759667  7144 raft_consensus.cc:493] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c445b7b7d94f48f99a3599ddfc92f462)
I20260709 13:00:52.759945  7231 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.760171  7230 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.760439  7144 raft_consensus.cc:515] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:52.761972  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.768288  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95518ca56c246da9d064efb1f0fb391" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.787285  7144 leader_election.cc:290] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:52.769402  1506 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.782282  7229 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:00:52.788861  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:52.789412  7229 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } }
I20260709 13:00:52.790990  7144 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:52.791391  7229 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:52.807482   431 tablet_replica.cc:333] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.808326  1506 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:52.809578  7229 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.811980  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.814561   431 raft_consensus.cc:2243] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.827921   431 raft_consensus.cc:2272] T a0a666caa35f4005a9f1bd6c9797300c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.823117  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee88b04047243b6b9ee3653189f3969" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.831393  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da6efa74464e65b8319c8230d379fc" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.911623  7250 tablet_copy_client.cc:323] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 13:00:52.921581  1507 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:00:52.922693  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 52948.3us
I20260709 13:00:52.923467  1507 leader_election.cc:304] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.923511  7251 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.924273  7229 raft_consensus.cc:2749] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:52.926113  7230 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:00:52.926853   431 tablet_replica.cc:333] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:52.926787  7230 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.928151  7254 ts_tablet_manager.cc:933] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: Initiating tablet copy from peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:52.929075  7230 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.933667  7247 tablet_copy_client.cc:806] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:52.934458  7247 tablet_copy_client.cc:670] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:52.938246  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.943750  7254 tablet_copy_client.cc:323] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33617
I20260709 13:00:52.945688   431 raft_consensus.cc:2243] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.950057  7174 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:52.950780  7174 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:52.952479  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet 33d9e592d41d477fb881a9c29cc45de1 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 13:00:52.953091  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet 33d9e592d41d477fb881a9c29cc45de1 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-33d9e592d41d477fb881a9c29cc45de1
I20260709 13:00:52.953812  7174 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:52.961354  1626 tablet_copy_source_session.cc:215] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:52.962625  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:52.964018  1626 tablet_copy_service.cc:140] P d3b488cf00f7497ea0bf5964b99f6e0e: Received BeginTabletCopySession request for tablet ef459e67de67444fad0fff119d7885c0 from peer c445b7b7d94f48f99a3599ddfc92f462 ({username='slave'} at 127.0.0.1:53078)
I20260709 13:00:52.964576  1626 tablet_copy_service.cc:161] P d3b488cf00f7497ea0bf5964b99f6e0e: Beginning new tablet copy session on tablet ef459e67de67444fad0fff119d7885c0 from peer c445b7b7d94f48f99a3599ddfc92f462 at {username='slave'} at 127.0.0.1:53078: session id = c445b7b7d94f48f99a3599ddfc92f462-ef459e67de67444fad0fff119d7885c0
W20260709 13:00:52.978575  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 44957.9us
I20260709 13:00:52.984103  7250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9e592d41d477fb881a9c29cc45de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.985702  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3e95209267412dbc539c57519c1a37" candidate_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:52.987820  1507 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f82bbd9193f4b71a0c17a0357cf0ce9; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:52.989701  7230 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:53.000003  1626 tablet_copy_source_session.cc:215] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:53.008787  7254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef459e67de67444fad0fff119d7885c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.009713  7247 tablet_copy_client.cc:538] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:53.015491   431 raft_consensus.cc:2272] T 710eea1b85d441dcabbb12e33e31ae6b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:53.021819  1582 leader_election.cc:336] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.022433  1582 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:53.023427  7191 raft_consensus.cc:2749] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:53.035928   431 tablet_replica.cc:333] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.036235  7174 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.036820  7174 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.038802  7174 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:53.040297  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:53.042470   431 raft_consensus.cc:2243] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.049294  7254 tablet_copy_client.cc:806] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:53.050000  7254 tablet_copy_client.cc:670] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:53.050556  7247 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 13:00:53.054445  7254 tablet_copy_client.cc:538] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:53.043804   431 raft_consensus.cc:2272] T 0d2479e7644f4a63a2e17a1e8ba94dcc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.065383  7254 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 13:00:53.066730   431 tablet_replica.cc:333] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
W20260709 13:00:53.067327  1582 leader_election.cc:336] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.071210  1582 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:53.072088  7174 raft_consensus.cc:2749] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.085282   431 raft_consensus.cc:2243] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.092885   431 raft_consensus.cc:2272] T 4588cb2170964d9888521712ee881700 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.096474   431 tablet_replica.cc:333] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.097361   431 raft_consensus.cc:2243] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.098591   431 raft_consensus.cc:2272] T cf01b8ced3144c0289c4f428fc24ead7 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.101368   431 tablet_replica.cc:333] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.116573  7250 tablet_copy_client.cc:806] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:53.118503   431 raft_consensus.cc:2243] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.119494   431 raft_consensus.cc:2272] T 39ed37d8a3924f28925dbe22d17e11b3 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.121511  7250 tablet_copy_client.cc:670] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:53.125830   431 tablet_replica.cc:333] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.125953  7250 tablet_copy_client.cc:538] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:53.142688   431 raft_consensus.cc:2243] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.143199  7250 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap starting.
I20260709 13:00:53.153452   431 raft_consensus.cc:2272] T a95518ca56c246da9d064efb1f0fb391 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.164811   431 tablet_replica.cc:333] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.165894   431 raft_consensus.cc:2243] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.166759   431 raft_consensus.cc:2272] T 33d9e592d41d477fb881a9c29cc45de1 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.194200   431 tablet_replica.cc:333] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.195195   431 raft_consensus.cc:2243] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.208832   431 raft_consensus.cc:2272] T 65a88b4c57e043e39d00e6e3f02b64fe P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.216281   431 tablet_replica.cc:333] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.224051   431 raft_consensus.cc:2243] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.224848   431 raft_consensus.cc:2272] T ef459e67de67444fad0fff119d7885c0 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.240856   431 tablet_replica.cc:333] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.241977   431 raft_consensus.cc:2243] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.243398   431 raft_consensus.cc:2272] T 6b3d048f5d2644a6b635da71cc6c7a8b P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.251520   431 tablet_replica.cc:333] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.253575   431 raft_consensus.cc:2243] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.258219   431 raft_consensus.cc:2272] T fc3f11a4a382403ca1e1f14d5fd731db P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.264688   431 tablet_replica.cc:333] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.287679   431 raft_consensus.cc:2243] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.288467   431 raft_consensus.cc:2272] T ef7b3cac6dd7435096e3efbed87d6eda P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.291378   431 tablet_replica.cc:333] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.296559   431 raft_consensus.cc:2243] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.301924   431 raft_consensus.cc:2272] T 25da6efa74464e65b8319c8230d379fc P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.303860  7140 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.304538  7140 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.305063   431 tablet_replica.cc:333] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.305938   431 raft_consensus.cc:2243] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.306622   431 raft_consensus.cc:2272] T 8bbf1e27410e4984b453b68cb9b08bd6 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.306846  7140 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.309310   431 tablet_replica.cc:333] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.310377   431 raft_consensus.cc:2243] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.311523   431 raft_consensus.cc:2272] T f38b9a36dae0409c8200773ccf754d04 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:53.311676  1656 leader_election.cc:336] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.312393  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:53.313251  1612 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:53.314460   431 tablet_replica.cc:333] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.314771  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.315441   431 raft_consensus.cc:2243] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.315614  7140 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.316138   431 raft_consensus.cc:2272] T 3f37c8720262488fbc2c2923a7e60e16 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.316093  7140 raft_consensus.cc:493] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.316813  7140 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.319167   431 tablet_replica.cc:333] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.319958   431 raft_consensus.cc:2243] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.320525   431 raft_consensus.cc:2272] T 2f4ac1b152f343b3b3d211b9061e8c4e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.323287   431 tablet_replica.cc:333] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.324048   431 raft_consensus.cc:2243] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.324772   431 raft_consensus.cc:2272] T faff66e63c5547ae8e8132a1465a5a30 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.327564   431 tablet_replica.cc:333] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.330020   431 raft_consensus.cc:2243] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.331175   431 raft_consensus.cc:2272] T 1bb16b93f1fe47b4be38ae591c62b564 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.333952   431 tablet_replica.cc:333] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.334841   431 raft_consensus.cc:2243] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.334959  7247 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=3 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:53.336020   431 raft_consensus.cc:2272] T 113c4345626841658cc1c3aa19853e2a P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.337045  7140 raft_consensus.cc:515] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.345688  7140 leader_election.cc:290] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.336064  7247 tablet_bootstrap.cc:492] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 13:00:53.340915   431 tablet_replica.cc:333] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.346630  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bea0da863664ef78c27cd81d07e53d9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
W20260709 13:00:53.350535  1656 leader_election.cc:336] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.357707  1612 raft_consensus.cc:3060] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.361486   431 raft_consensus.cc:2243] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.362238   431 raft_consensus.cc:2272] T 3306db491bf34b228d1100fd9c826528 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.332011  7254 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:53.364501  7254 tablet_bootstrap.cc:492] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 13:00:53.366133  7254 ts_tablet_manager.cc:1403] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.301s	user 0.032s	sys 0.016s
I20260709 13:00:53.357148  7247 ts_tablet_manager.cc:1403] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.307s	user 0.049s	sys 0.010s
I20260709 13:00:53.379834  1612 raft_consensus.cc:2468] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
I20260709 13:00:53.381130  1656 leader_election.cc:304] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.381894  7257 raft_consensus.cc:2804] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:53.382383  7257 raft_consensus.cc:697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:53.383306  7257 consensus_queue.cc:237] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.385478  7258 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.386062  7258 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.388705  7258 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.390730  7247 raft_consensus.cc:359] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:53.394102  7247 raft_consensus.cc:740] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 13:00:53.395347  7247 consensus_queue.cc:260] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:53.367317   431 tablet_replica.cc:333] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.398149   431 raft_consensus.cc:2243] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.398983   431 raft_consensus.cc:2272] T f94c71168cb04e9eaa1fdc0b7a131d9c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.395826  7250 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:53.401152  7250 tablet_bootstrap.cc:492] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: Bootstrap complete.
I20260709 13:00:53.379313  7254 raft_consensus.cc:359] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:53.398981  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:53.402177  1612 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 14.
I20260709 13:00:53.401621  7254 raft_consensus.cc:740] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 13:00:53.403152  7254 consensus_queue.cc:260] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:53.404676   431 tablet_replica.cc:333] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.407053  2310 raft_consensus.cc:1217] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:00:53.408066  7247 ts_tablet_manager.cc:1434] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:00:53.409397   431 raft_consensus.cc:2243] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.414510   431 raft_consensus.cc:2272] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.410501  1698 tablet_copy_service.cc:342] P 631fb66c0070402b8f78fd74633dae6f: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-25da6efa74464e65b8319c8230d379fc received from {username='slave'} at 127.0.0.1:55612
I20260709 13:00:53.415139  1698 tablet_copy_service.cc:434] P 631fb66c0070402b8f78fd74633dae6f: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-25da6efa74464e65b8319c8230d379fc on tablet 25da6efa74464e65b8319c8230d379fc with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:53.404668  7250 ts_tablet_manager.cc:1403] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: Time spent bootstrapping tablet: real 0.262s	user 0.030s	sys 0.021s
I20260709 13:00:53.413689  7254 ts_tablet_manager.cc:1434] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.005s
I20260709 13:00:53.418546  7250 raft_consensus.cc:359] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:53.421775  7250 raft_consensus.cc:740] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Initialized, Role: LEARNER
I20260709 13:00:53.422590  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-ef459e67de67444fad0fff119d7885c0 received from {username='slave'} at 127.0.0.1:53078
I20260709 13:00:53.423200  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-ef459e67de67444fad0fff119d7885c0 on tablet ef459e67de67444fad0fff119d7885c0 with peer c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:53.425499   431 tablet_replica.cc:333] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.426357   431 raft_consensus.cc:2243] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.422510  7250 consensus_queue.cc:260] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: true } }
I20260709 13:00:53.430447   431 raft_consensus.cc:2272] T 781a7e0898fc40c4a08fd46ca3bf5f17 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.433302   431 tablet_replica.cc:333] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.434587  1435 catalog_manager.cc:5697] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 13, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.437614  7250 ts_tablet_manager.cc:1434] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:00:53.439311  1626 tablet_copy_service.cc:342] P d3b488cf00f7497ea0bf5964b99f6e0e: Request end of tablet copy session c445b7b7d94f48f99a3599ddfc92f462-33d9e592d41d477fb881a9c29cc45de1 received from {username='slave'} at 127.0.0.1:53078
I20260709 13:00:53.439878  1626 tablet_copy_service.cc:434] P d3b488cf00f7497ea0bf5964b99f6e0e: ending tablet copy session c445b7b7d94f48f99a3599ddfc92f462-33d9e592d41d477fb881a9c29cc45de1 on tablet 33d9e592d41d477fb881a9c29cc45de1 with peer c445b7b7d94f48f99a3599ddfc92f462
W20260709 13:00:53.402402  1656 leader_election.cc:336] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.443516  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.439313   431 raft_consensus.cc:2243] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.451838   431 raft_consensus.cc:2272] T 339ceb86dfa74bca9b98f5bc6947143e P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.448942  7257 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:53.463742  7257 raft_consensus.cc:493] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.464159  7257 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.489406   431 tablet_replica.cc:333] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.492049   431 raft_consensus.cc:2243] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.516855   431 raft_consensus.cc:2272] T 07fbe913c7484df18b86408c13eabaad P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.500721  7257 raft_consensus.cc:515] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:53.527354  1656 leader_election.cc:336] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.528061   431 tablet_replica.cc:333] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.532528   431 raft_consensus.cc:2243] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.533571   431 raft_consensus.cc:2272] T 1b3e95209267412dbc539c57519c1a37 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.536895   431 tablet_replica.cc:333] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.537607   431 raft_consensus.cc:2243] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.538156   431 raft_consensus.cc:2272] T 2ee88b04047243b6b9ee3653189f3969 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.544780  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb908b69c2e4ea19d87384e95f694ce" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:53.545357  1612 raft_consensus.cc:3060] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.545948  7185 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.546478  7185 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.548447  7185 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.552809  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:53.555568  7185 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.557159  7185 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:53.556023  1656 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.558176  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:53.558948  7259 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.559165  7236 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.559741  7236 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.561827  7236 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:53.563269  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:53.563611  7185 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.563949  1682 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
W20260709 13:00:53.564678  1656 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.555365  1612 raft_consensus.cc:2468] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 15.
I20260709 13:00:53.567109  1656 leader_election.cc:304] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.545290   431 tablet_replica.cc:333] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9: stopping tablet replica
I20260709 13:00:53.576354  7185 raft_consensus.cc:2804] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:53.556110  7257 leader_election.cc:290] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.579349   431 raft_consensus.cc:2243] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:00:53.576139  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:53.580235  7185 raft_consensus.cc:697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 15 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:53.581393  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:53.581203  7185 consensus_queue.cc:237] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:53.584434  1582 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.588414  7236 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.588919  7236 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.589332  7236 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.594810   431 raft_consensus.cc:2272] T 018c063cc2cf4b4aa09be2b8d7067e61 P 0f82bbd9193f4b71a0c17a0357cf0ce9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.592969  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:53.605317  7259 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.615967  7236 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:53.626704  1582 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.637578  1435 catalog_manager.cc:5697] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 14 to 15, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 15 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.645465  7236 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:53.648563  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c877c15208b54931ba86acd6c47658c2" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:53.649277  1682 raft_consensus.cc:3060] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.664356  1682 raft_consensus.cc:2468] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:53.665740  1581 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.667362  7174 raft_consensus.cc:2804] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:53.667927  7174 raft_consensus.cc:697] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:53.671005  7174 consensus_queue.cc:237] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.695055  7236 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.695672  7236 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.698858  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:53.699254  2308 raft_consensus.cc:1217] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:00:53.699491  1682 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:53.700347  7236 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:53.707760  7185 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.708493  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:53.708397  7185 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.709317  7191 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:53.709729  7191 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.710103  7191 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.710587  7185 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.715370  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:53.716099  1656 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:53.718482  1582 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.718720  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:53.720091  7191 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.721062  7185 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.726948  1435 catalog_manager.cc:5697] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 12 to 13, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 13 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.730504  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048bebee007041bf8db6f1bdbcf60a16" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:53.731079  1682 raft_consensus.cc:3060] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:53.732486  1582 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.738052  1682 raft_consensus.cc:2468] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:53.739303  1581 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.741348  7174 raft_consensus.cc:2804] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:53.756354  7191 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:53.763115  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:53.775117  7174 raft_consensus.cc:697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:53.776284  7174 consensus_queue.cc:237] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.805552  7257 raft_consensus.cc:1064] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 13:00:53.806548  7269 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.807144  7269 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.808635  7257 consensus_queue.cc:237] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:53.812039  1582 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:53.814222  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.819581  7269 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:53.820809  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:53.821530  1690 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 9.
I20260709 13:00:53.823218  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.823958  7269 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.824349  7269 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.824715  7269 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:53.849473  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:53.852684  1435 catalog_manager.cc:5697] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 11 to 12, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 12 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:53.873049  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:53.876080  7257 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.876816  7257 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.877725  7269 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.878906  7257 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:53.879657  7273 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.880205  7273 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.882165  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d180faf3bc4436ad4c3b4b4805e7b9" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:53.882766  1690 raft_consensus.cc:3060] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.882342  7273 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:53.888088  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:53.888818  1682 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:53.890055  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:53.893955  7236 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.894375  7236 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:53.894743  7236 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:53.898466  1582 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:53.899646  1582 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.910567  2308 raft_consensus.cc:1217] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:00:53.914546  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:53.921036  1690 raft_consensus.cc:2468] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:53.928689  1581 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:53.930936  7174 raft_consensus.cc:2804] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:53.931434  7174 raft_consensus.cc:697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:53.932286  7174 consensus_queue.cc:237] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.937525  7269 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:53.955369  1656 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.958397  1614 raft_consensus.cc:1275] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:00:53.959596  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:53.959739  1611 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:53.960593  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:53.966507  7277 consensus_queue.cc:1048] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:53.968322  7279 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:53.973739  7236 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:53.975020  1612 raft_consensus.cc:2393] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631fb66c0070402b8f78fd74633dae6f in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:53.981653  1582 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.992456  2308 raft_consensus.cc:1275] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEARNER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:54.006268  7278 consensus_queue.cc:1048] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:54.017194  1582 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.019834  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:54.028064  1435 catalog_manager.cc:5697] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 9 to 10, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:54.031735  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.032433  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.026675  7279 raft_consensus.cc:3060] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:54.033321  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:54.037892  1582 consensus_peers.cc:597] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.031148  7236 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:54.068064  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a666caa35f4005a9f1bd6c9797300c" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
W20260709 13:00:54.079455  1582 consensus_peers.cc:597] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.101368  1582 consensus_peers.cc:597] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.110433  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.117501  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.103325  7279 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:54.128917  7277 raft_consensus.cc:2955] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:54.133071  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.144280  2310 raft_consensus.cc:2955] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:54.149385  1582 consensus_peers.cc:597] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.160607  1685 raft_consensus.cc:1275] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:54.160840  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.162213  7236 consensus_queue.cc:1048] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.163451  1682 raft_consensus.cc:2468] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 13.
I20260709 13:00:54.176393  1581 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:54.177666  7236 raft_consensus.cc:2804] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:54.178182  7236 raft_consensus.cc:697] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:54.178980  7236 consensus_queue.cc:237] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.180639  1612 raft_consensus.cc:1275] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:54.203389  1435 catalog_manager.cc:5697] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 9 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:54.215044  1582 consensus_peers.cc:597] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.220022  1582 consensus_peers.cc:597] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.222848  1432 catalog_manager.cc:5697] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 12 to 13, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 13 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:54.231679  1582 consensus_peers.cc:597] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.233609  7275 consensus_queue.cc:1048] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:54.233618  1612 raft_consensus.cc:2955] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:54.236442  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.237149  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.237756  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.238396  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.245671  7272 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.246340  7272 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.251399  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:54.258266  7272 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:54.260188  1582 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.261245  1582 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:00:54.262436  7272 raft_consensus.cc:2749] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:54.290861  1582 consensus_peers.cc:597] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.295213  7285 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.295888  7285 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.298197  7285 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.298691  1685 raft_consensus.cc:1275] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:00:54.300201  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:54.300904  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.302225  7236 consensus_queue.cc:1048] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:54.303126  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:54.310024  2276 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.310531  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:54.311493  6975 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:54.338904  7269 raft_consensus.cc:1064] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
W20260709 13:00:54.346374  1656 connection.cc:769] client connection to 127.0.107.193:34321 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:00:54.347445  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.358111  7236 raft_consensus.cc:1064] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: attempting to promote NON_VOTER c445b7b7d94f48f99a3599ddfc92f462 to VOTER
I20260709 13:00:54.361383  7236 consensus_queue.cc:237] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.379669  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.390095  7269 consensus_queue.cc:237] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.416494  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.471168  2306 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:54.473106  1682 raft_consensus.cc:1275] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:54.473956  7272 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:54.474730  7274 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.475304  7274 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.476459  7272 consensus_queue.cc:1048] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:54.477681  7274 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.481228  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:54.491691  7185 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.492357  7185 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.494590  7185 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.495923  7272 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.496646  7272 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.497972  7174 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.498682  7174 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.501155  7174 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.502950  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
W20260709 13:00:54.506752  1656 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.507256  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:54.508487  7185 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:54.508610  7274 raft_consensus.cc:2955] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:54.521668  7185 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.522275  7185 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.524664  7185 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.526897  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:54.527719  1612 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 15.
I20260709 13:00:54.529093  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
W20260709 13:00:54.531298  1656 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.532341  7185 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:54.532815  7185 raft_consensus.cc:493] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.533213  7185 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:54.534399  2306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:54.521852  7174 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.535145  2306 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:54.538352  7174 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.540746  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:54.542338  2306 raft_consensus.cc:2955] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:54.540026  7272 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.577414  7174 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:54.580129  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:54.590860  6975 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.600488  6975 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.600889  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.601974  7185 raft_consensus.cc:515] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.605417  6975 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.592475  2306 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEARNER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:54.594877  1435 catalog_manager.cc:5697] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: config changed from index 12 to 13, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:54.607820  7269 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:54.608383  7269 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.608927  7269 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:54.608266  1656 leader_election.cc:336] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.639206  7277 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.639802  7277 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.640682  7272 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:54.648973  7274 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.652596  7274 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.665649  1685 raft_consensus.cc:1275] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:54.667387  1682 raft_consensus.cc:1275] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:54.667430  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:54.670243  1614 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:54.674340  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:54.675459  1685 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 10.
I20260709 13:00:54.678059  7277 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.682392  1685 raft_consensus.cc:2955] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:54.701990  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 64050.6us
I20260709 13:00:54.683383  7274 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.703908  7269 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.705818  1582 consensus_peers.cc:597] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:54.706329  1582 consensus_peers.cc:597] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.708527  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:54.714345  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf01b8ced3144c0289c4f428fc24ead7" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:54.715323  1612 raft_consensus.cc:3060] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:54.706717  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:54.719748  1582 leader_election.cc:336] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.716985  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:54.724299  1582 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:54.726377  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:00:54.722435  7272 consensus_queue.cc:1048] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:00:54.741711  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb16b93f1fe47b4be38ae591c62b564" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:54.742429  2310 raft_consensus.cc:3060] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:54.743017  1656 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.743510  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:54.724874  7302 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:54.744561  7302 raft_consensus.cc:493] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.744969  7302 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.747272  7278 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:54.732128  2308 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 16.
I20260709 13:00:54.737733  7185 leader_election.cc:290] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.737844  7174 raft_consensus.cc:2749] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:54.741860  7258 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.750805  7258 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.723675  7301 consensus_queue.cc:1048] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:54.752959  7258 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:54.755119  1582 consensus_peers.cc:597] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:54.755743  1582 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:00:54.756620  1582 leader_election.cc:336] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:00:54.756816  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.757119  1582 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:54.758088  7301 raft_consensus.cc:2749] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:54.728720  7269 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.765972  1612 raft_consensus.cc:2468] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:00:54.771446  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:54.772409  1614 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 12.
I20260709 13:00:54.775367  6975 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.775942  6975 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.777324  1656 leader_election.cc:304] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:54.780028  7185 raft_consensus.cc:2804] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:54.780624  7185 raft_consensus.cc:697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:54.781407  6975 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.781594  7185 consensus_queue.cc:237] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:54.783764  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.792004  2310 raft_consensus.cc:2468] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:54.802866  6975 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.793504  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:54.803444  6975 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.806039  1582 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.815423  6975 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.778215  7300 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
W20260709 13:00:54.828150  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 127747us
I20260709 13:00:54.830318  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:54.831347  7269 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:54.831801  7269 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.832258  7269 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:54.832442  2276 leader_election.cc:336] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.839213  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:54.839524  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:54.840152  1612 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
W20260709 13:00:54.848062  1582 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.848393  7300 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.848924  1582 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:00:54.849529  1582 consensus_peers.cc:597] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.850601  7236 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.851449  7236 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.821026  7276 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:54.852756  7276 raft_consensus.cc:493] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.853276  7276 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.854159  7236 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:00:54.850662  7300 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.855142  1614 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 12.
I20260709 13:00:54.858497  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:54.858309  7302 raft_consensus.cc:515] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.859529  7272 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:54.859930  7272 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.860353  7272 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:54.860802  1579 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:54.861042  7302 leader_election.cc:290] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:54.861980  7300 raft_consensus.cc:2804] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:54.862485  7300 raft_consensus.cc:697] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:54.863370  7300 consensus_queue.cc:237] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:54.866671  1582 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.879413  1690 raft_consensus.cc:1275] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:54.880805  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:00:54.881486  1688 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 14.
I20260709 13:00:54.882344  7276 raft_consensus.cc:515] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:54.886840  2308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
W20260709 13:00:54.890450  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 50858us
I20260709 13:00:54.917469  7276 leader_election.cc:290] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:54.917536  1582 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:00:54.917487  1656 leader_election.cc:336] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.917129  2308 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 12.
I20260709 13:00:54.931342  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:54.934144  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fbe913c7484df18b86408c13eabaad" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:54.935804  7302 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:54.934412  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:54.936961  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781a7e0898fc40c4a08fd46ca3bf5f17" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:54.967779  1612 raft_consensus.cc:3060] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.942057  7272 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:54.947292  7236 consensus_queue.cc:1048] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:54.948184  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:54.947166  1656 leader_election.cc:336] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.954923  1614 raft_consensus.cc:3060] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:54.973793  2276 leader_election.cc:336] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:54.967295  7302 raft_consensus.cc:493] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.989804  1612 raft_consensus.cc:2468] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 15.
I20260709 13:00:54.990007  7174 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:54.996182  7174 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:54.996608  7174 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.000928  1434 catalog_manager.cc:5697] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 15 to 16, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 16 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:55.011400  7174 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:55.014312  7174 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:55.006233  1582 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.021512  7272 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:00:54.977284  7285 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.023131  7285 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:55.023614  7285 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.037066  7302 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.042047  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:55.043668  7236 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.044185  7236 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f82bbd9193f4b71a0c17a0357cf0ce9)
I20260709 13:00:55.044663  7236 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:55.048913  1582 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.049461  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c063cc2cf4b4aa09be2b8d7067e61" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:55.051056  1682 raft_consensus.cc:3060] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.051523  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2479e7644f4a63a2e17a1e8ba94dcc" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:55.052150  2310 raft_consensus.cc:3060] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:55.050199  1614 raft_consensus.cc:2468] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 13.
W20260709 13:00:55.057684  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 68057.3us
I20260709 13:00:55.071466  1656 leader_election.cc:304] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:55.082758  7257 raft_consensus.cc:2804] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:55.078976  7269 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:55.109619  2310 raft_consensus.cc:2468] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 17.
I20260709 13:00:55.111671  7257 raft_consensus.cc:697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:00:55.112353  1434 catalog_manager.cc:5697] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 14 to 15, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.113138  7257 consensus_queue.cc:237] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:00:55.125407  7269 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:00:55.148084  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 62667.2us
I20260709 13:00:55.155623  2276 leader_election.cc:304] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 
I20260709 13:00:55.164356  1579 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:55.170493  1682 raft_consensus.cc:2468] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 15.
I20260709 13:00:55.170701  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38b9a36dae0409c8200773ccf754d04" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f"
I20260709 13:00:55.171816  1681 raft_consensus.cc:3060] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.172430  1581 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:55.178310  1582 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.180439  7174 raft_consensus.cc:2804] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:55.181018  7174 raft_consensus.cc:697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
I20260709 13:00:55.182969  1681 raft_consensus.cc:2468] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3b488cf00f7497ea0bf5964b99f6e0e in term 11.
I20260709 13:00:55.185936  7174 consensus_queue.cc:237] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:55.140087  7285 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:55.207789  7313 raft_consensus.cc:2804] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:55.208578  7285 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:55.224332  7236 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:55.227198  7236 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
W20260709 13:00:55.239316  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 83827.1us
W20260709 13:00:55.240043  2276 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.208528  7313 raft_consensus.cc:697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:55.291761  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 119417us
I20260709 13:00:55.297868  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:55.302714  1611 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c445b7b7d94f48f99a3599ddfc92f462 in current term 13: Already voted for candidate d3b488cf00f7497ea0bf5964b99f6e0e in this term.
W20260709 13:00:55.330392  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 118616us
I20260709 13:00:55.325977  7309 raft_consensus.cc:2804] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:55.331948  1581 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:55.336406  7269 raft_consensus.cc:2804] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:55.345116  7309 raft_consensus.cc:697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:55.350528  1681 raft_consensus.cc:2955] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:55.365041   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1562)
I20260709 13:00:55.364094  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:00:55.347957  7269 raft_consensus.cc:697] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Becoming Leader. State: Replica: d3b488cf00f7497ea0bf5964b99f6e0e, State: Running, Role: LEADER
W20260709 13:00:55.364547  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 63183.1us
I20260709 13:00:55.366628  2304 raft_consensus.cc:2393] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d3b488cf00f7497ea0bf5964b99f6e0e in current term 13: Already voted for candidate c445b7b7d94f48f99a3599ddfc92f462 in this term.
I20260709 13:00:55.345583  7302 raft_consensus.cc:515] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:55.246405  7272 raft_consensus.cc:2955] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:55.395054  1435 catalog_manager.cc:5697] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 12 to 13, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 13 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:55.407867  7314 log.cc:927] Time spent T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:00:55.409235  7315 log.cc:927] Time spent T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:55.409631  7309 consensus_queue.cc:237] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:55.347220  7313 consensus_queue.cc:237] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:55.414791  7312 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
W20260709 13:00:55.422864  7323 log.cc:927] Time spent T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 13:00:55.425802  7302 leader_election.cc:290] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:00:55.428467  2276 leader_election.cc:336] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.431924  7269 consensus_queue.cc:237] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:00:55.453811  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 56581.6us
I20260709 13:00:55.469628  1435 catalog_manager.cc:5697] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 14 to 15, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:55.472920  2276 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.473448  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:00:55.475526  7309 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:55.506318  2276 leader_election.cc:336] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:00:55.532878  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 172261us
I20260709 13:00:55.534909  1435 catalog_manager.cc:5697] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: config changed from index 10 to 11, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
W20260709 13:00:55.536288  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.538708  2310 raft_consensus.cc:2955] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } } }
I20260709 13:00:55.541306  1434 catalog_manager.cc:5697] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 16 to 17, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 17 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.543154  1434 catalog_manager.cc:5697] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 14 to 15, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:55.548038  1582 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:55.552999  2304 raft_consensus.cc:1275] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:00:55.560624  1582 consensus_peers.cc:597] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.567090  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113c4345626841658cc1c3aa19853e2a" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:55.576601  1611 raft_consensus.cc:3060] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.589797  1611 raft_consensus.cc:2468] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
W20260709 13:00:55.591169  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.602962  1612 raft_consensus.cc:1275] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:55.619205  1579 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, c445b7b7d94f48f99a3599ddfc92f462
I20260709 13:00:55.622598  7269 raft_consensus.cc:2749] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:55.634068  7174 consensus_queue.cc:1048] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:55.646510  2276 leader_election.cc:304] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:55.648522  7306 raft_consensus.cc:2804] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:55.649107  7306 raft_consensus.cc:697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:55.650058  7306 consensus_queue.cc:237] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:55.664444  7327 consensus_queue.cc:1048] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:55.680886  1612 raft_consensus.cc:1275] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:55.759794  1435 catalog_manager.cc:5697] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e reported cstate change: term changed from 10 to 11, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194). New cstate: current_term: 11 leader_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.761426  7278 consensus_queue.cc:1048] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:55.773300  1432 catalog_manager.cc:5697] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 13 to 14, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:55.799857  2310 raft_consensus.cc:1275] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:00:55.816838  7334 consensus_queue.cc:1048] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:55.823133  1614 raft_consensus.cc:1275] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:55.833376  7324 consensus_queue.cc:1048] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:55.895916  1688 raft_consensus.cc:1275] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:55.899641  7334 consensus_queue.cc:1048] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:55.933772  1582 consensus_peers.cc:597] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:55.982277  1582 consensus_peers.cc:597] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:56.078217  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.086295  1609 raft_consensus.cc:1275] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:00:56.108798  1582 consensus_peers.cc:597] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.103768  7302 consensus_queue.cc:1048] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:00:56.120172  7346 log.cc:927] Time spent T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 13:00:56.134505  1690 raft_consensus.cc:1275] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Refusing update from remote peer d3b488cf00f7497ea0bf5964b99f6e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:56.162300  7174 consensus_queue.cc:1048] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:56.224000  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:56.298250  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.309545  1656 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111) [suppressed 399 similar messages]
W20260709 13:00:56.317340  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.367529   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1562)
W20260709 13:00:56.472172  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 68874us
W20260709 13:00:56.475648  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.537706  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.541917  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.606626  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.607194  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.607620  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.631260  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.652910  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.681314  1582 consensus_peers.cc:597] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.681880  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.696796  1582 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.729329  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.731426  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.740949  1582 consensus_peers.cc:597] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.765931  1582 consensus_peers.cc:597] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.798832  1582 consensus_peers.cc:597] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.812176  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.830847  1582 consensus_peers.cc:597] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.831629  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.844830  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.901684  1582 consensus_peers.cc:597] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.933235  1582 consensus_peers.cc:597] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.951092  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:56.962327  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:57.033619  1582 consensus_peers.cc:597] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:57.067660  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:57.073040  1582 consensus_peers.cc:597] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:57.083314  1582 consensus_peers.cc:597] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:57.107754  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:57.131058  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.159054  7321 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.159657  7321 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:57.163136  7321 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:57.173578  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" is_pre_election: true
I20260709 13:00:57.174224  1609 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 13.
W20260709 13:00:57.176390  2276 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:57.177223  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
W20260709 13:00:57.178786  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.185253  7321 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.185784  7321 raft_consensus.cc:493] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.186168  7321 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.205641  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:57.244845  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.254801  7321 raft_consensus.cc:515] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:00:57.258862  7321 leader_election.cc:290] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Requested vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:00:57.262919  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3d048f5d2644a6b635da71cc6c7a8b" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e"
I20260709 13:00:57.263556  1609 raft_consensus.cc:3060] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.266844  1582 consensus_peers.cc:597] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:57.269594  2276 leader_election.cc:336] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:00:57.270686  1609 raft_consensus.cc:2468] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 14.
I20260709 13:00:57.271538  2276 leader_election.cc:304] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462, d3b488cf00f7497ea0bf5964b99f6e0e; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9
I20260709 13:00:57.288666  7351 raft_consensus.cc:2804] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:57.289337  7351 raft_consensus.cc:697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Becoming Leader. State: Replica: c445b7b7d94f48f99a3599ddfc92f462, State: Running, Role: LEADER
I20260709 13:00:57.290302  7351 consensus_queue.cc:237] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:00:57.312000  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:57.352084  1434 catalog_manager.cc:5697] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 reported cstate change: term changed from 12 to 14, leader changed from 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193) to c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "c445b7b7d94f48f99a3599ddfc92f462" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:57.368075   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1562)
W20260709 13:00:57.390223  1582 consensus_peers.cc:597] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:57.414109  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:57.710508  1614 raft_consensus.cc:1275] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Refusing update from remote peer c445b7b7d94f48f99a3599ddfc92f462: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:57.715824  7302 consensus_queue.cc:1048] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:00:57.815111  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:57.906342  1582 consensus_peers.cc:597] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.125097  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.137981  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.342072  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.368590   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1562)
W20260709 13:00:58.430145  1582 consensus_peers.cc:597] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.434381  1582 consensus_peers.cc:597] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.670063  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.701728  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:58.736943  1582 consensus_peers.cc:597] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.870409  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 55405us
W20260709 13:00:58.880704  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:58.926568  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:58.935295  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:58.981163  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.089862  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.093542  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.130441  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.141009  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.141495  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.200078  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.244475  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.369148   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1562)
W20260709 13:00:59.377417  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 84465.2us
W20260709 13:00:59.402359  1582 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.422547  2276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 44450.4us
W20260709 13:00:59.425369  2275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43205, user_credentials={real_user=slave}} blocked reactor thread for 46380us
W20260709 13:00:59.430238  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.439260  1582 consensus_peers.cc:597] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.447490  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33617, user_credentials={real_user=slave}} blocked reactor thread for 63683.7us
W20260709 13:00:59.448710  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.440058  1582 consensus_peers.cc:597] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.464720  1582 consensus_peers.cc:597] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.476914  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.477728  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.519821  1582 consensus_peers.cc:597] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.523417  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.539129  1582 consensus_peers.cc:597] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.556382  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.567660  1582 consensus_peers.cc:597] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.606154  1582 consensus_peers.cc:597] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.623414  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.629864  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.636945  1582 consensus_peers.cc:597] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.662142  1582 consensus_peers.cc:597] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.669013  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.675562  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.697892  1582 consensus_peers.cc:597] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.706117  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.730786  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.735417  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:00:59.744454  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.755054  1582 consensus_peers.cc:597] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:00.012104  1582 consensus_peers.cc:597] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:00.373952   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1562)
W20260709 13:01:00.428791  1582 consensus_peers.cc:597] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:00.561532  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:00.650348  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:00.764490  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:00.782541  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.109592  1582 consensus_peers.cc:597] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.168252  1582 consensus_peers.cc:597] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.209610  1582 consensus_peers.cc:597] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.245432  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.309509  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.311645  1582 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111) [suppressed 468 similar messages]
W20260709 13:01:01.319308  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.374507   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1562)
W20260709 13:01:01.479426  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.525090  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.550817  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:01.561064  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.608202  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.608750  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.673285  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.713100  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:01.779572  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.789971  1582 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.792431  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.854657  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.875777  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.899101  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.902762  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.932518  1582 consensus_peers.cc:597] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:01.935869  1582 consensus_peers.cc:597] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.026048  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.032394  1582 consensus_peers.cc:597] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.033007  1582 consensus_peers.cc:597] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.081795  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.109706  1582 consensus_peers.cc:597] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.110288  1582 consensus_peers.cc:597] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.153438  1582 consensus_peers.cc:597] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.153997  1582 consensus_peers.cc:597] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.166414  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.169896  1582 consensus_peers.cc:597] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.185340  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.198179  1582 consensus_peers.cc:597] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.199411  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.235847  1582 consensus_peers.cc:597] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.238672  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.245285  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.245463  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.350075  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.375176   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1562)
W20260709 13:01:02.401805  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.552783  1582 consensus_peers.cc:597] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:02.828896  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:02.937282  1582 consensus_peers.cc:597] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.156945  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.283375  1582 consensus_peers.cc:597] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.348869  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.375842   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1562)
W20260709 13:01:03.404452  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.507434  1582 consensus_peers.cc:597] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.547425  1582 consensus_peers.cc:597] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.611403  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:03.613423  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:03.659264  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:03.890674  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:03.895455  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:04.081143  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.137737  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.161962  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.178253  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.204448  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.280355  1582 consensus_peers.cc:597] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.283241  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.303601  1582 consensus_peers.cc:597] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.309798  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.328461  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.364917  1582 consensus_peers.cc:597] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.371732  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.374446  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.379840  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.380138   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1562)
W20260709 13:01:04.411139  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.461555  1582 consensus_peers.cc:597] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.480808  1582 consensus_peers.cc:597] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.495124  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.498904  1582 consensus_peers.cc:597] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.509701  1582 consensus_peers.cc:597] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.572985  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.595701  1582 consensus_peers.cc:597] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.661664  1582 consensus_peers.cc:597] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.664201  1582 consensus_peers.cc:597] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.665361  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.669870  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.700973  1582 consensus_peers.cc:597] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.747407  1582 consensus_peers.cc:597] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.773681  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.802465  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.874898  1582 consensus_peers.cc:597] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.877990  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:04.930922  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08002da800 after lost signal to thread 434
W20260709 13:01:04.932116  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800034800 after lost signal to thread 1473
W20260709 13:01:04.933589  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800034a20 after lost signal to thread 1640
W20260709 13:01:04.934824  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080003c660 after lost signal to thread 1714
W20260709 13:01:04.936101  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800409d00 after lost signal to thread 2334
W20260709 13:01:04.946414  1582 consensus_peers.cc:597] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.948690  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.385521  1582 consensus_peers.cc:597] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.429931  1582 consensus_peers.cc:597] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:05.444868  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:05.654516  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.733072  1582 consensus_peers.cc:597] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.799578  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.908468  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:06.010728   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:06.031173  1582 consensus_peers.cc:597] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.105772  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.222078  1582 consensus_peers.cc:597] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.223373  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.233520   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:06.255436  2276 consensus_peers.cc:597] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.283121  1582 consensus_peers.cc:597] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.286089  2276 consensus_peers.cc:597] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.287949  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.292086  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.292852  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.291320  2276 consensus_peers.cc:597] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.294355  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.312415  1582 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111) [suppressed 482 similar messages]
W20260709 13:01:06.312980  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.322022  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.349999  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.368789  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.371266  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.383157  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.386072  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.410051  2276 consensus_peers.cc:597] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.438620  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.439203  2276 consensus_peers.cc:597] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.443938  2276 consensus_peers.cc:597] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.451757   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:06.460454  2276 consensus_peers.cc:597] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.461769   431 tablet_replica.cc:333] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.462994   431 raft_consensus.cc:2243] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.473855   431 raft_consensus.cc:2272] T 1bea0da863664ef78c27cd81d07e53d9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.477604   431 tablet_replica.cc:333] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.479530   431 raft_consensus.cc:2243] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.487880   431 raft_consensus.cc:2272] T 8ab255080f74412f87943c46e12f9f06 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.493424   431 tablet_replica.cc:333] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.494469   431 raft_consensus.cc:2243] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.495783   431 raft_consensus.cc:2272] T ef7b3cac6dd7435096e3efbed87d6eda P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.499003   431 tablet_replica.cc:333] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.500080   431 raft_consensus.cc:2243] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.501544   431 raft_consensus.cc:2272] T 79180ee33a124de7a839155b4a30086e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.506907   431 tablet_replica.cc:333] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.507869   431 raft_consensus.cc:2243] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:06.508319  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.516115   431 raft_consensus.cc:2272] T ea39a99a63554d4dbb26f49a38585b4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.522043   431 tablet_replica.cc:333] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
W20260709 13:01:06.522975  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.522969   431 raft_consensus.cc:2243] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.536525   431 raft_consensus.cc:2272] T 9059b4be41c340278068c13696d1000e P d3b488cf00f7497ea0bf5964b99f6e0e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.545341   431 tablet_replica.cc:333] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.546645   431 raft_consensus.cc:2243] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.547420   431 raft_consensus.cc:2272] T b36f171d98ea4aedbd87b5f98c2c0127 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.556339  1582 consensus_peers.cc:597] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.556986  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.565582   431 tablet_replica.cc:333] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.566498   431 raft_consensus.cc:2243] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.567145   431 raft_consensus.cc:2272] T 7fb908b69c2e4ea19d87384e95f694ce P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.570053   431 tablet_replica.cc:333] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.570818   431 raft_consensus.cc:2243] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.571609   431 raft_consensus.cc:2272] T 6b3d048f5d2644a6b635da71cc6c7a8b P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.580829  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:06.598778  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.599670  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.601679   431 tablet_replica.cc:333] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
W20260709 13:01:06.602988  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.613729   431 raft_consensus.cc:2243] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.615346   431 raft_consensus.cc:2272] T ef459e67de67444fad0fff119d7885c0 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.620287   431 tablet_replica.cc:333] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.625146   431 raft_consensus.cc:2243] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:01:06.626649  1656 consensus_peers.cc:597] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.631832   431 raft_consensus.cc:2272] T d1a3569684e442e0a362c5e9412961ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.634593   431 tablet_replica.cc:333] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
W20260709 13:01:06.637068  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.652041  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.656497  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.660054   431 raft_consensus.cc:2243] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.661203   431 raft_consensus.cc:2272] T 2f362fd54b48400ba3c9fb8b8a405a93 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.662724  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.664077   431 tablet_replica.cc:333] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.664914   431 raft_consensus.cc:2243] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:01:06.670344  2276 consensus_peers.cc:597] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.681502   431 raft_consensus.cc:2272] T c877c15208b54931ba86acd6c47658c2 P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.704406   431 tablet_replica.cc:333] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.705375   431 raft_consensus.cc:2243] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.706553   431 raft_consensus.cc:2272] T 048bebee007041bf8db6f1bdbcf60a16 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.713306   431 tablet_replica.cc:333] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
W20260709 13:01:06.720103  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.721408   431 raft_consensus.cc:2243] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.728094   431 raft_consensus.cc:2272] T f4058bbcb74442ac872f33138d7075c8 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.736752   431 tablet_replica.cc:333] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.744894   431 raft_consensus.cc:2243] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.751473   431 raft_consensus.cc:2272] T 312ab9d000ac4b1c82c590d2ea787c2d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.754243  2276 consensus_peers.cc:597] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:06.759027  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.754488   431 tablet_replica.cc:333] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.762032   431 raft_consensus.cc:2243] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.769382   431 raft_consensus.cc:2272] T 1246638ecc3b4bf59847dec07f61fd3d P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.788520  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.796970   431 tablet_replica.cc:333] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.797878   431 raft_consensus.cc:2243] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.798568   431 raft_consensus.cc:2272] T f5f65122cec34901839f22a448343dca P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.806696   431 tablet_replica.cc:333] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.807983   431 raft_consensus.cc:2243] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.809231   431 raft_consensus.cc:2272] T f7d180faf3bc4436ad4c3b4b4805e7b9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.811939   431 tablet_replica.cc:333] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.812752   431 raft_consensus.cc:2243] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.813870   431 raft_consensus.cc:2272] T a0a666caa35f4005a9f1bd6c9797300c P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.814749  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.816828   431 tablet_replica.cc:333] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.817785   431 raft_consensus.cc:2243] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.819006   431 raft_consensus.cc:2272] T 32066347a26c4c6a94cbe8e9b624cb23 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.822024   431 tablet_replica.cc:333] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.822882   431 raft_consensus.cc:2243] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.823644   431 raft_consensus.cc:2272] T bb61d39ca56d420fbee59be16467e2ec P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.826306   431 tablet_replica.cc:333] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.832563   431 raft_consensus.cc:2243] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.833303   431 raft_consensus.cc:2272] T cf01b8ced3144c0289c4f428fc24ead7 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.836066   431 tablet_replica.cc:333] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.837905   431 raft_consensus.cc:2243] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.843919   431 raft_consensus.cc:2272] T 39ed37d8a3924f28925dbe22d17e11b3 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.850869  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.853972  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:06.864362   431 tablet_replica.cc:333] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.865293   431 raft_consensus.cc:2243] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.865872   431 raft_consensus.cc:2272] T 96265149c6c844b48c46f6df62cc9162 P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.868471   431 tablet_replica.cc:333] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.869216   431 raft_consensus.cc:2243] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.870003   431 raft_consensus.cc:2272] T 4588cb2170964d9888521712ee881700 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.873376   431 tablet_replica.cc:333] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.884045   431 raft_consensus.cc:2243] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.885284   431 raft_consensus.cc:2272] T 0d2479e7644f4a63a2e17a1e8ba94dcc P d3b488cf00f7497ea0bf5964b99f6e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.894273   431 tablet_replica.cc:333] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.895176   431 raft_consensus.cc:2243] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.896517   431 raft_consensus.cc:2272] T f94c71168cb04e9eaa1fdc0b7a131d9c P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.899323   431 tablet_replica.cc:333] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.900215   431 raft_consensus.cc:2243] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.900983   431 raft_consensus.cc:2272] T bdbc1ad76ba949aba54340f33a210d0d P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.903930   431 tablet_replica.cc:333] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.905350   431 raft_consensus.cc:2243] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.906085   431 raft_consensus.cc:2272] T 3306db491bf34b228d1100fd9c826528 P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.908854   431 tablet_replica.cc:333] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.909714   431 raft_consensus.cc:2243] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.910441   431 raft_consensus.cc:2272] T 07fbe913c7484df18b86408c13eabaad P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.913446   431 tablet_replica.cc:333] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.915972   431 raft_consensus.cc:2243] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.917770   431 raft_consensus.cc:2272] T 33d9e592d41d477fb881a9c29cc45de1 P d3b488cf00f7497ea0bf5964b99f6e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.920622   431 tablet_replica.cc:333] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.923964   431 raft_consensus.cc:2243] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.925285   431 raft_consensus.cc:2272] T 4ea53f766b5a4fd081983e46c7fd5da9 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.928012   431 tablet_replica.cc:333] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.928911   431 raft_consensus.cc:2243] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.929549   431 raft_consensus.cc:2272] T ff79ac342d91424db634ca7802846535 P d3b488cf00f7497ea0bf5964b99f6e0e [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.940135  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:06.942855   431 tablet_replica.cc:333] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.944386   431 raft_consensus.cc:2243] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.945329   431 raft_consensus.cc:2272] T 25da6efa74464e65b8319c8230d379fc P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.967916   431 tablet_replica.cc:333] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.969285   431 raft_consensus.cc:2243] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.970386   431 raft_consensus.cc:2272] T 08d3893a9300428592d3ce769b91a4db P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.973202   431 tablet_replica.cc:333] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.974246   431 raft_consensus.cc:2243] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.974967   431 raft_consensus.cc:2272] T fc3f11a4a382403ca1e1f14d5fd731db P d3b488cf00f7497ea0bf5964b99f6e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.977928   431 tablet_replica.cc:333] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.978794   431 raft_consensus.cc:2243] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.979478   431 raft_consensus.cc:2272] T 2f4ac1b152f343b3b3d211b9061e8c4e P d3b488cf00f7497ea0bf5964b99f6e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.983665   431 tablet_replica.cc:333] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.984458   431 raft_consensus.cc:2243] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.987627   431 raft_consensus.cc:2272] T faff66e63c5547ae8e8132a1465a5a30 P d3b488cf00f7497ea0bf5964b99f6e0e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.991171   431 tablet_replica.cc:333] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:06.992000   431 raft_consensus.cc:2243] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.993629   431 raft_consensus.cc:2272] T 1bb16b93f1fe47b4be38ae591c62b564 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.004218   431 tablet_replica.cc:333] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.005147   431 raft_consensus.cc:2243] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:07.006341   431 raft_consensus.cc:2272] T fe01230b6e6e4a119346bdaa29d78b55 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.009272   431 tablet_replica.cc:333] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.010106   431 raft_consensus.cc:2243] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.010784   431 raft_consensus.cc:2272] T 113c4345626841658cc1c3aa19853e2a P d3b488cf00f7497ea0bf5964b99f6e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.014045   431 tablet_replica.cc:333] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.014995   431 raft_consensus.cc:2243] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:07.016315   431 raft_consensus.cc:2272] T f38b9a36dae0409c8200773ccf754d04 P d3b488cf00f7497ea0bf5964b99f6e0e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.018975   431 tablet_replica.cc:333] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.019788   431 raft_consensus.cc:2243] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.020639   431 raft_consensus.cc:2272] T 2ee88b04047243b6b9ee3653189f3969 P d3b488cf00f7497ea0bf5964b99f6e0e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.023566   431 tablet_replica.cc:333] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.024387   431 raft_consensus.cc:2243] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:07.025650   431 raft_consensus.cc:2272] T 018c063cc2cf4b4aa09be2b8d7067e61 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.029553   431 tablet_replica.cc:333] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.030313   431 raft_consensus.cc:2243] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.031040   431 raft_consensus.cc:2272] T 396314c408674415abb66b1625b8a308 P d3b488cf00f7497ea0bf5964b99f6e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.033676   431 tablet_replica.cc:333] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.034361   431 raft_consensus.cc:2243] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:07.035537   431 raft_consensus.cc:2272] T 1b3e95209267412dbc539c57519c1a37 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.038443   431 tablet_replica.cc:333] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.039191   431 raft_consensus.cc:2243] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.039954   431 raft_consensus.cc:2272] T 781a7e0898fc40c4a08fd46ca3bf5f17 P d3b488cf00f7497ea0bf5964b99f6e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.052629   431 tablet_replica.cc:333] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e: stopping tablet replica
I20260709 13:01:07.053459   431 raft_consensus.cc:2243] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.054215   431 raft_consensus.cc:2272] T 339ceb86dfa74bca9b98f5bc6947143e P d3b488cf00f7497ea0bf5964b99f6e0e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:07.070750  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:07.086144  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:07.150656  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:07.192657  1579 connection.cc:466] server connection from 127.0.0.1:46810 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46810 (request call id 3258) could send its response
W20260709 13:01:07.294832  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:07.302141  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:07.437681  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:07.500167  7387 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.500789  7387 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:07.504907  7387 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:07.536746  1656 leader_election.cc:336] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:07.538823  1656 leader_election.cc:336] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.539366  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:07.540271  7387 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:07.544435  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.627511  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:07.633525  7383 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.634064  7383 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:01:07.645298  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:07.652177  7383 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:07.663529  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.664297  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:07.665129  7383 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:07.766649  7396 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.767263  7396 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:07.769349  7396 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:07.779778  2276 leader_election.cc:336] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:07.780580  2276 leader_election.cc:336] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.781141  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:07.781944  7396 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:07.790041  7396 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.790618  7396 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:07.796130  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:01:07.803568  7396 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:01:07.812088  2276 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:07.812733  2276 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:07.813516  7396 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:07.814757  2276 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.825618  7398 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.826272  7398 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:07.829596  7398 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:07.831043  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
W20260709 13:01:07.853832  2276 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.856986  2276 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:07.864439  7396 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:07.880059  7396 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.880659  7396 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:07.884588  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:01:07.886365  7396 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:07.891465  7387 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.892024  7387 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:07.893961  7387 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:07.897003  7387 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.897915  7387 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:07.902859  7387 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:07.906314  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:01:07.907024  2310 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
W20260709 13:01:07.903352  1656 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:07.912257  1656 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.912708  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
W20260709 13:01:07.913537  2276 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:07.914083  7387 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:07.915059  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:07.914033  2276 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:07.917402  7396 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:07.919450  1656 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:07.932717  1656 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:07.921289  2276 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.933254  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:07.935186  7402 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:07.956533  7387 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.958163  7387 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:07.960322  7387 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:07.968658  1656 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:07.969399  1656 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:07.969844  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:07.970607  7387 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:07.986099  7390 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:07.986718  7390 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:07.989034  7390 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:07.997771  1656 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.000455  1656 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.000957  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.001643  7387 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.038902  7387 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.039449  7387 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.041508  7387 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.049458  1656 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.050143  1656 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.050575  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.052013  7390 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:08.052740  7390 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.053224  7390 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.055382  7390 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:08.059017  7387 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.061134  7387 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.063104  7387 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.063588  1656 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.066965  1656 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.067426  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.068169  7390 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:08.088533  1656 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.093436  1656 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.093966  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.094844  7387 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.095446  7387 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.095880  7387 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.097923  7387 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.108886  1656 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.109639  1656 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.110069  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.111069  7402 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:08.130481  7402 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.131112  7402 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:08.133702  7387 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.134268  7387 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:08.136127  7387 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:08.138537  2310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:01:08.138993  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:01:08.139158  2310 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 15.
I20260709 13:01:08.139664  2304 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:01:08.141316  1653 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 
I20260709 13:01:08.143344  7390 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:08.143725  7390 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.144106  7390 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:08.145251  1656 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:08.148633  7387 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.149262  7387 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:01:08.150643  1656 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:08.151412  1656 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.149976  7402 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:08.156626  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.157408  7402 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:08.151731  7387 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.170926  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.180984  1656 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:08.181613  7402 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.187425  7402 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:01:08.198141  1656 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.198668  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.200380  7387 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.200750  7403 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.201295  7403 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.203310  7403 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:08.208315  7402 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:08.209759  7390 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:08.217495  7396 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.218097  7396 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:01:08.219231  1656 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:08.219749  1656 leader_election.cc:336] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.220409  7396 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.222080  1656 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:08.222568  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.223281  7402 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:08.224331  1656 leader_election.cc:336] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:08.224761  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.225446  7402 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:08.228538   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1637)
W20260709 13:01:08.231560  2276 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:08.233397  2276 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:08.232687  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32066347a26c4c6a94cbe8e9b624cb23" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462"
I20260709 13:01:08.234609  2304 raft_consensus.cc:3060] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:08.239001  1656 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.250605  2304 raft_consensus.cc:2468] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:01:08.252122  1653 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.253082  7402 raft_consensus.cc:2804] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:08.253618  7402 raft_consensus.cc:697] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Becoming Leader. State: Replica: 631fb66c0070402b8f78fd74633dae6f, State: Running, Role: LEADER
I20260709 13:01:08.254474  7402 consensus_queue.cc:237] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:08.231680  7390 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 election: Requested vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:08.258703  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.259639  7396 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.277245  7403 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.277848  7403 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.280676  7387 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.281188  7387 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.283008  7387 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:08.283453  7387 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.279934  7403 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:08.283847  7387 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.286453  7387 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.289582  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:08.298792  1435 catalog_manager.cc:5697] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f reported cstate change: term changed from 15 to 16, leader changed from d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194) to 631fb66c0070402b8f78fd74633dae6f (127.0.107.195). New cstate: current_term: 16 leader_uuid: "631fb66c0070402b8f78fd74633dae6f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:08.305068  1656 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.305684  1656 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.306143  1656 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.306749  1656 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.307106  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.310474  7402 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:08.311527  1656 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.311934  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.312638  7402 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:08.313530  1656 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.313943  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.314656  7402 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:08.371810  7396 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.372393  7396 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:08.374601  7396 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.383426  2276 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:08.384404  2276 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:08.384800  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.385551  7396 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:08.400422  7402 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:08.401046  7402 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:08.403219  7402 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:08.413089  1656 leader_election.cc:336] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:08.413902  1656 leader_election.cc:336] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:08.414346  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:08.415521  7402 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:08.491632  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:08.551970  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:08.627701  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.628306  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.631808  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:08.640329  2304 raft_consensus.cc:1275] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Refusing update from remote peer 631fb66c0070402b8f78fd74633dae6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:08.642204  7402 consensus_queue.cc:1048] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:08.673067  2276 consensus_peers.cc:597] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.688517  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.719056  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.723500  1656 consensus_peers.cc:597] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:08.754637  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.758050  2276 consensus_peers.cc:597] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.782204  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:08.785955  2276 consensus_peers.cc:597] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.797654  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.825570  2276 consensus_peers.cc:597] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.832350  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.913564  2276 consensus_peers.cc:597] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.921314  2276 consensus_peers.cc:597] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:08.962708  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:08.965590  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.966398  2276 consensus_peers.cc:597] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.000036  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.034119  1656 consensus_peers.cc:597] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.037003  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.040185  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.097471  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.096855  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.098489  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.116554  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.154709  2276 consensus_peers.cc:597] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.156808  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.162739  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.175581  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.228962   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1637)
W20260709 13:01:09.259711  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.277160  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.277733  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.287920  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.346151  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.367646  2276 consensus_peers.cc:597] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:09.406440  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.422459  1656 consensus_peers.cc:597] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:09.440120  7415 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.440749  7415 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:09.442833  7415 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:09.450639  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.451202  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:09.454023  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.454631  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.464902  7409 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:09.506721  7402 raft_consensus.cc:493] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.507314  7402 raft_consensus.cc:515] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:09.509255  7402 leader_election.cc:290] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:09.550738  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.588743  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.589295  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.591658  1656 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:09.593498  1656 leader_election.cc:336] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:09.597131  1656 leader_election.cc:304] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.598137  7387 raft_consensus.cc:2749] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:09.598387  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.610743  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:09.676278  7416 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.676893  7416 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:01:09.689296  1656 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:09.703207  7415 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.703888  7415 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:09.706965  7415 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:09.709903  7409 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.726857  7409 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:09.729595  7409 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:09.721252  7416 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:09.722716  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:01:09.732750  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef459e67de67444fad0fff119d7885c0" candidate_uuid: "c445b7b7d94f48f99a3599ddfc92f462" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "631fb66c0070402b8f78fd74633dae6f" is_pre_election: true
I20260709 13:01:09.733058  2304 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:01:09.733377  1681 raft_consensus.cc:2468] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c445b7b7d94f48f99a3599ddfc92f462 in term 16.
I20260709 13:01:09.738164  7387 raft_consensus.cc:493] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.738821  7387 raft_consensus.cc:515] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:01:09.724021  2276 leader_election.cc:336] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:09.757133  2276 leader_election.cc:336] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.757694  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.760776  7409 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:09.815075  7387 leader_election.cc:290] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:09.827723  7417 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.828306  7417 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:09.830749  7417 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:09.846781  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:01:09.847446  2304 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
I20260709 13:01:09.849987  7417 raft_consensus.cc:493] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.850553  7417 raft_consensus.cc:515] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:09.852589  7417 leader_election.cc:290] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:09.871999  2276 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:09.873018  2276 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.877628  2276 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.878414  7415 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:09.879380  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:09.888955  1656 leader_election.cc:336] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:09.891153  1656 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.891613  1656 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.892478  7416 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:09.895478  1656 leader_election.cc:336] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.896003  1656 leader_election.cc:304] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.896771  7416 raft_consensus.cc:2749] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:09.902231  1656 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:09.904336  1656 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:09.905748  7416 raft_consensus.cc:493] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.906327  7416 raft_consensus.cc:515] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:09.908556  7416 leader_election.cc:290] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:09.904814  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.909637  7417 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:09.910122  1656 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:09.912616  7417 raft_consensus.cc:493] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:09.913053  7417 raft_consensus.cc:515] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:09.914861  7417 leader_election.cc:290] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:09.917680  1656 leader_election.cc:336] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.919221  1656 leader_election.cc:304] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.920043  7417 raft_consensus.cc:2749] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:09.923053  1656 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:09.930964  1656 leader_election.cc:336] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:09.931423  1656 leader_election.cc:304] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.932053  7417 raft_consensus.cc:2749] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:09.932257  1656 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:09.938735  1656 leader_election.cc:336] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:09.939136  1656 leader_election.cc:304] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:09.940719  7417 raft_consensus.cc:2749] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.052078  7416 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.052734  7416 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.054777  7416 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:10.055548  7417 raft_consensus.cc:493] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.056080  7417 raft_consensus.cc:515] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.058179  7417 leader_election.cc:290] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.064400  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:10.074829  1656 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.077253  7416 raft_consensus.cc:493] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.078578  7416 raft_consensus.cc:515] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.086719  7417 raft_consensus.cc:493] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.087472  7417 raft_consensus.cc:515] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.090844  7416 leader_election.cc:290] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:10.089700  7417 leader_election.cc:290] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.091909  1656 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:10.093645  1656 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:10.094134  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.096619  7417 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:10.097751  1656 leader_election.cc:336] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:10.098225  1656 leader_election.cc:304] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.099015  7417 raft_consensus.cc:2749] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.108557  7417 raft_consensus.cc:493] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.109156  7417 raft_consensus.cc:515] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.111249  7417 leader_election.cc:290] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.114481  1656 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.115170  1656 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.118501  1656 leader_election.cc:336] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.118990  1656 leader_election.cc:304] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.119858  7417 raft_consensus.cc:2749] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:10.121004  1656 leader_election.cc:336] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.121469  1656 leader_election.cc:304] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.122239  7417 raft_consensus.cc:2749] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.142796  7417 raft_consensus.cc:493] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.143371  7417 raft_consensus.cc:515] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.145798  7417 leader_election.cc:290] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.148772  1656 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.151679  7417 raft_consensus.cc:493] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.152175  7417 raft_consensus.cc:515] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.154410  7417 leader_election.cc:290] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.155103  1656 leader_election.cc:336] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:10.160075  1656 leader_election.cc:304] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.163245  7417 raft_consensus.cc:2749] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:10.179486  1656 leader_election.cc:336] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.180164  1656 leader_election.cc:336] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.182008  1656 leader_election.cc:336] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:10.189441  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:10.182497  1656 leader_election.cc:304] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.190863  7417 raft_consensus.cc:2749] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:10.191895  1656 leader_election.cc:336] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.192409  1656 leader_election.cc:304] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.193259  7417 raft_consensus.cc:2749] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:10.221347  7417 raft_consensus.cc:493] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.221920  7417 raft_consensus.cc:515] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.224090  7417 leader_election.cc:290] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.229581   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1637)
W20260709 13:01:10.240118  1656 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.241086  1656 leader_election.cc:336] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.241825  1656 leader_election.cc:304] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.242699  7417 raft_consensus.cc:2749] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:10.301285  7417 raft_consensus.cc:493] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.301972  7417 raft_consensus.cc:515] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
I20260709 13:01:10.315444  7417 leader_election.cc:290] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:10.373834  7409 raft_consensus.cc:493] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.374536  7409 raft_consensus.cc:515] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:10.377014  7409 leader_election.cc:290] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:10.394644  7409 raft_consensus.cc:493] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.395640  7409 raft_consensus.cc:515] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:10.401692  7409 leader_election.cc:290] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.411231  2276 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.421198  2276 leader_election.cc:336] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.422129  2276 leader_election.cc:304] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.423833  7409 raft_consensus.cc:2749] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:10.421633  1656 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.501385  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:10.503047  2276 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.504048  2276 leader_election.cc:336] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.504469  2276 leader_election.cc:304] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.505203  7409 raft_consensus.cc:2749] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:10.533298  7420 raft_consensus.cc:493] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.533946  7420 raft_consensus.cc:515] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:01:10.534768  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08001baca0 after lost signal to thread 434
W20260709 13:01:10.535943  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800316300 after lost signal to thread 1473
I20260709 13:01:10.536074  7420 leader_election.cc:290] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:10.537398  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080019eea0 after lost signal to thread 1714
W20260709 13:01:10.538556  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080035e700 after lost signal to thread 2334
W20260709 13:01:10.556766  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34321, user_credentials={real_user=slave}} blocked reactor thread for 131815us
W20260709 13:01:10.559939  1656 leader_election.cc:336] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.560493  1656 leader_election.cc:304] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.561331  7419 raft_consensus.cc:2749] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:10.624980  1656 consensus_peers.cc:597] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.625787  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.626355  1656 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:10.627987  1656 leader_election.cc:336] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:10.628603  1656 leader_election.cc:304] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:10.629326  7419 raft_consensus.cc:2749] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:10.659314  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.686161  1656 consensus_peers.cc:597] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:10.910384  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.957823  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:10.958599  1656 consensus_peers.cc:597] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:10.991222  7421 raft_consensus.cc:493] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:10.991896  7421 raft_consensus.cc:515] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:10.994074  7421 leader_election.cc:290] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:11.018518  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
W20260709 13:01:11.027452  2276 leader_election.cc:336] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:11.027999  2276 leader_election.cc:304] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:11.029350  7421 raft_consensus.cc:2749] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:11.062518  2276 consensus_peers.cc:597] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.099196  1656 consensus_peers.cc:597] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.106014  1656 consensus_peers.cc:597] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.150060  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.177330  2276 consensus_peers.cc:597] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.196166  1656 consensus_peers.cc:597] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.200663  2276 consensus_peers.cc:597] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.226883  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:11.253372  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.290470  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.304615  1656 consensus_peers.cc:597] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.315894  2276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111) [suppressed 659 similar messages]
W20260709 13:01:11.322461  2276 consensus_peers.cc:597] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.325448   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:11.350206  1656 consensus_peers.cc:597] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.437217  2276 consensus_peers.cc:597] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.453361  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.454586   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:11.458509  2276 consensus_peers.cc:597] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.464859  2276 consensus_peers.cc:597] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.487471  7416 raft_consensus.cc:493] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
W20260709 13:01:11.492700  2275 consensus_peers.cc:597] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.492990  7416 raft_consensus.cc:515] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:11.495606  7416 leader_election.cc:290] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), c445b7b7d94f48f99a3599ddfc92f462 (127.0.107.196:38377)
I20260709 13:01:11.498340  2304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d9e592d41d477fb881a9c29cc45de1" candidate_uuid: "631fb66c0070402b8f78fd74633dae6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c445b7b7d94f48f99a3599ddfc92f462" is_pre_election: true
I20260709 13:01:11.498973  2304 raft_consensus.cc:2468] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631fb66c0070402b8f78fd74633dae6f in term 16.
W20260709 13:01:11.516428  2331 debug-util.cc:398] Leaking SignalData structure 0x7b08003634c0 after lost signal to thread 434
W20260709 13:01:11.517522  2331 debug-util.cc:398] Leaking SignalData structure 0x7b0800363900 after lost signal to thread 1473
W20260709 13:01:11.508872  1656 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:11.518848  2331 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5980 after lost signal to thread 1714
W20260709 13:01:11.520404  2331 debug-util.cc:398] Leaking SignalData structure 0x7b08003569e0 after lost signal to thread 2334
W20260709 13:01:11.534919  1656 leader_election.cc:336] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:11.536381  1656 leader_election.cc:304] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f, c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:11.537170   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:11.537170  7416 raft_consensus.cc:2749] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:11.538677   431 tablet_replica.cc:333] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.539728   431 raft_consensus.cc:2243] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.540407   431 raft_consensus.cc:2272] T fe01230b6e6e4a119346bdaa29d78b55 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.543192   431 tablet_replica.cc:333] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.544075   431 raft_consensus.cc:2243] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:11.546662  2275 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.547215   431 raft_consensus.cc:2272] T 57b6d9fb4551488e978e5e62c1c59485 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.548360  1656 consensus_peers.cc:597] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:11.552757   431 tablet_replica.cc:333] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.553761   431 raft_consensus.cc:2243] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:01:11.555071  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.555143   431 raft_consensus.cc:2272] T 1bea0da863664ef78c27cd81d07e53d9 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.564540   431 tablet_replica.cc:333] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.569226  2275 consensus_peers.cc:597] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:11.578474  2275 consensus_peers.cc:597] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.580399   431 raft_consensus.cc:2243] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.583071   431 raft_consensus.cc:2272] T ef7b3cac6dd7435096e3efbed87d6eda P 631fb66c0070402b8f78fd74633dae6f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.586692   431 tablet_replica.cc:333] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.587829   431 raft_consensus.cc:2243] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.588995   431 raft_consensus.cc:2272] T 5a5f5933777f457e99f4a6b1781ec12b P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.591764   431 tablet_replica.cc:333] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.592700   431 raft_consensus.cc:2243] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.593458   431 raft_consensus.cc:2272] T ea39a99a63554d4dbb26f49a38585b4e P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.596318   431 tablet_replica.cc:333] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.597796   431 raft_consensus.cc:2243] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.599229   431 raft_consensus.cc:2272] T 7fb908b69c2e4ea19d87384e95f694ce P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.602101   431 tablet_replica.cc:333] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.602329  1656 consensus_peers.cc:597] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.603039   431 raft_consensus.cc:2243] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.604214   431 raft_consensus.cc:2272] T 31d2293f596d4cefaf1a169b3a79ba46 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.607223   431 tablet_replica.cc:333] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.608064   431 raft_consensus.cc:2243] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.608783   431 raft_consensus.cc:2272] T d1a3569684e442e0a362c5e9412961ec P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.611467   431 tablet_replica.cc:333] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.612010  1656 consensus_peers.cc:597] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.612403   431 raft_consensus.cc:2243] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.613022   431 raft_consensus.cc:2272] T c877c15208b54931ba86acd6c47658c2 P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.614650  1656 consensus_peers.cc:597] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.615693   431 tablet_replica.cc:333] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.616647   431 raft_consensus.cc:2243] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.623958   431 raft_consensus.cc:2272] T 2f362fd54b48400ba3c9fb8b8a405a93 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.627478   431 tablet_replica.cc:333] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.628461   431 raft_consensus.cc:2243] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.629276   431 raft_consensus.cc:2272] T 9059b4be41c340278068c13696d1000e P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.634557   431 tablet_replica.cc:333] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.639616  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.640334   431 raft_consensus.cc:2243] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.641007   431 raft_consensus.cc:2272] T b36f171d98ea4aedbd87b5f98c2c0127 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.642177  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.644047   431 tablet_replica.cc:333] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.644994   431 raft_consensus.cc:2243] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.645761   431 raft_consensus.cc:2272] T 312ab9d000ac4b1c82c590d2ea787c2d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.648655   431 tablet_replica.cc:333] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.649498   431 raft_consensus.cc:2243] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.650199   431 raft_consensus.cc:2272] T f4058bbcb74442ac872f33138d7075c8 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.652992   431 tablet_replica.cc:333] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.653904   431 raft_consensus.cc:2243] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.654587   431 raft_consensus.cc:2272] T 1246638ecc3b4bf59847dec07f61fd3d P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.657178   431 tablet_replica.cc:333] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.660135   431 raft_consensus.cc:2243] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.667528   431 raft_consensus.cc:2272] T 96265149c6c844b48c46f6df62cc9162 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.670936   431 tablet_replica.cc:333] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.671984   431 raft_consensus.cc:2243] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:11.677824  2276 consensus_peers.cc:597] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.679427   431 raft_consensus.cc:2272] T c43a3d11aec04f86a107e64e2a5bc263 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.683223   431 tablet_replica.cc:333] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.685344   431 raft_consensus.cc:2243] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.686250   431 raft_consensus.cc:2272] T 048bebee007041bf8db6f1bdbcf60a16 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.688813  1656 consensus_peers.cc:597] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.690712   431 tablet_replica.cc:333] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.691821   431 raft_consensus.cc:2243] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.692771   431 raft_consensus.cc:2272] T f5f65122cec34901839f22a448343dca P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.715018   431 tablet_replica.cc:333] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.718120  1656 consensus_peers.cc:597] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.720106  2275 consensus_peers.cc:597] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.715914   431 raft_consensus.cc:2243] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.721355   431 raft_consensus.cc:2272] T f7d180faf3bc4436ad4c3b4b4805e7b9 P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.722186  1656 consensus_peers.cc:597] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:11.724117   431 tablet_replica.cc:333] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.724434  1656 consensus_peers.cc:597] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:11.725343   431 raft_consensus.cc:2243] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.726289   431 raft_consensus.cc:2272] T a0a666caa35f4005a9f1bd6c9797300c P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.734637   431 tablet_replica.cc:333] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.735432   431 raft_consensus.cc:2243] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.737110   431 raft_consensus.cc:2272] T 25da6efa74464e65b8319c8230d379fc P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.738462  1656 consensus_peers.cc:597] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.745956  2276 consensus_peers.cc:597] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:11.747885  1656 consensus_peers.cc:597] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.750674  2276 consensus_peers.cc:597] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.752602   431 tablet_replica.cc:333] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.764029  2275 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:11.766196  2276 consensus_peers.cc:597] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:11.767483   431 raft_consensus.cc:2243] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.769322   431 raft_consensus.cc:2272] T 8bbf1e27410e4984b453b68cb9b08bd6 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.772099   431 tablet_replica.cc:333] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.772907   431 raft_consensus.cc:2243] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.773473   431 raft_consensus.cc:2272] T 08d3893a9300428592d3ce769b91a4db P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.776149   431 tablet_replica.cc:333] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.777007   431 raft_consensus.cc:2243] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.777989   431 raft_consensus.cc:2272] T ef459e67de67444fad0fff119d7885c0 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.784822  2275 consensus_peers.cc:597] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.785701   431 tablet_replica.cc:333] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.793146   431 raft_consensus.cc:2243] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.802379   431 raft_consensus.cc:2272] T fc3f11a4a382403ca1e1f14d5fd731db P 631fb66c0070402b8f78fd74633dae6f [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.799433  2275 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.805294   431 tablet_replica.cc:333] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.806087   431 raft_consensus.cc:2243] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.807178   431 raft_consensus.cc:2272] T 32066347a26c4c6a94cbe8e9b624cb23 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.810374   431 tablet_replica.cc:333] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.811115   431 raft_consensus.cc:2243] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.811668   431 raft_consensus.cc:2272] T bb61d39ca56d420fbee59be16467e2ec P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.814190   431 tablet_replica.cc:333] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.814952   431 raft_consensus.cc:2243] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.816102   431 raft_consensus.cc:2272] T cf01b8ced3144c0289c4f428fc24ead7 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.818686   431 tablet_replica.cc:333] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.819626   431 raft_consensus.cc:2243] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:01:11.816329  2275 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.820712   431 raft_consensus.cc:2272] T 39ed37d8a3924f28925dbe22d17e11b3 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.822103  2276 consensus_peers.cc:597] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:11.822628  2275 consensus_peers.cc:597] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.823959   431 tablet_replica.cc:333] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.824432  1656 consensus_peers.cc:597] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.824875   431 raft_consensus.cc:2243] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.825680   431 raft_consensus.cc:2272] T 4ea53f766b5a4fd081983e46c7fd5da9 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.828284   431 tablet_replica.cc:333] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.829030   431 raft_consensus.cc:2243] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.829881   431 raft_consensus.cc:2272] T ff79ac342d91424db634ca7802846535 P 631fb66c0070402b8f78fd74633dae6f [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.832607   431 tablet_replica.cc:333] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.833341   431 raft_consensus.cc:2243] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.834406   431 raft_consensus.cc:2272] T a95518ca56c246da9d064efb1f0fb391 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.836971   431 tablet_replica.cc:333] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.837725   431 raft_consensus.cc:2243] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.838274   431 raft_consensus.cc:2272] T bdbc1ad76ba949aba54340f33a210d0d P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.840894   431 tablet_replica.cc:333] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.841578   431 raft_consensus.cc:2243] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.842712   431 raft_consensus.cc:2272] T 3306db491bf34b228d1100fd9c826528 P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.845968   431 tablet_replica.cc:333] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.846657   431 raft_consensus.cc:2243] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.847730   431 raft_consensus.cc:2272] T 07fbe913c7484df18b86408c13eabaad P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.850410   431 tablet_replica.cc:333] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.851198   431 raft_consensus.cc:2243] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.851765   431 raft_consensus.cc:2272] T 710eea1b85d441dcabbb12e33e31ae6b P 631fb66c0070402b8f78fd74633dae6f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.854241   431 tablet_replica.cc:333] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.854914   431 raft_consensus.cc:2243] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.855815   431 raft_consensus.cc:2272] T 2f4ac1b152f343b3b3d211b9061e8c4e P 631fb66c0070402b8f78fd74633dae6f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.858825  2275 consensus_peers.cc:597] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:11.859505  2275 consensus_peers.cc:597] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.897619   431 tablet_replica.cc:333] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.901827   431 raft_consensus.cc:2243] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.904098  7423 raft_consensus.cc:493] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:11.905534   431 raft_consensus.cc:2272] T faff66e63c5547ae8e8132a1465a5a30 P 631fb66c0070402b8f78fd74633dae6f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.905238  7423 raft_consensus.cc:515] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } }
W20260709 13:01:11.914645  2275 consensus_peers.cc:597] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Couldn't send request to peer 631fb66c0070402b8f78fd74633dae6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.916463  7415 raft_consensus.cc:493] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:11.916766   431 tablet_replica.cc:333] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.919099   431 raft_consensus.cc:2243] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:01:11.921077  1656 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:11.922438   431 raft_consensus.cc:2272] T 04fd8c1bd97c403fbac13cb4d6f34e1c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:11.922837  2276 consensus_peers.cc:597] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 -> Peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Couldn't send request to peer d3b488cf00f7497ea0bf5964b99f6e0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:11.917424  7415 raft_consensus.cc:515] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:11.922896  7423 leader_election.cc:290] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:11.926833   431 tablet_replica.cc:333] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.927836  1656 leader_election.cc:336] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:11.928980  1656 leader_election.cc:304] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631fb66c0070402b8f78fd74633dae6f; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:11.929219  7415 leader_election.cc:290] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
I20260709 13:01:11.929780  7423 raft_consensus.cc:2749] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.930778   431 raft_consensus.cc:2243] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.933525   431 raft_consensus.cc:2272] T 339ceb86dfa74bca9b98f5bc6947143e P 631fb66c0070402b8f78fd74633dae6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.937351   431 tablet_replica.cc:333] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
W20260709 13:01:11.938275  2276 leader_election.cc:336] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:11.938351   431 raft_consensus.cc:2243] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:01:11.939575  2276 leader_election.cc:336] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:11.940032  2276 leader_election.cc:304] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:11.941010  7415 raft_consensus.cc:2749] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.941684   431 raft_consensus.cc:2272] T 65a88b4c57e043e39d00e6e3f02b64fe P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.944825   431 tablet_replica.cc:333] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.945597   431 raft_consensus.cc:2243] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.947395   431 raft_consensus.cc:2272] T 33d9e592d41d477fb881a9c29cc45de1 P 631fb66c0070402b8f78fd74633dae6f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.950600   431 tablet_replica.cc:333] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.951211   431 raft_consensus.cc:2243] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.952467   431 raft_consensus.cc:2272] T 1b3e95209267412dbc539c57519c1a37 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.955260   431 tablet_replica.cc:333] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.955986   431 raft_consensus.cc:2243] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:11.958248   431 raft_consensus.cc:2272] T 396314c408674415abb66b1625b8a308 P 631fb66c0070402b8f78fd74633dae6f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.962199   431 tablet_replica.cc:333] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.962806   431 raft_consensus.cc:2243] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.964056   431 raft_consensus.cc:2272] T f38b9a36dae0409c8200773ccf754d04 P 631fb66c0070402b8f78fd74633dae6f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.967593   431 tablet_replica.cc:333] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.968609   431 raft_consensus.cc:2243] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.969524   431 raft_consensus.cc:2272] T 3f37c8720262488fbc2c2923a7e60e16 P 631fb66c0070402b8f78fd74633dae6f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.981554   431 tablet_replica.cc:333] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.982410   431 raft_consensus.cc:2243] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.983352   431 raft_consensus.cc:2272] T 018c063cc2cf4b4aa09be2b8d7067e61 P 631fb66c0070402b8f78fd74633dae6f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:11.987317   431 tablet_replica.cc:333] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f: stopping tablet replica
I20260709 13:01:11.988201   431 raft_consensus.cc:2243] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:11.989512   431 raft_consensus.cc:2272] T f94c71168cb04e9eaa1fdc0b7a131d9c P 631fb66c0070402b8f78fd74633dae6f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:12.274317  2276 consensus_peers.cc:597] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:12.548776  2276 consensus_peers.cc:597] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:12.566210  2276 consensus_peers.cc:597] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:12.806393  2276 consensus_peers.cc:597] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:12.814540  7415 raft_consensus.cc:493] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:12.815506  7415 raft_consensus.cc:515] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:12.818252  7415 leader_election.cc:290] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:01:12.825294  2275 leader_election.cc:336] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:12.829813  2276 leader_election.cc:336] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:12.830415  2276 leader_election.cc:304] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:12.831187  7415 raft_consensus.cc:2749] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:12.914740  7426 raft_consensus.cc:493] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:12.915454  7426 raft_consensus.cc:515] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:12.917691  7426 leader_election.cc:290] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:01:12.924057  2275 leader_election.cc:336] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
I20260709 13:01:12.927482  7426 raft_consensus.cc:493] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d3b488cf00f7497ea0bf5964b99f6e0e)
I20260709 13:01:12.928351  7426 raft_consensus.cc:515] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:12.931320  7415 raft_consensus.cc:493] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:12.931988  7415 raft_consensus.cc:515] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:12.934067  7415 leader_election.cc:290] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:12.934736  7426 leader_election.cc:290] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:01:12.948194  2276 leader_election.cc:336] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:12.948992  2276 leader_election.cc:304] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:12.950258  7426 raft_consensus.cc:2749] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:12.949546  2275 leader_election.cc:336] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:12.953703  2275 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:12.957257  2276 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:12.957729  2276 leader_election.cc:304] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:12.958777  7426 raft_consensus.cc:2749] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:12.959540  2276 leader_election.cc:336] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:12.959967  2276 leader_election.cc:304] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:12.960781  7426 raft_consensus.cc:2749] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.982240  7426 raft_consensus.cc:493] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:12.983033  7426 raft_consensus.cc:515] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:12.985435  7426 leader_election.cc:290] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:12.988005   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:13.002377  2275 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:13.008623  2276 leader_election.cc:336] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
W20260709 13:01:13.012952  2276 leader_election.cc:336] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:13.013543  2276 leader_election.cc:304] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:13.014384  7426 raft_consensus.cc:2749] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:13.017894  7426 raft_consensus.cc:493] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:13.018464  7426 raft_consensus.cc:515] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
W20260709 13:01:13.026157  2275 leader_election.cc:336] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
I20260709 13:01:13.027009  7426 leader_election.cc:290] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:01:13.032574  2276 leader_election.cc:336] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:13.033131  2276 leader_election.cc:304] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:13.033955  7426 raft_consensus.cc:2749] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.075373  7426 raft_consensus.cc:493] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:13.076210  7426 raft_consensus.cc:515] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:13.079756  7426 leader_election.cc:290] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
W20260709 13:01:13.086429  2275 leader_election.cc:336] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:13.111167  2276 leader_election.cc:336] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:13.111785  2276 leader_election.cc:304] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:13.112674  7426 raft_consensus.cc:2749] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.154872   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:01:13.161166  7429 raft_consensus.cc:493] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:13.162014  7429 raft_consensus.cc:515] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } attrs { replace: true } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:13.164974  7429 leader_election.cc:290] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205), d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617)
W20260709 13:01:13.171432  2275 leader_election.cc:336] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:13.175208  2276 leader_election.cc:336] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:13.175738  2276 leader_election.cc:304] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:13.176553  7415 raft_consensus.cc:2749] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:13.180662  2276 leader_election.cc:336] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:13.204094   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:13.205231   431 tablet_replica.cc:333] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.206204   431 raft_consensus.cc:2243] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.206812   431 raft_consensus.cc:2272] T 32066347a26c4c6a94cbe8e9b624cb23 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.211046   431 tablet_replica.cc:333] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.211733   431 raft_consensus.cc:2243] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.212884   431 raft_consensus.cc:2272] T 2f362fd54b48400ba3c9fb8b8a405a93 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.216205   431 tablet_replica.cc:333] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.217180   431 raft_consensus.cc:2243] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.218432   431 raft_consensus.cc:2272] T ff79ac342d91424db634ca7802846535 P c445b7b7d94f48f99a3599ddfc92f462 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.221794   431 tablet_replica.cc:333] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.222630   431 raft_consensus.cc:2243] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.223974   431 raft_consensus.cc:2272] T 5a5f5933777f457e99f4a6b1781ec12b P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.226673   431 tablet_replica.cc:333] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.227502   431 raft_consensus.cc:2243] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.228103   431 raft_consensus.cc:2272] T 1bb16b93f1fe47b4be38ae591c62b564 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.230396   431 tablet_replica.cc:333] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.231019   431 raft_consensus.cc:2243] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.231844   431 raft_consensus.cc:2272] T 0d2479e7644f4a63a2e17a1e8ba94dcc P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.235349   431 tablet_replica.cc:333] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.236130   431 raft_consensus.cc:2243] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.237398   431 raft_consensus.cc:2272] T 57b6d9fb4551488e978e5e62c1c59485 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.239740   431 tablet_replica.cc:333] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.240404   431 raft_consensus.cc:2243] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.241331   431 raft_consensus.cc:2272] T 3f37c8720262488fbc2c2923a7e60e16 P c445b7b7d94f48f99a3599ddfc92f462 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.243616   431 tablet_replica.cc:333] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.244294   431 raft_consensus.cc:2243] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.244966   431 raft_consensus.cc:2272] T 04fd8c1bd97c403fbac13cb4d6f34e1c P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.247057   431 tablet_replica.cc:333] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.247704   431 raft_consensus.cc:2243] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.249013   431 raft_consensus.cc:2272] T 781a7e0898fc40c4a08fd46ca3bf5f17 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.251408   431 tablet_replica.cc:333] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.252014   431 raft_consensus.cc:2243] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.252930   431 raft_consensus.cc:2272] T c43a3d11aec04f86a107e64e2a5bc263 P c445b7b7d94f48f99a3599ddfc92f462 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.255595   431 tablet_replica.cc:333] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.256268   431 raft_consensus.cc:2243] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.256575  7415 raft_consensus.cc:493] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:13.257475   431 raft_consensus.cc:2272] T 08d3893a9300428592d3ce769b91a4db P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.257172  7415 raft_consensus.cc:515] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d3b488cf00f7497ea0bf5964b99f6e0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33617 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:13.260609   431 tablet_replica.cc:333] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.261456   431 raft_consensus.cc:2243] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.263013   431 raft_consensus.cc:2272] T 6b3d048f5d2644a6b635da71cc6c7a8b P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.264415  2275 leader_election.cc:336] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
W20260709 13:01:13.264657  2276 consensus_peers.cc:597] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 -> Peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Couldn't send request to peer 0f82bbd9193f4b71a0c17a0357cf0ce9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:13.264148  7415 leader_election.cc:290] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:13.266047   431 tablet_replica.cc:333] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.266860   431 raft_consensus.cc:2243] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.267714   431 raft_consensus.cc:2272] T 8ab255080f74412f87943c46e12f9f06 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.268303  2276 leader_election.cc:336] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d3b488cf00f7497ea0bf5964b99f6e0e (127.0.107.194:33617): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33617: connect: Connection refused (error 111)
I20260709 13:01:13.268765  2276 leader_election.cc:304] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 631fb66c0070402b8f78fd74633dae6f, d3b488cf00f7497ea0bf5964b99f6e0e
I20260709 13:01:13.269796  7415 raft_consensus.cc:2749] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.270439   431 tablet_replica.cc:333] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.271164   431 raft_consensus.cc:2243] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.272150   431 raft_consensus.cc:2272] T 25da6efa74464e65b8319c8230d379fc P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.275605   431 tablet_replica.cc:333] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.276191   431 raft_consensus.cc:2243] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.277168   431 raft_consensus.cc:2272] T 8bbf1e27410e4984b453b68cb9b08bd6 P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.279822   431 tablet_replica.cc:333] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.280460   431 raft_consensus.cc:2243] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.281562   431 raft_consensus.cc:2272] T ea39a99a63554d4dbb26f49a38585b4e P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.284371   431 tablet_replica.cc:333] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.285151   431 raft_consensus.cc:2243] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.286353   431 raft_consensus.cc:2272] T b36f171d98ea4aedbd87b5f98c2c0127 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.288615   431 tablet_replica.cc:333] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.289239   431 raft_consensus.cc:2243] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.290171   431 raft_consensus.cc:2272] T 2ee88b04047243b6b9ee3653189f3969 P c445b7b7d94f48f99a3599ddfc92f462 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.292333   431 tablet_replica.cc:333] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.292869   431 raft_consensus.cc:2243] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.293766   431 raft_consensus.cc:2272] T 9059b4be41c340278068c13696d1000e P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.296411   431 tablet_replica.cc:333] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.297127   431 raft_consensus.cc:2243] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.298168   431 raft_consensus.cc:2272] T bdbc1ad76ba949aba54340f33a210d0d P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.300490   431 tablet_replica.cc:333] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.301010   431 raft_consensus.cc:2243] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.301891   431 raft_consensus.cc:2272] T 710eea1b85d441dcabbb12e33e31ae6b P c445b7b7d94f48f99a3599ddfc92f462 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.303803   431 tablet_replica.cc:333] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.304390   431 raft_consensus.cc:2243] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.305325   431 raft_consensus.cc:2272] T 4588cb2170964d9888521712ee881700 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.307459   431 tablet_replica.cc:333] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.307962   431 raft_consensus.cc:2243] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.308535   431 raft_consensus.cc:2272] T 31d2293f596d4cefaf1a169b3a79ba46 P c445b7b7d94f48f99a3599ddfc92f462 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.310508   431 tablet_replica.cc:333] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.311057   431 raft_consensus.cc:2243] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.311853   431 raft_consensus.cc:2272] T 4ea53f766b5a4fd081983e46c7fd5da9 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.313931   431 tablet_replica.cc:333] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.314414   431 raft_consensus.cc:2243] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.314860   431 raft_consensus.cc:2272] T 396314c408674415abb66b1625b8a308 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.316848   431 tablet_replica.cc:333] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.317396   431 raft_consensus.cc:2243] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.318267   431 raft_consensus.cc:2272] T ef459e67de67444fad0fff119d7885c0 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.320971   431 tablet_replica.cc:333] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.321455   431 raft_consensus.cc:2243] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.322023   431 raft_consensus.cc:2272] T 79180ee33a124de7a839155b4a30086e P c445b7b7d94f48f99a3599ddfc92f462 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.323925   431 tablet_replica.cc:333] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.324520   431 raft_consensus.cc:2243] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.325665   431 raft_consensus.cc:2272] T 113c4345626841658cc1c3aa19853e2a P c445b7b7d94f48f99a3599ddfc92f462 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.327587   431 tablet_replica.cc:333] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.328084   431 raft_consensus.cc:2243] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.328944   431 raft_consensus.cc:2272] T 33d9e592d41d477fb881a9c29cc45de1 P c445b7b7d94f48f99a3599ddfc92f462 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.329423  7415 raft_consensus.cc:493] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 631fb66c0070402b8f78fd74633dae6f)
I20260709 13:01:13.330042  7415 raft_consensus.cc:515] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f82bbd9193f4b71a0c17a0357cf0ce9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34321 } } peers { permanent_uuid: "631fb66c0070402b8f78fd74633dae6f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43205 } } peers { permanent_uuid: "c445b7b7d94f48f99a3599ddfc92f462" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } attrs { promote: false } }
I20260709 13:01:13.331881   431 tablet_replica.cc:333] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.332458  7415 leader_election.cc:290] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321), 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205)
I20260709 13:01:13.332690   431 raft_consensus.cc:2243] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.334038   431 raft_consensus.cc:2272] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.336531  2276 leader_election.cc:336] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0f82bbd9193f4b71a0c17a0357cf0ce9 (127.0.107.193:34321): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34321: connect: Connection refused (error 111)
I20260709 13:01:13.337242   431 tablet_replica.cc:333] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
W20260709 13:01:13.337285  2275 leader_election.cc:336] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 631fb66c0070402b8f78fd74633dae6f (127.0.107.195:43205): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43205: connect: Connection refused (error 111)
I20260709 13:01:13.337863  2275 leader_election.cc:304] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c445b7b7d94f48f99a3599ddfc92f462; no voters: 0f82bbd9193f4b71a0c17a0357cf0ce9, 631fb66c0070402b8f78fd74633dae6f
I20260709 13:01:13.338045   431 raft_consensus.cc:2243] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:13.338395  2275 raft_consensus.cc:2686] T 65a88b4c57e043e39d00e6e3f02b64fe P c445b7b7d94f48f99a3599ddfc92f462: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:01:13.338739   431 raft_consensus.cc:2272] T a95518ca56c246da9d064efb1f0fb391 P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.341789   431 tablet_replica.cc:333] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462: stopping tablet replica
I20260709 13:01:13.342391   431 raft_consensus.cc:2243] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.343394   431 raft_consensus.cc:2272] T bb61d39ca56d420fbee59be16467e2ec P c445b7b7d94f48f99a3599ddfc92f462 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.626791   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:13.689220   431 master.cc:562] Master@127.0.107.254:33233 shutting down...
W20260709 13:01:13.723495  1487 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:01:13.723809  1487 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:13.724025  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:01:13.727953   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.728627   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.728916   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P a34435529147466db8abc42dc6329534: stopping tablet replica
I20260709 13:01:13.848429   431 master.cc:584] Master@127.0.107.254:33233 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (186118 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:01:13.952461   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:44269
I20260709 13:01:13.953649   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:13.959476  7430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.959998  7431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.960958  7433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:13.961460   431 server_base.cc:1061] running on GCE node
I20260709 13:01:13.963724   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:13.963918   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:13.964094   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602073964079 us; error 0 us; skew 500 ppm
I20260709 13:01:13.964732   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:13.971462   431 webserver.cc:533] Webserver started at http://127.0.107.254:34957/ using document root <none> and password file <none>
I20260709 13:01:13.972011   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:13.972216   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:13.972676   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:13.974017   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "9198f12b4abf43fb82c87bc083a6d5c9"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-vcr9"
I20260709 13:01:13.979089   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:13.982648  7438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.983407   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:13.983711   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "9198f12b4abf43fb82c87bc083a6d5c9"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-vcr9"
I20260709 13:01:13.984026   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:14.000793   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:14.002076   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:14.040863   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:44269
I20260709 13:01:14.040961  7489 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:44269 every 8 connection(s)
I20260709 13:01:14.044893  7490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.055365  7490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9: Bootstrap starting.
I20260709 13:01:14.060344  7490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.064646  7490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9: No bootstrap required, opened a new log
I20260709 13:01:14.066919  7490 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" member_type: VOTER }
I20260709 13:01:14.067358  7490 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.067596  7490 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9198f12b4abf43fb82c87bc083a6d5c9, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.068257  7490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" member_type: VOTER }
I20260709 13:01:14.068821  7490 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:14.069051  7490 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:14.069334  7490 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.073698  7490 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" member_type: VOTER }
I20260709 13:01:14.074225  7490 leader_election.cc:304] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9198f12b4abf43fb82c87bc083a6d5c9; no voters: 
I20260709 13:01:14.075331  7490 leader_election.cc:290] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:14.075748  7493 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:14.077199  7493 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 1 LEADER]: Becoming Leader. State: Replica: 9198f12b4abf43fb82c87bc083a6d5c9, State: Running, Role: LEADER
I20260709 13:01:14.077919  7493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" member_type: VOTER }
I20260709 13:01:14.078296  7490 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:14.083261  7495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9198f12b4abf43fb82c87bc083a6d5c9. Latest consensus state: current_term: 1 leader_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" member_type: VOTER } }
I20260709 13:01:14.083467  7494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9198f12b4abf43fb82c87bc083a6d5c9" member_type: VOTER } }
I20260709 13:01:14.084210  7494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:14.084396  7495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:14.086354  7500 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:14.094224  7500 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:14.095204   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:14.102922  7500 catalog_manager.cc:1383] Generated new cluster ID: ad5dc32b60244666a033b8859776a240
I20260709 13:01:14.103199  7500 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:14.128382  7500 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:14.129691  7500 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:14.142810  7500 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9: Generated new TSK 0
I20260709 13:01:14.143415  7500 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:14.162128   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:14.168321  7511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.169349  7512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.172005  7514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:14.172359   431 server_base.cc:1061] running on GCE node
I20260709 13:01:14.174449   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:14.174677   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:14.174850   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602074174831 us; error 0 us; skew 500 ppm
I20260709 13:01:14.175396   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:14.177661   431 webserver.cc:533] Webserver started at http://127.0.107.193:45581/ using document root <none> and password file <none>
I20260709 13:01:14.178164   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:14.178367   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:14.178627   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:14.179757   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "8f0ca605b31c4386b93d83ddb820c36e"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.184180   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:01:14.187477  7519 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.188278   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:14.188613   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "8f0ca605b31c4386b93d83ddb820c36e"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.188925   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:14.202011   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:14.203207   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:14.204706   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:14.206877   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:14.207113   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.207351   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:14.207537   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.247620   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42081
I20260709 13:01:14.247752  7581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42081 every 8 connection(s)
I20260709 13:01:14.252883   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:14.260421  7586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.260870  7587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.263779  7589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:14.264526   431 server_base.cc:1061] running on GCE node
I20260709 13:01:14.266659   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:14.266893   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:14.267102   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602074267085 us; error 0 us; skew 500 ppm
I20260709 13:01:14.267668   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:14.269603  7582 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44269
I20260709 13:01:14.269968  7582 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:14.270604   431 webserver.cc:533] Webserver started at http://127.0.107.194:33917/ using document root <none> and password file <none>
I20260709 13:01:14.270780  7582 heartbeater.cc:507] Master 127.0.107.254:44269 requested a full tablet report, sending...
I20260709 13:01:14.271193   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:14.271448   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:14.271726   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:14.273057   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "53979e9879e74487a8a95daacdefdbcd"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.273084  7455 ts_manager.cc:194] Registered new tserver with Master: 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:14.274932  7455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37418
I20260709 13:01:14.277886   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:14.281464  7594 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.282181   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:01:14.282488   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "53979e9879e74487a8a95daacdefdbcd"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.282805   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:14.297215   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:14.298442   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:14.300000   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:14.302251   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:14.302487   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.302752   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:14.302937   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.343065   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36939
I20260709 13:01:14.343176  7656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36939 every 8 connection(s)
I20260709 13:01:14.347987   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:14.355377  7660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.357352  7661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:14.361271  7657 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44269
I20260709 13:01:14.361433   431 server_base.cc:1061] running on GCE node
W20260709 13:01:14.361564  7663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:14.361837  7657 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:14.362588   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:14.362790   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:14.362728  7657 heartbeater.cc:507] Master 127.0.107.254:44269 requested a full tablet report, sending...
I20260709 13:01:14.363197   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602074363169 us; error 0 us; skew 500 ppm
I20260709 13:01:14.363826   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:14.365218  7455 ts_manager.cc:194] Registered new tserver with Master: 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:14.366389   431 webserver.cc:533] Webserver started at http://127.0.107.195:32903/ using document root <none> and password file <none>
I20260709 13:01:14.366925   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:14.366868  7455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37420
I20260709 13:01:14.367300   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:14.367609   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:14.368817   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "ebe6c341a95a4deda3fd323405e42608"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.373309   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:14.376611  7668 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.377357   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:01:14.377661   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "ebe6c341a95a4deda3fd323405e42608"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.377954   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:14.403249   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:14.404562   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:14.406047   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:14.408272   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:14.408499   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.408821   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:14.408993   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.461130   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38267
I20260709 13:01:14.461220  7730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38267 every 8 connection(s)
I20260709 13:01:14.467060   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:14.475149  7734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.475539  7735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:14.478963  7737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:14.480841   431 server_base.cc:1061] running on GCE node
I20260709 13:01:14.481804  7731 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44269
I20260709 13:01:14.481846   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:14.482347  7731 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:14.482815   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:14.483036   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602074483014 us; error 0 us; skew 500 ppm
I20260709 13:01:14.483544  7731 heartbeater.cc:507] Master 127.0.107.254:44269 requested a full tablet report, sending...
I20260709 13:01:14.483850   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:14.486354  7455 ts_manager.cc:194] Registered new tserver with Master: ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:14.487026   431 webserver.cc:533] Webserver started at http://127.0.107.196:46109/ using document root <none> and password file <none>
I20260709 13:01:14.487671   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:14.487867   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:14.488127   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:14.488729  7455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37424
I20260709 13:01:14.489501   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-3-root/instance:
uuid: "07d5308b5f834161a9f46b9565fa95e6"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.495779   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:14.499528  7742 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.500341   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:01:14.500687   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-3-root
uuid: "07d5308b5f834161a9f46b9565fa95e6"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:14.500996   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:14.520437   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:14.521741   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:14.523191   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:14.525419   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:14.525661   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.525905   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:14.526085   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:14.565744   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:42107
I20260709 13:01:14.565845  7804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:42107 every 8 connection(s)
I20260709 13:01:14.579543  7805 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44269
I20260709 13:01:14.579943  7805 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:14.580760  7805 heartbeater.cc:507] Master 127.0.107.254:44269 requested a full tablet report, sending...
I20260709 13:01:14.582758  7455 ts_manager.cc:194] Registered new tserver with Master: 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:14.582944   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014002297s
I20260709 13:01:14.584724  7455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37436
I20260709 13:01:14.608858  7455 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37442:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:01:14.848843  7547 tablet_service.cc:1511] Processing CreateTablet for tablet a74589dcef6c479c90e97df23e516a12 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:14.850414  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74589dcef6c479c90e97df23e516a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.850386  7546 tablet_service.cc:1511] Processing CreateTablet for tablet d322269bb5424add8d6df46595372704 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:14.851790  7546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d322269bb5424add8d6df46595372704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.853812  7696 tablet_service.cc:1511] Processing CreateTablet for tablet a74589dcef6c479c90e97df23e516a12 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:14.855232  7696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74589dcef6c479c90e97df23e516a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.862470  7695 tablet_service.cc:1511] Processing CreateTablet for tablet e1633ca6bd2346cbbca54b2fd74b21a3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:14.868359  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1633ca6bd2346cbbca54b2fd74b21a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.874691  7694 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c347c14744ddebeb34bf12cec639c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:14.877162  7694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c347c14744ddebeb34bf12cec639c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.877982  7545 tablet_service.cc:1511] Processing CreateTablet for tablet e1633ca6bd2346cbbca54b2fd74b21a3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:14.879452  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1633ca6bd2346cbbca54b2fd74b21a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.885891  7544 tablet_service.cc:1511] Processing CreateTablet for tablet 40fce8895f7140c1bb5c58216f2018ca (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:14.887384  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fce8895f7140c1bb5c58216f2018ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.894776  7693 tablet_service.cc:1511] Processing CreateTablet for tablet 40fce8895f7140c1bb5c58216f2018ca (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:14.896188  7693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fce8895f7140c1bb5c58216f2018ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.897743  7543 tablet_service.cc:1511] Processing CreateTablet for tablet fcbc5ef8c78a4759a2bb8fe7a52b49d3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:14.899133  7543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbc5ef8c78a4759a2bb8fe7a52b49d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.903211  7545 tablet_service.cc:1511] Processing CreateTablet for tablet 4e06caf0de81404985683e0fa4c93453 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:14.903766  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 4e06caf0de81404985683e0fa4c93453 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:14.905115  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e06caf0de81404985683e0fa4c93453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.905758  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e06caf0de81404985683e0fa4c93453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.906845  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 41f635c63a7d4a5c9eab84b42ebe8786 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:14.908258  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f635c63a7d4a5c9eab84b42ebe8786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.925484  7769 tablet_service.cc:1511] Processing CreateTablet for tablet e1633ca6bd2346cbbca54b2fd74b21a3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:14.926913  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1633ca6bd2346cbbca54b2fd74b21a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.929490  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c347c14744ddebeb34bf12cec639c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:14.930907  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c347c14744ddebeb34bf12cec639c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.923686  7770 tablet_service.cc:1511] Processing CreateTablet for tablet d322269bb5424add8d6df46595372704 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:14.938220  7767 tablet_service.cc:1511] Processing CreateTablet for tablet fcbc5ef8c78a4759a2bb8fe7a52b49d3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:14.939673  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbc5ef8c78a4759a2bb8fe7a52b49d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.939635  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 4e06caf0de81404985683e0fa4c93453 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:14.941138  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e06caf0de81404985683e0fa4c93453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.941478  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 41f635c63a7d4a5c9eab84b42ebe8786 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:14.942844  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f635c63a7d4a5c9eab84b42ebe8786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.944810  7824 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:14.950320  7825 tablet_bootstrap.cc:492] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:14.953025  7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d322269bb5424add8d6df46595372704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.966740  7695 tablet_service.cc:1511] Processing CreateTablet for tablet c729997968264c78bbdf7e19a94ba7bf (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:14.968158  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c729997968264c78bbdf7e19a94ba7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.969877  7546 tablet_service.cc:1511] Processing CreateTablet for tablet c729997968264c78bbdf7e19a94ba7bf (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:14.971294  7546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c729997968264c78bbdf7e19a94ba7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.973475  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 80f8a79b4a1f4ba1b853e27bb9a44736 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:14.974915  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f8a79b4a1f4ba1b853e27bb9a44736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.971343  7824 tablet_bootstrap.cc:654] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.980939  7619 tablet_service.cc:1511] Processing CreateTablet for tablet 40fce8895f7140c1bb5c58216f2018ca (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:14.981694  7617 tablet_service.cc:1511] Processing CreateTablet for tablet 41f635c63a7d4a5c9eab84b42ebe8786 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:14.981848  7621 tablet_service.cc:1511] Processing CreateTablet for tablet d322269bb5424add8d6df46595372704 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:14.982566  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fce8895f7140c1bb5c58216f2018ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.983281  7621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d322269bb5424add8d6df46595372704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.983903  7617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f635c63a7d4a5c9eab84b42ebe8786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.985445  7618 tablet_service.cc:1511] Processing CreateTablet for tablet fcbc5ef8c78a4759a2bb8fe7a52b49d3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:14.986090  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc971cb81cf49afa0b8d663a0b267a2 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:14.986927  7618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbc5ef8c78a4759a2bb8fe7a52b49d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.987519  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc971cb81cf49afa0b8d663a0b267a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.990653  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc971cb81cf49afa0b8d663a0b267a2 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:14.990892  7763 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc971cb81cf49afa0b8d663a0b267a2 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:14.991549  7620 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c347c14744ddebeb34bf12cec639c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:14.992116  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc971cb81cf49afa0b8d663a0b267a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.993736  7616 tablet_service.cc:1511] Processing CreateTablet for tablet c729997968264c78bbdf7e19a94ba7bf (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:14.993803  7622 tablet_service.cc:1511] Processing CreateTablet for tablet a74589dcef6c479c90e97df23e516a12 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:14.992280  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc971cb81cf49afa0b8d663a0b267a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.996855  7615 tablet_service.cc:1511] Processing CreateTablet for tablet 80f8a79b4a1f4ba1b853e27bb9a44736 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:14.999511  7614 tablet_service.cc:1511] Processing CreateTablet for tablet f653b5173b0b42bb869623267b61bfca (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:15.005029  7620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c347c14744ddebeb34bf12cec639c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.008592  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f653b5173b0b42bb869623267b61bfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.012580  7615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f8a79b4a1f4ba1b853e27bb9a44736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.013231  7622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74589dcef6c479c90e97df23e516a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.016350  7692 tablet_service.cc:1511] Processing CreateTablet for tablet f653b5173b0b42bb869623267b61bfca (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:15.017827  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f653b5173b0b42bb869623267b61bfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.027508  7765 tablet_service.cc:1511] Processing CreateTablet for tablet f653b5173b0b42bb869623267b61bfca (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:15.028980  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f653b5173b0b42bb869623267b61bfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.031715  7689 tablet_service.cc:1511] Processing CreateTablet for tablet bc981b77d6b8419aaab6827bd0a25275 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:15.033215  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc981b77d6b8419aaab6827bd0a25275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.036027  7613 tablet_service.cc:1511] Processing CreateTablet for tablet bc981b77d6b8419aaab6827bd0a25275 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:15.037539  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc981b77d6b8419aaab6827bd0a25275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.040385  7825 tablet_bootstrap.cc:654] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.042003  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c729997968264c78bbdf7e19a94ba7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.042606  7547 tablet_service.cc:1511] Processing CreateTablet for tablet bc981b77d6b8419aaab6827bd0a25275 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:15.043926  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc981b77d6b8419aaab6827bd0a25275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.043705  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8e41c6979b4cb5a279abaf4c65007c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:15.045080  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8e41c6979b4cb5a279abaf4c65007c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.046280  7543 tablet_service.cc:1511] Processing CreateTablet for tablet 80f8a79b4a1f4ba1b853e27bb9a44736 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:15.047668  7543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f8a79b4a1f4ba1b853e27bb9a44736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.063822  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8e41c6979b4cb5a279abaf4c65007c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:15.065447  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8e41c6979b4cb5a279abaf4c65007c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:15.090221  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:15.099606  7824 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:15.100502  7824 ts_tablet_manager.cc:1403] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.006s
I20260709 13:01:15.105566  7826 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:15.107565  7824 raft_consensus.cc:359] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.108332  7824 raft_consensus.cc:385] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.108626  7824 raft_consensus.cc:740] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.100492  7622 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8e41c6979b4cb5a279abaf4c65007c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:15.122642  7622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8e41c6979b4cb5a279abaf4c65007c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.123694  7825 tablet_bootstrap.cc:492] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:15.124580  7825 ts_tablet_manager.cc:1403] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.005s
I20260709 13:01:15.124611  7824 consensus_queue.cc:260] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.137219  7825 raft_consensus.cc:359] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.138078  7825 raft_consensus.cc:385] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.138434  7825 raft_consensus.cc:740] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.139346  7825 consensus_queue.cc:260] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.145601  7770 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3cae1107da44f5af6f20b55687be66 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:15.147012  7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3cae1107da44f5af6f20b55687be66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.163312  7695 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3cae1107da44f5af6f20b55687be66 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:15.165429  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3cae1107da44f5af6f20b55687be66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.174796  7829 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:15.177480  7545 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3cae1107da44f5af6f20b55687be66 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:15.178597  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3cae1107da44f5af6f20b55687be66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.181321  7824 ts_tablet_manager.cc:1434] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.078s	user 0.020s	sys 0.008s
I20260709 13:01:15.184401  7582 heartbeater.cc:499] Master 127.0.107.254:44269 was elected leader, sending a full tablet report...
I20260709 13:01:15.183843  7829 tablet_bootstrap.cc:654] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.189486  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 6f242eb526cd4973918a7293d825cbbe (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:15.191099  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f242eb526cd4973918a7293d825cbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.194967  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 6f242eb526cd4973918a7293d825cbbe (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:15.196909  7826 tablet_bootstrap.cc:654] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.196877  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f242eb526cd4973918a7293d825cbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.201550  7824 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:15.206724  7731 heartbeater.cc:499] Master 127.0.107.254:44269 was elected leader, sending a full tablet report...
I20260709 13:01:15.208835  7829 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:15.209694  7829 ts_tablet_manager.cc:1403] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.009s
I20260709 13:01:15.209554  7616 tablet_service.cc:1511] Processing CreateTablet for tablet 6f242eb526cd4973918a7293d825cbbe (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:15.211078  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f242eb526cd4973918a7293d825cbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.213053  7829 raft_consensus.cc:359] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.213903  7829 raft_consensus.cc:385] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.214263  7829 raft_consensus.cc:740] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.208472  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed0433b495a4adab9c75e40ec020b60 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:15.208840  7825 ts_tablet_manager.cc:1434] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.082s	user 0.014s	sys 0.003s
I20260709 13:01:15.216899  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed0433b495a4adab9c75e40ec020b60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:15.217005  7732 tablet.cc:2406] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:15.219386  7825 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:15.221297  7824 tablet_bootstrap.cc:654] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.227789  7825 tablet_bootstrap.cc:654] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.227947  7619 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed0433b495a4adab9c75e40ec020b60 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:15.229817  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed0433b495a4adab9c75e40ec020b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.215482  7829 consensus_queue.cc:260] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.250788  7826 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:15.251544  7826 ts_tablet_manager.cc:1403] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.000s
I20260709 13:01:15.254024  7829 ts_tablet_manager.cc:1434] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:01:15.254858  7805 heartbeater.cc:499] Master 127.0.107.254:44269 was elected leader, sending a full tablet report...
I20260709 13:01:15.257279  7835 raft_consensus.cc:493] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.257952  7835 raft_consensus.cc:515] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.265122  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed0433b495a4adab9c75e40ec020b60 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:15.266614  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed0433b495a4adab9c75e40ec020b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.267351  7829 tablet_bootstrap.cc:492] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:15.255568  7826 raft_consensus.cc:359] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.268646  7826 raft_consensus.cc:385] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.268988  7826 raft_consensus.cc:740] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.250788  7824 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:15.270282  7824 ts_tablet_manager.cc:1403] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 13:01:15.265127  7770 tablet_service.cc:1511] Processing CreateTablet for tablet e140450c826d47e194aad76501966c61 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:15.273679  7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e140450c826d47e194aad76501966c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.273545  7824 raft_consensus.cc:359] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.274412  7824 raft_consensus.cc:385] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.274744  7824 raft_consensus.cc:740] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.276448  7826 consensus_queue.cc:260] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.265789  7825 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:15.278481  7825 ts_tablet_manager.cc:1403] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.004s
I20260709 13:01:15.283504  7825 raft_consensus.cc:359] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.285600  7825 raft_consensus.cc:385] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.286391  7825 raft_consensus.cc:740] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.287240  7825 consensus_queue.cc:260] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.287843  7829 tablet_bootstrap.cc:654] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.289767  7825 ts_tablet_manager.cc:1434] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:01:15.290861  7825 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:15.297271  7826 ts_tablet_manager.cc:1434] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.045s	user 0.000s	sys 0.010s
I20260709 13:01:15.297663  7545 tablet_service.cc:1511] Processing CreateTablet for tablet e140450c826d47e194aad76501966c61 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:15.298235  7657 heartbeater.cc:499] Master 127.0.107.254:44269 was elected leader, sending a full tablet report...
I20260709 13:01:15.298563  7826 tablet_bootstrap.cc:492] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:15.299003  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e140450c826d47e194aad76501966c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.304569  7835 leader_election.cc:290] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:15.331218  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 8821c72ad05541a680bf7e51256d96c5 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:15.292819  7824 consensus_queue.cc:260] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.337309  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 8821c72ad05541a680bf7e51256d96c5 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:15.350229  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821c72ad05541a680bf7e51256d96c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.350948  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821c72ad05541a680bf7e51256d96c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.352577  7824 ts_tablet_manager.cc:1434] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 13:01:15.337353  7831 raft_consensus.cc:493] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.353998  7824 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:15.354056  7831 raft_consensus.cc:515] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.355533  7825 tablet_bootstrap.cc:654] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.337311  7616 tablet_service.cc:1511] Processing CreateTablet for tablet e140450c826d47e194aad76501966c61 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:15.343987  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 8821c72ad05541a680bf7e51256d96c5 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:15.357203  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e140450c826d47e194aad76501966c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.357547  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821c72ad05541a680bf7e51256d96c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.345572  7826 tablet_bootstrap.cc:654] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.362908  7831 leader_election.cc:290] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:15.375171  7619 tablet_service.cc:1511] Processing CreateTablet for tablet f7ba54050b634067a6e55c28cfa270ba (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:15.376768  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ba54050b634067a6e55c28cfa270ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.422276  7690 tablet_service.cc:1511] Processing CreateTablet for tablet f7ba54050b634067a6e55c28cfa270ba (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:15.422365  7766 tablet_service.cc:1511] Processing CreateTablet for tablet f7ba54050b634067a6e55c28cfa270ba (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:15.423961  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ba54050b634067a6e55c28cfa270ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.424468  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ba54050b634067a6e55c28cfa270ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.466641  7824 tablet_bootstrap.cc:654] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.472973  7829 tablet_bootstrap.cc:492] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:15.473613  7829 ts_tablet_manager.cc:1403] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.206s	user 0.020s	sys 0.047s
I20260709 13:01:15.477452  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1633ca6bd2346cbbca54b2fd74b21a3" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:15.478330  7557 raft_consensus.cc:2468] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:15.479820  7671 leader_election.cc:304] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:15.478654  7826 tablet_bootstrap.cc:492] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:15.482075  7826 ts_tablet_manager.cc:1403] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.008s
I20260709 13:01:15.481926  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1633ca6bd2346cbbca54b2fd74b21a3" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:15.486140  7670 leader_election.cc:343] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.485809  7546 tablet_service.cc:1511] Processing CreateTablet for tablet 868bb0c5915543b7bd6a7644aa0fc361 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:15.481069  7831 raft_consensus.cc:2804] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.487142  7831 raft_consensus.cc:493] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.487414  7546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868bb0c5915543b7bd6a7644aa0fc361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.487522  7825 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:15.488212  7825 ts_tablet_manager.cc:1403] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.198s	user 0.010s	sys 0.010s
I20260709 13:01:15.487592  7831 raft_consensus.cc:3060] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.493227  7825 raft_consensus.cc:359] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.494020  7825 raft_consensus.cc:385] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.494323  7825 raft_consensus.cc:740] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.494467  7826 raft_consensus.cc:359] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.495455  7826 raft_consensus.cc:385] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.498788  7826 raft_consensus.cc:740] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.495882  7831 raft_consensus.cc:515] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.499482  7824 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:15.500056  7824 ts_tablet_manager.cc:1403] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.006s
I20260709 13:01:15.499881  7826 consensus_queue.cc:260] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.502728  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1633ca6bd2346cbbca54b2fd74b21a3" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
W20260709 13:01:15.504312  7670 leader_election.cc:343] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.505049  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1633ca6bd2346cbbca54b2fd74b21a3" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:15.505738  7557 raft_consensus.cc:3060] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.506150  7826 ts_tablet_manager.cc:1434] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:01:15.507220  7826 tablet_bootstrap.cc:492] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:15.509373  7831 leader_election.cc:290] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:15.509949  7831 raft_consensus.cc:493] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.510388  7831 raft_consensus.cc:515] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.505918  7824 raft_consensus.cc:359] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.517269  7824 raft_consensus.cc:385] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.518828  7824 raft_consensus.cc:740] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.518200  7557 raft_consensus.cc:2468] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:15.522593  7671 leader_election.cc:304] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6
I20260709 13:01:15.523908  7848 raft_consensus.cc:2804] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.508394  7825 consensus_queue.cc:260] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.527834  7826 tablet_bootstrap.cc:654] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.527690  7619 tablet_service.cc:1511] Processing CreateTablet for tablet 868bb0c5915543b7bd6a7644aa0fc361 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:15.529168  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868bb0c5915543b7bd6a7644aa0fc361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.529942  7829 raft_consensus.cc:359] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.536919  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 868bb0c5915543b7bd6a7644aa0fc361 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:15.537305  7766 tablet_service.cc:1511] Processing CreateTablet for tablet b2fb2def96cb455bbc7a536643f246c7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:15.538661  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2fb2def96cb455bbc7a536643f246c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.538810  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868bb0c5915543b7bd6a7644aa0fc361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.519990  7824 consensus_queue.cc:260] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.546571  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:15.554921  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c347c14744ddebeb34bf12cec639c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:15.552970  7830 raft_consensus.cc:493] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.556160  7830 raft_consensus.cc:515] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.552659  7831 leader_election.cc:290] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:15.555063  7706 raft_consensus.cc:2468] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:15.558983  7830 leader_election.cc:290] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:15.558849  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:15.560364  7746 leader_election.cc:304] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:15.562130  7835 raft_consensus.cc:2804] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.563211  7835 raft_consensus.cc:493] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.548815  7829 raft_consensus.cc:385] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.563661  7835 raft_consensus.cc:3060] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.554466  7848 raft_consensus.cc:697] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:15.568323  7829 raft_consensus.cc:740] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
W20260709 13:01:15.569013  7670 leader_election.cc:343] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.584851  7546 tablet_service.cc:1511] Processing CreateTablet for tablet b2fb2def96cb455bbc7a536643f246c7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:15.585312  7616 tablet_service.cc:1511] Processing CreateTablet for tablet b2fb2def96cb455bbc7a536643f246c7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:15.586419  7825 ts_tablet_manager.cc:1434] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.097s	user 0.018s	sys 0.036s
I20260709 13:01:15.589569  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2fb2def96cb455bbc7a536643f246c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.590595  7825 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:15.590345  7695 tablet_service.cc:1511] Processing CreateTablet for tablet 99c1d3edcbd24605885f5aece16869f1 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:15.591625  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c1d3edcbd24605885f5aece16869f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.593686  7546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2fb2def96cb455bbc7a536643f246c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.593925  7622 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa66f85089b48afada6adb174712a9a (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:15.595220  7622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa66f85089b48afada6adb174712a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.597384  7825 tablet_bootstrap.cc:654] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.598317  7848 consensus_queue.cc:237] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.600171  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 99c1d3edcbd24605885f5aece16869f1 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:15.601590  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c1d3edcbd24605885f5aece16869f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.597015  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 99c1d3edcbd24605885f5aece16869f1 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:15.613765  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa66f85089b48afada6adb174712a9a (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:15.615633  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa66f85089b48afada6adb174712a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.621791  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c1d3edcbd24605885f5aece16869f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:15.624559  7745 leader_election.cc:343] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.616531  7838 raft_consensus.cc:493] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.628727  7838 raft_consensus.cc:515] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.645064  7770 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa66f85089b48afada6adb174712a9a (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:15.647572  7829 consensus_queue.cc:260] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.654500  7829 ts_tablet_manager.cc:1434] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.181s	user 0.008s	sys 0.000s
I20260709 13:01:15.645435  7835 raft_consensus.cc:515] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.655861  7545 tablet_service.cc:1511] Processing CreateTablet for tablet f472af11ec9e424ea42c848b20e97c35 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:15.657179  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:15.657761  7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa66f85089b48afada6adb174712a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.658746  7835 leader_election.cc:290] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:15.660028  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:15.657810  7706 raft_consensus.cc:3060] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.678831  7706 raft_consensus.cc:2468] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:15.657197  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f472af11ec9e424ea42c848b20e97c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.680496  7746 leader_election.cc:304] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:15.681411  7835 raft_consensus.cc:2804] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.681317  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c347c14744ddebeb34bf12cec639c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:15.684410  7745 leader_election.cc:343] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.685537  7632 raft_consensus.cc:2468] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:15.690057  7671 leader_election.cc:304] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6
I20260709 13:01:15.690531  7622 tablet_service.cc:1511] Processing CreateTablet for tablet f472af11ec9e424ea42c848b20e97c35 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:15.691397  7850 raft_consensus.cc:2804] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.691810  7850 raft_consensus.cc:493] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.692157  7850 raft_consensus.cc:3060] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.693209  7838 leader_election.cc:290] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:15.693814  7769 tablet_service.cc:1511] Processing CreateTablet for tablet 30af4a33a3c84877bee300138641109b (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:15.691813  7622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f472af11ec9e424ea42c848b20e97c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.684605  7835 raft_consensus.cc:697] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:15.711652  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d322269bb5424add8d6df46595372704" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:15.713784  7522 leader_election.cc:343] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.728591  7543 tablet_service.cc:1511] Processing CreateTablet for tablet 30af4a33a3c84877bee300138641109b (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:15.730048  7543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30af4a33a3c84877bee300138641109b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.732357  7829 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:15.734887  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d322269bb5424add8d6df46595372704" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:15.738200  7521 leader_election.cc:343] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.738688  7521 leader_election.cc:304] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:15.744690  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30af4a33a3c84877bee300138641109b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.747290  7544 tablet_service.cc:1511] Processing CreateTablet for tablet 1981e10fe1f543fcb29a57e7cd592155 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:15.748654  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1981e10fe1f543fcb29a57e7cd592155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.753533  7830 raft_consensus.cc:2749] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.760041  7856 raft_consensus.cc:493] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.760612  7856 raft_consensus.cc:515] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.762389  7689 tablet_service.cc:1511] Processing CreateTablet for tablet 707d80b971064b8fbb0d0a9b353a53ae (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:15.762876  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 1981e10fe1f543fcb29a57e7cd592155 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:15.763801  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707d80b971064b8fbb0d0a9b353a53ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.764217  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:15.764068  7835 consensus_queue.cc:237] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.764972  7632 raft_consensus.cc:2468] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:15.766309  7522 leader_election.cc:304] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:15.767217  7830 raft_consensus.cc:2804] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.767603  7830 raft_consensus.cc:493] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.767930  7830 raft_consensus.cc:3060] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.770929  7454 catalog_manager.cc:5697] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.773286  7692 tablet_service.cc:1511] Processing CreateTablet for tablet f472af11ec9e424ea42c848b20e97c35 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:15.774827  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f472af11ec9e424ea42c848b20e97c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.775252  7825 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:15.775774  7825 ts_tablet_manager.cc:1403] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.024s
I20260709 13:01:15.780923  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1981e10fe1f543fcb29a57e7cd592155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.782161  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 707d80b971064b8fbb0d0a9b353a53ae (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:15.783517  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707d80b971064b8fbb0d0a9b353a53ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.756573  7826 tablet_bootstrap.cc:492] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:15.784845  7826 ts_tablet_manager.cc:1403] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.278s	user 0.032s	sys 0.013s
I20260709 13:01:15.759670  7829 tablet_bootstrap.cc:654] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.792572  7856 leader_election.cc:290] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:15.811384  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 557c070427344f13b3df4674a7f5f307 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:15.813390  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557c070427344f13b3df4674a7f5f307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.814076  7695 tablet_service.cc:1511] Processing CreateTablet for tablet 557c070427344f13b3df4674a7f5f307 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:15.815330  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557c070427344f13b3df4674a7f5f307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.779103  7825 raft_consensus.cc:359] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:15.837189  7769 tablet_service.cc:1511] Processing CreateTablet for tablet 33adb63e12f441f799b0ba5829b6291b (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:15.837199  7619 tablet_service.cc:1511] Processing CreateTablet for tablet 30af4a33a3c84877bee300138641109b (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:15.838783  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33adb63e12f441f799b0ba5829b6291b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.839069  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30af4a33a3c84877bee300138641109b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.840895  7696 tablet_service.cc:1511] Processing CreateTablet for tablet 0320ea4b71844851b35b9d1a05a5d2c6 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:15.842124  7696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0320ea4b71844851b35b9d1a05a5d2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.837199  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 33adb63e12f441f799b0ba5829b6291b (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:15.845602  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33adb63e12f441f799b0ba5829b6291b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.811482  7830 raft_consensus.cc:515] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.828687  7825 raft_consensus.cc:385] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.853475  7825 raft_consensus.cc:740] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.855670  7825 consensus_queue.cc:260] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:15.859869  7825 ts_tablet_manager.cc:1434] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.001s
I20260709 13:01:15.860337  7616 tablet_service.cc:1511] Processing CreateTablet for tablet 707d80b971064b8fbb0d0a9b353a53ae (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:15.860893  7825 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:15.861224  7830 leader_election.cc:290] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:15.861658  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707d80b971064b8fbb0d0a9b353a53ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.861812  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 1981e10fe1f543fcb29a57e7cd592155 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:15.863166  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1981e10fe1f543fcb29a57e7cd592155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.828058  7850 raft_consensus.cc:515] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.865319  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:15.865916  7632 raft_consensus.cc:3060] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.867311  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 0320ea4b71844851b35b9d1a05a5d2c6 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:15.867970  7825 tablet_bootstrap.cc:654] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.868582  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0320ea4b71844851b35b9d1a05a5d2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.870594  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c347c14744ddebeb34bf12cec639c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:15.871271  7631 raft_consensus.cc:3060] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.872476  7829 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:15.873000  7829 ts_tablet_manager.cc:1403] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.152s	user 0.006s	sys 0.009s
I20260709 13:01:15.880745  7632 raft_consensus.cc:2468] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:15.882046  7522 leader_election.cc:304] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:15.883333  7830 raft_consensus.cc:2804] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.883838  7830 raft_consensus.cc:697] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:15.884479  7826 raft_consensus.cc:359] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.885771  7826 raft_consensus.cc:385] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.886263  7826 raft_consensus.cc:740] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.876116  7829 raft_consensus.cc:359] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.888672  7824 ts_tablet_manager.cc:1434] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.388s	user 0.019s	sys 0.033s
I20260709 13:01:15.888927  7829 raft_consensus.cc:385] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.889274  7829 raft_consensus.cc:740] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.889331  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:15.889883  7824 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:15.888397  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
W20260709 13:01:15.891978  7523 leader_election.cc:343] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:15.892959  7523 leader_election.cc:343] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.901577  7621 tablet_service.cc:1511] Processing CreateTablet for tablet 557c070427344f13b3df4674a7f5f307 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:15.902177  7829 consensus_queue.cc:260] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:15.902969  7621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557c070427344f13b3df4674a7f5f307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.904552  7829 ts_tablet_manager.cc:1434] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.006s
I20260709 13:01:15.905588  7829 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:15.905663  7615 tablet_service.cc:1511] Processing CreateTablet for tablet 33adb63e12f441f799b0ba5829b6291b (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:15.906973  7615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33adb63e12f441f799b0ba5829b6291b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.884685  7830 consensus_queue.cc:237] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.913597  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c347c14744ddebeb34bf12cec639c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:15.916193  7835 raft_consensus.cc:493] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.916729  7835 raft_consensus.cc:515] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.919013  7835 leader_election.cc:290] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:15.920385  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f635c63a7d4a5c9eab84b42ebe8786" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
W20260709 13:01:15.923918  7746 leader_election.cc:343] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.925374  7850 leader_election.cc:290] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:15.926673  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c347c14744ddebeb34bf12cec639c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
W20260709 13:01:15.928151  7670 leader_election.cc:343] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.932467  7826 consensus_queue.cc:260] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.937309  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c347c14744ddebeb34bf12cec639c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:15.938100  7706 raft_consensus.cc:2393] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate ebe6c341a95a4deda3fd323405e42608 in this term.
I20260709 13:01:15.945231  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f635c63a7d4a5c9eab84b42ebe8786" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:15.945920  7632 raft_consensus.cc:2468] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:15.945721  7544 tablet_service.cc:1511] Processing CreateTablet for tablet 0320ea4b71844851b35b9d1a05a5d2c6 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:15.947074  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0320ea4b71844851b35b9d1a05a5d2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.947243  7745 leader_election.cc:304] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:15.948498  7835 raft_consensus.cc:2804] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.948873  7835 raft_consensus.cc:493] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.949216  7835 raft_consensus.cc:3060] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:15.951165  7596 leader_election.cc:343] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.951651  7596 leader_election.cc:304] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:15.932469  7631 raft_consensus.cc:2468] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:15.957842  7825 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:15.957986  7838 raft_consensus.cc:2749] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.958412  7825 ts_tablet_manager.cc:1403] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.024s
I20260709 13:01:15.961220  7546 tablet_service.cc:1511] Processing CreateTablet for tablet 151ef9b1313942e19ca2a8e43a49ed8c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:15.960668  7766 tablet_service.cc:1511] Processing CreateTablet for tablet cfc999ec44e646bab1cfdf860801548c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:15.962638  7546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ef9b1313942e19ca2a8e43a49ed8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.963008  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc999ec44e646bab1cfdf860801548c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.961481  7671 leader_election.cc:304] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6
I20260709 13:01:15.964058  7696 tablet_service.cc:1511] Processing CreateTablet for tablet 151ef9b1313942e19ca2a8e43a49ed8c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:15.965340  7829 tablet_bootstrap.cc:654] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.965441  7696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ef9b1313942e19ca2a8e43a49ed8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.968067  7850 raft_consensus.cc:2804] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.968833  7850 raft_consensus.cc:697] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:15.969841  7691 tablet_service.cc:1511] Processing CreateTablet for tablet cfc999ec44e646bab1cfdf860801548c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:15.969756  7850 consensus_queue.cc:237] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.974426  7825 raft_consensus.cc:359] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.975168  7825 raft_consensus.cc:385] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.975473  7825 raft_consensus.cc:740] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.976341  7825 consensus_queue.cc:260] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:15.976877  7826 ts_tablet_manager.cc:1434] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.192s	user 0.008s	sys 0.000s
I20260709 13:01:15.968075  7824 tablet_bootstrap.cc:654] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.980610  7770 tablet_service.cc:1511] Processing CreateTablet for tablet e8124d5cf96b48d688ce6481f676f0e7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:15.986709  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc999ec44e646bab1cfdf860801548c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.978224  7835 raft_consensus.cc:515] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:15.994858  7835 leader_election.cc:290] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:15.996130  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f635c63a7d4a5c9eab84b42ebe8786" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:15.997418  7631 raft_consensus.cc:3060] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:15.999431  7670 consensus_peers.cc:597] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 -> Peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Couldn't send request to peer 07d5308b5f834161a9f46b9565fa95e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.996459  7825 ts_tablet_manager.cc:1434] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:01:16.006536  7689 tablet_service.cc:1511] Processing CreateTablet for tablet 443a208ce4b24ce880e010a7916485d4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:16.007702  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 443a208ce4b24ce880e010a7916485d4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:16.000468  7831 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.019714  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 294ddc69dc9b4dcf862a83483747739f (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:16.020773  7619 tablet_service.cc:1511] Processing CreateTablet for tablet cfc999ec44e646bab1cfdf860801548c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:16.025161  7616 tablet_service.cc:1511] Processing CreateTablet for tablet 151ef9b1313942e19ca2a8e43a49ed8c (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:16.025589  7543 tablet_service.cc:1511] Processing CreateTablet for tablet e8124d5cf96b48d688ce6481f676f0e7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:16.026929  7543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8124d5cf96b48d688ce6481f676f0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.028523  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f635c63a7d4a5c9eab84b42ebe8786" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:16.029593  7693 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0b66f27b97469aa22ddc9191bad56d (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:16.031105  7693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0b66f27b97469aa22ddc9191bad56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.031678  7631 raft_consensus.cc:2468] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:16.032903  7745 leader_election.cc:304] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:16.033088  7762 tablet_service.cc:1511] Processing CreateTablet for tablet d666861897c64b54b998b0df834afc31 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:16.033834  7835 raft_consensus.cc:2804] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.015138  7826 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:16.034318  7835 raft_consensus.cc:697] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
W20260709 13:01:16.035198  7746 leader_election.cc:343] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.035681  7848 consensus_queue.cc:1048] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.035508  7835 consensus_queue.cc:237] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:16.034235  7540 tablet_service.cc:1511] Processing CreateTablet for tablet 294ddc69dc9b4dcf862a83483747739f (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:16.033124  7541 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0b66f27b97469aa22ddc9191bad56d (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:16.037949  7540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294ddc69dc9b4dcf862a83483747739f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.040831  7541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0b66f27b97469aa22ddc9191bad56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.044420  7831 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.046670  7831 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.016422  7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8124d5cf96b48d688ce6481f676f0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.050912  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294ddc69dc9b4dcf862a83483747739f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.052032  7545 tablet_service.cc:1511] Processing CreateTablet for tablet d666861897c64b54b998b0df834afc31 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:16.053385  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d666861897c64b54b998b0df834afc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.054244  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:16.055774  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d666861897c64b54b998b0df834afc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.057657  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc999ec44e646bab1cfdf860801548c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.057942  7614 tablet_service.cc:1511] Processing CreateTablet for tablet 443a208ce4b24ce880e010a7916485d4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:16.061275  7613 tablet_service.cc:1511] Processing CreateTablet for tablet 0c0b66f27b97469aa22ddc9191bad56d (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:16.061275  7618 tablet_service.cc:1511] Processing CreateTablet for tablet 294ddc69dc9b4dcf862a83483747739f (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:16.062572  7621 tablet_service.cc:1511] Processing CreateTablet for tablet e8124d5cf96b48d688ce6481f676f0e7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:01:16.065232  7671 leader_election.cc:343] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.065750  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:16.065091  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 6567006f2659467e8fa74d383dddd8c0 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:16.069298  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 6567006f2659467e8fa74d383dddd8c0 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:16.069746  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ef9b1313942e19ca2a8e43a49ed8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.081671  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443a208ce4b24ce880e010a7916485d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.078344  7826 tablet_bootstrap.cc:654] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.089970  7671 leader_election.cc:343] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.091996  7539 tablet_service.cc:1511] Processing CreateTablet for tablet 6567006f2659467e8fa74d383dddd8c0 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:16.082659  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443a208ce4b24ce880e010a7916485d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.095099  7615 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8c8390fe4c4f5f869c4f9bd12d1f72 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:16.071020  7831 raft_consensus.cc:493] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.088120  7825 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:16.114152  7539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6567006f2659467e8fa74d383dddd8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.116482  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6567006f2659467e8fa74d383dddd8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.117667  7694 tablet_service.cc:1511] Processing CreateTablet for tablet c539aa1a1c68405e955915052a212104 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:16.116504  7695 tablet_service.cc:1511] Processing CreateTablet for tablet d666861897c64b54b998b0df834afc31 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:16.119576  7763 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8c8390fe4c4f5f869c4f9bd12d1f72 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:16.120853  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c8390fe4c4f5f869c4f9bd12d1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.116046  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8c8390fe4c4f5f869c4f9bd12d1f72 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:16.123056  7617 tablet_service.cc:1511] Processing CreateTablet for tablet c539aa1a1c68405e955915052a212104 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:01:16.124091  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:16.101533  7671 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:16.123075  7538 tablet_service.cc:1511] Processing CreateTablet for tablet c539aa1a1c68405e955915052a212104 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:16.139379  7538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c539aa1a1c68405e955915052a212104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.105400  7831 raft_consensus.cc:515] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.149919  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6567006f2659467e8fa74d383dddd8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.151345  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c8390fe4c4f5f869c4f9bd12d1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.151242  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:16.153000  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d666861897c64b54b998b0df834afc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.156034  7451 catalog_manager.cc:5697] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.148403  7835 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.160830  7835 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:16.162006  7694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c539aa1a1c68405e955915052a212104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.163293  7835 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:16.163870  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:16.163949  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:16.165074  7829 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
W20260709 13:01:16.165627  7745 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:16.166278  7746 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.166741  7746 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:16.169898  7824 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:16.170423  7824 ts_tablet_manager.cc:1403] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.281s	user 0.009s	sys 0.009s
I20260709 13:01:16.165601  7829 ts_tablet_manager.cc:1403] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.260s	user 0.008s	sys 0.009s
I20260709 13:01:16.174000  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:16.174793  7632 raft_consensus.cc:2393] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe6c341a95a4deda3fd323405e42608 in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:16.176017  7671 leader_election.cc:304] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:16.176855  7831 leader_election.cc:290] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.177680  7831 raft_consensus.cc:3060] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.178406  7848 raft_consensus.cc:2749] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.107429  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443a208ce4b24ce880e010a7916485d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.182150  7835 raft_consensus.cc:2749] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.187466  7829 raft_consensus.cc:359] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.193687  7829 raft_consensus.cc:385] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.193989  7829 raft_consensus.cc:740] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.194795  7622 tablet_service.cc:1511] Processing CreateTablet for tablet a3f93e1711174847b286ab0ede1a21c8 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:16.200984  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 744ab78ecf16420aa63391410de204e2 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:16.202392  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744ab78ecf16420aa63391410de204e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.202210  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 744ab78ecf16420aa63391410de204e2 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:16.203569  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744ab78ecf16420aa63391410de204e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.201987  7766 tablet_service.cc:1511] Processing CreateTablet for tablet a3f93e1711174847b286ab0ede1a21c8 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:16.210736  7544 tablet_service.cc:1511] Processing CreateTablet for tablet 744ab78ecf16420aa63391410de204e2 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:16.212050  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744ab78ecf16420aa63391410de204e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.213392  7542 tablet_service.cc:1511] Processing CreateTablet for tablet a3f93e1711174847b286ab0ede1a21c8 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:16.221107  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f93e1711174847b286ab0ede1a21c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.204689  7615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c8390fe4c4f5f869c4f9bd12d1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.228212  7826 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:16.228816  7826 ts_tablet_manager.cc:1403] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.228s	user 0.014s	sys 0.004s
I20260709 13:01:16.230887  7831 raft_consensus.cc:2749] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.231693  7826 raft_consensus.cc:359] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.236644  7826 raft_consensus.cc:385] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.237015  7826 raft_consensus.cc:740] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.237980  7826 consensus_queue.cc:260] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.242436  7826 ts_tablet_manager.cc:1434] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:16.244565  7622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f93e1711174847b286ab0ede1a21c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.245716  7824 raft_consensus.cc:359] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.252933  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f93e1711174847b286ab0ede1a21c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.265522  7621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8124d5cf96b48d688ce6481f676f0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.280184  7618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294ddc69dc9b4dcf862a83483747739f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.269578  7825 tablet_bootstrap.cc:654] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.286212  7824 raft_consensus.cc:385] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.286615  7824 raft_consensus.cc:740] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.287655  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c0b66f27b97469aa22ddc9191bad56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.287429  7824 consensus_queue.cc:260] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.289891  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 77d1fdbfd5514309bf3e4e212f275ec4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:16.291254  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d1fdbfd5514309bf3e4e212f275ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.291689  7824 ts_tablet_manager.cc:1434] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.121s	user 0.000s	sys 0.009s
I20260709 13:01:16.291826  7617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c539aa1a1c68405e955915052a212104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.277361  7826 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:16.206002  7829 consensus_queue.cc:260] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.277527  7619 tablet_service.cc:1511] Processing CreateTablet for tablet 77d1fdbfd5514309bf3e4e212f275ec4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:16.278507  7545 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5e9a92801e4073b7efd1cf6ec0b299 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:16.285674  7837 consensus_queue.cc:1048] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.294222  7835 raft_consensus.cc:493] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.297642  7835 raft_consensus.cc:515] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.303618  7835 leader_election.cc:290] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.295320  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d1fdbfd5514309bf3e4e212f275ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.312315  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d322269bb5424add8d6df46595372704" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:16.312487  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d322269bb5424add8d6df46595372704" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:16.313222  7556 raft_consensus.cc:2468] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
W20260709 13:01:16.314126  7745 leader_election.cc:343] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.314949  7745 leader_election.cc:304] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:16.316128  7835 raft_consensus.cc:2804] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.316609  7835 raft_consensus.cc:493] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.316848  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5e9a92801e4073b7efd1cf6ec0b299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.317046  7835 raft_consensus.cc:3060] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.332077  7824 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:16.364204  7835 raft_consensus.cc:515] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.365684  7825 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:16.366231  7825 ts_tablet_manager.cc:1403] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.295s	user 0.021s	sys 0.000s
I20260709 13:01:16.366536  7835 leader_election.cc:290] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.376660  7825 raft_consensus.cc:359] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.377526  7825 raft_consensus.cc:385] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.377842  7825 raft_consensus.cc:740] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.378788  7825 consensus_queue.cc:260] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.381896  7825 ts_tablet_manager.cc:1434] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:01:16.383008  7825 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:16.368556  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d322269bb5424add8d6df46595372704" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:16.385275  7556 raft_consensus.cc:3060] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.387612  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3022e4bfdc4b6db39017acd5786020 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:16.368556  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d322269bb5424add8d6df46595372704" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:16.390614  7452 catalog_manager.cc:5697] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:16.391571  7745 leader_election.cc:343] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.388833  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 77d1fdbfd5514309bf3e4e212f275ec4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:16.393465  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d1fdbfd5514309bf3e4e212f275ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.397248  7616 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5e9a92801e4073b7efd1cf6ec0b299 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:01:16.397751  7745 consensus_peers.cc:597] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.398919  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5e9a92801e4073b7efd1cf6ec0b299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.404981  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3022e4bfdc4b6db39017acd5786020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.407145  7848 raft_consensus.cc:493] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.407841  7848 raft_consensus.cc:515] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.470844  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5e9a92801e4073b7efd1cf6ec0b299 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:16.481628  7829 ts_tablet_manager.cc:1434] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.309s	user 0.011s	sys 0.010s
I20260709 13:01:16.428215  7830 consensus_queue.cc:1048] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:01:16.495718  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3022e4bfdc4b6db39017acd5786020 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:16.498556  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3022e4bfdc4b6db39017acd5786020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.502326  7824 tablet_bootstrap.cc:654] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.504963  7829 tablet_bootstrap.cc:492] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:16.507508  7556 raft_consensus.cc:2468] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:16.508877  7745 leader_election.cc:304] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:16.510061  7835 raft_consensus.cc:2804] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.524194  7826 tablet_bootstrap.cc:654] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.538527  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5e9a92801e4073b7efd1cf6ec0b299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.531925  7835 raft_consensus.cc:697] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:16.545547  7692 tablet_service.cc:1511] Processing CreateTablet for tablet daf282a249724a72ab2d1ad22cdc3ebb (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:16.547518  7829 tablet_bootstrap.cc:654] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.552549  7746 consensus_peers.cc:597] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.556504  7825 tablet_bootstrap.cc:654] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.562844  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc981b77d6b8419aaab6827bd0a25275" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:16.565991  7671 leader_election.cc:343] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:16.567652  7440 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 61354.5us
I20260709 13:01:16.568523  7835 consensus_queue.cc:237] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.563663  7848 leader_election.cc:290] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.570097  7767 tablet_service.cc:1511] Processing CreateTablet for tablet daf282a249724a72ab2d1ad22cdc3ebb (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:16.571393  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf282a249724a72ab2d1ad22cdc3ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.572746  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf282a249724a72ab2d1ad22cdc3ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.572873  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc981b77d6b8419aaab6827bd0a25275" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:16.578728  7830 consensus_queue.cc:1048] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:16.577163  7671 leader_election.cc:343] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.583823  7671 leader_election.cc:304] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:16.590330  7831 raft_consensus.cc:2749] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.592079  7826 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:16.592823  7826 ts_tablet_manager.cc:1403] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.316s	user 0.015s	sys 0.002s
W20260709 13:01:16.600214  7670 consensus_peers.cc:597] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 -> Peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Couldn't send request to peer 07d5308b5f834161a9f46b9565fa95e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.604095  7837 consensus_queue.cc:1048] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.604894  7824 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:16.607232  7848 consensus_queue.cc:1048] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.605448  7824 ts_tablet_manager.cc:1403] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.313s	user 0.022s	sys 0.007s
I20260709 13:01:16.613736  7829 tablet_bootstrap.cc:492] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:16.614373  7826 raft_consensus.cc:359] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.632198  7826 raft_consensus.cc:385] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.632683  7826 raft_consensus.cc:740] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.633795  7826 consensus_queue.cc:260] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.626219  7824 raft_consensus.cc:359] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:16.649098  7824 raft_consensus.cc:385] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.649526  7824 raft_consensus.cc:740] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.650554  7824 consensus_queue.cc:260] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:16.654034  7618 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3022e4bfdc4b6db39017acd5786020 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:16.655905  7618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3022e4bfdc4b6db39017acd5786020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.658414  7826 ts_tablet_manager.cc:1434] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:01:16.658720  7838 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.659813  7826 tablet_bootstrap.cc:492] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:16.659461  7838 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.661818  7452 catalog_manager.cc:5697] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.664157  7838 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:16.638561  7829 ts_tablet_manager.cc:1403] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.008s
I20260709 13:01:16.665189  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:16.676381  7825 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:16.676908  7825 ts_tablet_manager.cc:1403] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.294s	user 0.012s	sys 0.007s
I20260709 13:01:16.681295  7453 catalog_manager.cc:5697] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:16.672676  7522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36939, user_credentials={real_user=slave}} blocked reactor thread for 56506.7us
I20260709 13:01:16.697328  7547 tablet_service.cc:1511] Processing CreateTablet for tablet daf282a249724a72ab2d1ad22cdc3ebb (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:01:16.692684  7596 leader_election.cc:343] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.698835  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf282a249724a72ab2d1ad22cdc3ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.699394  7830 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.699892  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 3afadb00ef5e4da3b2bd303cfd85dc7f (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:16.700048  7830 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.701287  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afadb00ef5e4da3b2bd303cfd85dc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.701470  7829 raft_consensus.cc:359] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:16.702234  7829 raft_consensus.cc:385] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.702541  7829 raft_consensus.cc:740] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.703282  7829 consensus_queue.cc:260] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:16.704185  7830 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.716537  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 3afadb00ef5e4da3b2bd303cfd85dc7f (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:16.719173  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afadb00ef5e4da3b2bd303cfd85dc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.726831  7829 ts_tablet_manager.cc:1434] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.006s
I20260709 13:01:16.685827  7825 raft_consensus.cc:359] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.729961  7829 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:16.736835  7838 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.737347  7838 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.738276  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 2299a78017b149c09890c26668ba6fd4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:16.730862  7825 raft_consensus.cc:385] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.740191  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 37832dc21511480f8c27bcc81ccafae7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:16.742139  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37832dc21511480f8c27bcc81ccafae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.739362  7838 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:16.744362  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:16.750276  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:16.750923  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:16.750326  7596 leader_election.cc:343] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.751010  7629 raft_consensus.cc:2468] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:16.753047  7826 tablet_bootstrap.cc:654] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.752928  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 37832dc21511480f8c27bcc81ccafae7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:16.754267  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37832dc21511480f8c27bcc81ccafae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.754169  7616 tablet_service.cc:1511] Processing CreateTablet for tablet 37832dc21511480f8c27bcc81ccafae7 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:16.755537  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37832dc21511480f8c27bcc81ccafae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.756467  7618 tablet_service.cc:1511] Processing CreateTablet for tablet 3afadb00ef5e4da3b2bd303cfd85dc7f (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:16.757699  7618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afadb00ef5e4da3b2bd303cfd85dc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.762588  7824 ts_tablet_manager.cc:1434] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.146s	user 0.011s	sys 0.018s
I20260709 13:01:16.763769  7824 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:16.766104  7522 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:16.767642  7894 raft_consensus.cc:2804] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.768187  7894 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.768604  7894 raft_consensus.cc:3060] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.741374  7825 raft_consensus.cc:740] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.771960  7451 catalog_manager.cc:5697] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.775297  7694 tablet_service.cc:1511] Processing CreateTablet for tablet feaa67cb7a5c4a679797896362fe5996 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:16.777688  7764 tablet_service.cc:1511] Processing CreateTablet for tablet feaa67cb7a5c4a679797896362fe5996 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:01:16.779515  7521 leader_election.cc:343] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.781876  7538 tablet_service.cc:1511] Processing CreateTablet for tablet 2299a78017b149c09890c26668ba6fd4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:16.783188  7538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2299a78017b149c09890c26668ba6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.786990  7544 tablet_service.cc:1511] Processing CreateTablet for tablet feaa67cb7a5c4a679797896362fe5996 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:16.787365  7825 consensus_queue.cc:260] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.788198  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2299a78017b149c09890c26668ba6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.795874  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaa67cb7a5c4a679797896362fe5996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.790470  7621 tablet_service.cc:1511] Processing CreateTablet for tablet f6e898bc5032410ca78cbdab796104c0 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:16.789513  7613 tablet_service.cc:1511] Processing CreateTablet for tablet 2299a78017b149c09890c26668ba6fd4 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:16.788383  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaa67cb7a5c4a679797896362fe5996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.791971  7694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaa67cb7a5c4a679797896362fe5996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.799431  7621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e898bc5032410ca78cbdab796104c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.803874  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2299a78017b149c09890c26668ba6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.804572  7824 tablet_bootstrap.cc:654] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.812848  7895 log.cc:927] Time spent T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:16.799299  7825 ts_tablet_manager.cc:1434] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.122s	user 0.008s	sys 0.000s
I20260709 13:01:16.794912  7894 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.823223  7695 tablet_service.cc:1511] Processing CreateTablet for tablet f6e898bc5032410ca78cbdab796104c0 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:16.825197  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e898bc5032410ca78cbdab796104c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.826112  7826 tablet_bootstrap.cc:492] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:16.826666  7826 ts_tablet_manager.cc:1403] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.003s
I20260709 13:01:16.829741  7826 raft_consensus.cc:359] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:16.830506  7826 raft_consensus.cc:385] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.830835  7826 raft_consensus.cc:740] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.831743  7826 consensus_queue.cc:260] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:16.835048  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
W20260709 13:01:16.836764  7521 leader_election.cc:343] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.846577  7825 tablet_bootstrap.cc:492] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:16.850062  7545 tablet_service.cc:1511] Processing CreateTablet for tablet 2fdcc56ca75e484fabc00af5a9d10bab (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:16.851403  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fdcc56ca75e484fabc00af5a9d10bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.851707  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:16.852355  7631 raft_consensus.cc:3060] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.840026  7829 tablet_bootstrap.cc:654] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.865046  7825 tablet_bootstrap.cc:654] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.847543  7826 ts_tablet_manager.cc:1434] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:01:16.874632  7631 raft_consensus.cc:2468] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:16.876256  7522 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6
I20260709 13:01:16.877280  7896 raft_consensus.cc:2804] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.877784  7896 raft_consensus.cc:697] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:16.878561  7896 consensus_queue.cc:237] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.861316  7894 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:16.882998  7616 tablet_service.cc:1511] Processing CreateTablet for tablet 2fdcc56ca75e484fabc00af5a9d10bab (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:16.884143  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fdcc56ca75e484fabc00af5a9d10bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.901682  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 2fdcc56ca75e484fabc00af5a9d10bab (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:16.903034  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fdcc56ca75e484fabc00af5a9d10bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.903887  7766 tablet_service.cc:1511] Processing CreateTablet for tablet f6e898bc5032410ca78cbdab796104c0 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:16.905237  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e898bc5032410ca78cbdab796104c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.906481  7824 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:16.907011  7824 ts_tablet_manager.cc:1403] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.143s	user 0.004s	sys 0.013s
I20260709 13:01:16.908951  7826 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:16.910094  7824 raft_consensus.cc:359] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.910820  7824 raft_consensus.cc:385] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.911135  7824 raft_consensus.cc:740] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.912012  7892 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.911847  7824 consensus_queue.cc:260] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:16.917044  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 2d70fce73a46409dbc64e66b30cf76fb (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:16.918388  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d70fce73a46409dbc64e66b30cf76fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.918891  7824 ts_tablet_manager.cc:1434] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:01:16.920588  7621 tablet_service.cc:1511] Processing CreateTablet for tablet 2d70fce73a46409dbc64e66b30cf76fb (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:16.921020  7695 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1b18450fa44dabc35d7960e67a0bc (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:16.922271  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1b18450fa44dabc35d7960e67a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.925184  7621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d70fce73a46409dbc64e66b30cf76fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.928427  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 2d70fce73a46409dbc64e66b30cf76fb (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:16.929478  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:16.931555  7597 leader_election.cc:343] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.931998  7597 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:16.933207  7838 raft_consensus.cc:2749] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.934027  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:16.912535  7892 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:16.937007  7824 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:16.938292  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1b18450fa44dabc35d7960e67a0bc (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:16.939608  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1b18450fa44dabc35d7960e67a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.941260  7597 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:16.942468  7838 raft_consensus.cc:2749] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.944001  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d70fce73a46409dbc64e66b30cf76fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.950150  7892 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:16.954174  7826 tablet_bootstrap.cc:654] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.955694  7838 raft_consensus.cc:493] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.955842  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:16.956485  7838 raft_consensus.cc:515] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:16.956969  7780 raft_consensus.cc:2468] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:16.958972  7838 leader_election.cc:290] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:16.959993  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f653b5173b0b42bb869623267b61bfca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:16.963850  7824 tablet_bootstrap.cc:654] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.965824  7598 leader_election.cc:343] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.967312  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f653b5173b0b42bb869623267b61bfca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:16.963617  7521 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:16.968966  7892 raft_consensus.cc:2804] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:01:16.969436  7596 leader_election.cc:343] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.970147  7596 leader_election.cc:304] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:16.971652  7838 raft_consensus.cc:2749] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.969470  7892 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.975419  7892 raft_consensus.cc:3060] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.983146  7545 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1b18450fa44dabc35d7960e67a0bc (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:16.984440  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1b18450fa44dabc35d7960e67a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.993716  7829 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:16.994309  7829 ts_tablet_manager.cc:1403] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.267s	user 0.024s	sys 0.004s
I20260709 13:01:16.998104  7829 raft_consensus.cc:359] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:16.998857  7829 raft_consensus.cc:385] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.999171  7829 raft_consensus.cc:740] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.999959  7829 consensus_queue.cc:260] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.006803  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.006661  7892 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.008876  7892 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
W20260709 13:01:17.011174  7523 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.013048  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
W20260709 13:01:17.014420  7523 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:17.016650  7745 consensus_peers.cc:597] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:17.018982  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:17.019647  7780 raft_consensus.cc:3060] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.019812  7451 catalog_manager.cc:5697] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.021229  7829 ts_tablet_manager.cc:1434] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:01:17.022956  7829 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.029429  7829 tablet_bootstrap.cc:654] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.028954  7621 tablet_service.cc:1511] Processing CreateTablet for tablet 78cabd51630341128537276b69e1d771 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:17.033249  7694 tablet_service.cc:1511] Processing CreateTablet for tablet 78cabd51630341128537276b69e1d771 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:17.037079  7824 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.037467  7831 raft_consensus.cc:493] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.045313  7824 ts_tablet_manager.cc:1403] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.011s
I20260709 13:01:17.045770  7831 raft_consensus.cc:515] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.048501  7694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cabd51630341128537276b69e1d771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.051132  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.053045  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:17.055516  7671 leader_election.cc:343] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:17.056504  7671 leader_election.cc:343] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.057078  7671 leader_election.cc:304] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:17.057928  7831 leader_election.cc:290] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:17.058718  7848 raft_consensus.cc:2749] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.059567  7824 raft_consensus.cc:359] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.060763  7824 raft_consensus.cc:385] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.061237  7824 raft_consensus.cc:740] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.062433  7824 consensus_queue.cc:260] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.065353  7824 ts_tablet_manager.cc:1434] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:01:17.070878  7824 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:17.071807  7621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cabd51630341128537276b69e1d771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.082428  7779 raft_consensus.cc:3060] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.083657  7824 tablet_bootstrap.cc:654] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.091670  7826 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:17.092402  7826 ts_tablet_manager.cc:1403] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.002s
I20260709 13:01:17.095594  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 61892e5f699c46bbb647be64c3a48f96 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:17.097007  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61892e5f699c46bbb647be64c3a48f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.097028  7826 raft_consensus.cc:359] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.097965  7826 raft_consensus.cc:385] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.097819  7613 tablet_service.cc:1511] Processing CreateTablet for tablet 61892e5f699c46bbb647be64c3a48f96 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:17.098315  7826 raft_consensus.cc:740] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.099182  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61892e5f699c46bbb647be64c3a48f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.099020  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 78cabd51630341128537276b69e1d771 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:17.099241  7826 consensus_queue.cc:260] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.100508  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cabd51630341128537276b69e1d771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.075455  7780 raft_consensus.cc:2468] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:17.117911  7521 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:17.118834  7892 raft_consensus.cc:2804] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.119379  7892 raft_consensus.cc:697] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:17.120195  7892 consensus_queue.cc:237] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.123818  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 524dfa0cdc7644fbad395fedf8b39c67 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:17.125222  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524dfa0cdc7644fbad395fedf8b39c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.129540  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 524dfa0cdc7644fbad395fedf8b39c67 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:17.130168  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 61892e5f699c46bbb647be64c3a48f96 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:17.131421  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524dfa0cdc7644fbad395fedf8b39c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.131951  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61892e5f699c46bbb647be64c3a48f96. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:17.136090  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:17.121675  7826 ts_tablet_manager.cc:1434] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:01:17.151134  7826 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:17.156565  7825 tablet_bootstrap.cc:492] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.156710  7884 consensus_queue.cc:1048] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.157258  7825 ts_tablet_manager.cc:1403] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.336s	user 0.030s	sys 0.038s
I20260709 13:01:17.159741  7829 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.160353  7829 ts_tablet_manager.cc:1403] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.138s	user 0.036s	sys 0.040s
I20260709 13:01:17.160158  7825 raft_consensus.cc:359] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.160943  7825 raft_consensus.cc:385] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.161216  7825 raft_consensus.cc:740] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.161960  7825 consensus_queue.cc:260] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.168113  7829 raft_consensus.cc:359] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.168937  7829 raft_consensus.cc:385] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.169221  7829 raft_consensus.cc:740] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.169588  7825 ts_tablet_manager.cc:1434] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:17.170075  7829 consensus_queue.cc:260] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.170635  7825 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.172690  7829 ts_tablet_manager.cc:1434] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:01:17.174634  7829 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.186533  7826 tablet_bootstrap.cc:654] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.193339  7451 catalog_manager.cc:5697] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.196599  7825 tablet_bootstrap.cc:654] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.187345  7829 tablet_bootstrap.cc:654] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.211743  7829 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.211565  7613 tablet_service.cc:1511] Processing CreateTablet for tablet 524dfa0cdc7644fbad395fedf8b39c67 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:17.212464  7829 ts_tablet_manager.cc:1403] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
I20260709 13:01:17.213274  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524dfa0cdc7644fbad395fedf8b39c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.216280  7829 raft_consensus.cc:359] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.220711  7691 tablet_service.cc:1511] Processing CreateTablet for tablet 94b58c7b55d3458f90d62cb7cd4491f3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:17.222014  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b58c7b55d3458f90d62cb7cd4491f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.222610  7824 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.223086  7824 ts_tablet_manager.cc:1403] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.028s
I20260709 13:01:17.225698  7824 raft_consensus.cc:359] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.226361  7824 raft_consensus.cc:385] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.226627  7824 raft_consensus.cc:740] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.227276  7824 consensus_queue.cc:260] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.229081  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 94b58c7b55d3458f90d62cb7cd4491f3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:17.229562  7824 ts_tablet_manager.cc:1434] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:01:17.230443  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b58c7b55d3458f90d62cb7cd4491f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.230553  7824 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:17.231446  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 94b58c7b55d3458f90d62cb7cd4491f3 (DEFAULT_TABLE table=test-workload [id=59c7f38ec4ab421483d7952519a80e3c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:17.232563  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b58c7b55d3458f90d62cb7cd4491f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:17.236725  7824 tablet_bootstrap.cc:654] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.217512  7829 raft_consensus.cc:385] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.239739  7829 raft_consensus.cc:740] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.240463  7829 consensus_queue.cc:260] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.244885  7829 ts_tablet_manager.cc:1434] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:01:17.245831  7829 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.250224  7825 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.250770  7825 ts_tablet_manager.cc:1403] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.001s
I20260709 13:01:17.251516  7829 tablet_bootstrap.cc:654] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.253410  7826 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:17.253887  7826 ts_tablet_manager.cc:1403] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.103s	user 0.005s	sys 0.016s
I20260709 13:01:17.257351  7831 raft_consensus.cc:493] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.258038  7831 raft_consensus.cc:515] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.260385  7825 raft_consensus.cc:359] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.261080  7825 raft_consensus.cc:385] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.261344  7825 raft_consensus.cc:740] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.261538  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f635c63a7d4a5c9eab84b42ebe8786" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.262013  7825 consensus_queue.cc:260] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.262804  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f635c63a7d4a5c9eab84b42ebe8786" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:17.264008  7825 ts_tablet_manager.cc:1434] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:01:17.265003  7825 tablet_bootstrap.cc:492] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.268520  7670 leader_election.cc:304] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.269619  7848 raft_consensus.cc:2749] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.270493  7831 leader_election.cc:290] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:17.257354  7826 raft_consensus.cc:359] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.271868  7892 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.272249  7826 raft_consensus.cc:385] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.272666  7826 raft_consensus.cc:740] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.272461  7892 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.274644  7892 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.276273  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.276582  7826 consensus_queue.cc:260] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
W20260709 13:01:17.277875  7522 leader_election.cc:343] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.278919  7825 tablet_bootstrap.cc:654] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.279691  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.280409  7705 raft_consensus.cc:2468] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:17.281826  7523 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.283632  7838 raft_consensus.cc:493] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.284309  7838 raft_consensus.cc:515] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.287046  7838 leader_election.cc:290] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.288853  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc981b77d6b8419aaab6827bd0a25275" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.289264  7892 raft_consensus.cc:2804] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.289542  7557 raft_consensus.cc:2468] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:17.289892  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc981b77d6b8419aaab6827bd0a25275" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.289670  7892 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.290716  7705 raft_consensus.cc:2468] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:17.292479  7598 leader_election.cc:304] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:17.293079  7825 tablet_bootstrap.cc:492] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.293576  7825 ts_tablet_manager.cc:1403] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.001s
I20260709 13:01:17.290743  7892 raft_consensus.cc:3060] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.296473  7825 raft_consensus.cc:359] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.297199  7825 raft_consensus.cc:385] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.297492  7825 raft_consensus.cc:740] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.297825  7896 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.298290  7896 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.298214  7825 consensus_queue.cc:260] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.300768  7825 ts_tablet_manager.cc:1434] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:17.301411  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:17.301707  7825 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.302068  7779 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:17.303409  7521 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:17.304354  7826 ts_tablet_manager.cc:1434] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.004s
I20260709 13:01:17.304500  7829 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.305004  7829 ts_tablet_manager.cc:1403] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.005s
I20260709 13:01:17.305274  7896 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:17.306986  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.307686  7630 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:17.307606  7829 raft_consensus.cc:359] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.308400  7829 raft_consensus.cc:385] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.308686  7829 raft_consensus.cc:740] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.309353  7825 tablet_bootstrap.cc:654] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.309458  7829 consensus_queue.cc:260] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.311806  7829 ts_tablet_manager.cc:1434] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:17.312703  7829 tablet_bootstrap.cc:492] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.304265  7894 raft_consensus.cc:2804] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.313360  7894 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.313844  7894 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.318342  7829 tablet_bootstrap.cc:654] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.319280  7826 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:17.327116  7826 tablet_bootstrap.cc:654] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.332751  7838 raft_consensus.cc:2804] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.333397  7838 raft_consensus.cc:493] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.337718  7829 tablet_bootstrap.cc:492] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.338265  7829 ts_tablet_manager.cc:1403] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:01:17.339135  7892 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.341075  7829 raft_consensus.cc:359] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.341640  7892 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.341785  7829 raft_consensus.cc:385] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.333963  7838 raft_consensus.cc:3060] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.342362  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
W20260709 13:01:17.343780  7522 leader_election.cc:343] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.345796  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:17.346357  7835 raft_consensus.cc:493] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.346526  7705 raft_consensus.cc:3060] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.342125  7829 raft_consensus.cc:740] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.346903  7835 raft_consensus.cc:515] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.347966  7829 consensus_queue.cc:260] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.349290  7835 leader_election.cc:290] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:17.353242  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1633ca6bd2346cbbca54b2fd74b21a3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.355407  7829 ts_tablet_manager.cc:1434] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:01:17.356321  7824 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.356791  7824 ts_tablet_manager.cc:1403] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.031s
I20260709 13:01:17.363209  7894 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.363729  7835 raft_consensus.cc:493] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.359625  7831 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.364212  7835 raft_consensus.cc:515] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.364790  7831 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.366389  7835 leader_election.cc:290] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.366775  7831 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:17.370918  7894 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:17.370671  7838 raft_consensus.cc:515] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.371251  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f653b5173b0b42bb869623267b61bfca" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.371840  7630 raft_consensus.cc:2468] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:17.373003  7824 raft_consensus.cc:359] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.373536  7838 leader_election.cc:290] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.373721  7824 raft_consensus.cc:385] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.373046  7745 leader_election.cc:304] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:17.374295  7824 raft_consensus.cc:740] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.375182  7835 raft_consensus.cc:2804] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.376554  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:17.376941  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1633ca6bd2346cbbca54b2fd74b21a3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.377175  7779 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.377586  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:17.377733  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f653b5173b0b42bb869623267b61bfca" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.378364  7780 raft_consensus.cc:2393] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe6c341a95a4deda3fd323405e42608 in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:17.378643  7746 leader_election.cc:304] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:17.380028  7887 raft_consensus.cc:2749] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.380415  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:17.380676  7829 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.381026  7630 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.381315  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc981b77d6b8419aaab6827bd0a25275" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:17.381882  7706 raft_consensus.cc:3060] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.375618  7835 raft_consensus.cc:493] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.382773  7835 raft_consensus.cc:3060] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.375262  7824 consensus_queue.cc:260] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.389827  7824 ts_tablet_manager.cc:1434] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:01:17.389755  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.380734  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc981b77d6b8419aaab6827bd0a25275" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:17.378440  7704 raft_consensus.cc:2468] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:17.393409  7557 raft_consensus.cc:3060] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.394699  7703 raft_consensus.cc:3060] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.392765  7671 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:17.396777  7831 raft_consensus.cc:3060] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.396792  7705 raft_consensus.cc:2468] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:17.398981  7824 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:17.401847  7523 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.402978  7892 raft_consensus.cc:2804] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.402343  7835 raft_consensus.cc:515] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.404002  7892 raft_consensus.cc:697] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:17.406579  7892 consensus_queue.cc:237] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.407874  7835 leader_election.cc:290] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.410233  7824 tablet_bootstrap.cc:654] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.412004  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f653b5173b0b42bb869623267b61bfca" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:17.412715  7632 raft_consensus.cc:3060] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.418073  7829 tablet_bootstrap.cc:654] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.419816  7825 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.420511  7825 ts_tablet_manager.cc:1403] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.119s	user 0.048s	sys 0.010s
I20260709 13:01:17.424769  7835 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.400695  7894 raft_consensus.cc:493] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.425482  7835 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.429287  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.425779  7894 raft_consensus.cc:515] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.435921  7835 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:17.423947  7557 raft_consensus.cc:2468] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:17.443353  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.445250  7778 raft_consensus.cc:3060] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.452780  7631 raft_consensus.cc:2393] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07d5308b5f834161a9f46b9565fa95e6 in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:17.438759  7780 raft_consensus.cc:3060] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.454789  7825 raft_consensus.cc:359] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.455488  7825 raft_consensus.cc:385] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.455756  7825 raft_consensus.cc:740] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.456548  7825 consensus_queue.cc:260] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.456938  7745 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:17.459089  7825 ts_tablet_manager.cc:1434] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:01:17.444774  7826 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:17.459779  7826 ts_tablet_manager.cc:1403] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.141s	user 0.023s	sys 0.017s
I20260709 13:01:17.460058  7825 tablet_bootstrap.cc:492] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.462759  7826 raft_consensus.cc:359] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.466434  7825 tablet_bootstrap.cc:654] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.471131  7826 raft_consensus.cc:385] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.469421  7835 raft_consensus.cc:2749] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.447643  7632 raft_consensus.cc:2468] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:17.471663  7826 raft_consensus.cc:740] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.470721  7631 raft_consensus.cc:3060] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.472846  7892 consensus_queue.cc:1048] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.440366  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f653b5173b0b42bb869623267b61bfca" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:17.470481  7779 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:17.479682  7454 catalog_manager.cc:5697] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.482860  7892 consensus_queue.cc:1048] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.483340  7521 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:17.484335  7896 raft_consensus.cc:2804] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.484594  7826 consensus_queue.cc:260] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.487032  7831 raft_consensus.cc:2749] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.494323  7826 ts_tablet_manager.cc:1434] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.006s
I20260709 13:01:17.495055  7826 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:17.491791  7745 leader_election.cc:304] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:17.487907  7705 raft_consensus.cc:3060] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.502884  7597 leader_election.cc:304] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:17.505515  7630 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:17.506018  7829 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.507046  7887 raft_consensus.cc:2804] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.507416  7829 ts_tablet_manager.cc:1403] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.009s
I20260709 13:01:17.507597  7887 raft_consensus.cc:697] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:17.508335  7838 raft_consensus.cc:2804] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.495738  7706 raft_consensus.cc:2468] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:17.508560  7887 consensus_queue.cc:237] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.517513  7829 raft_consensus.cc:359] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.520285  7829 raft_consensus.cc:385] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.511832  7896 raft_consensus.cc:697] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:17.525624  7896 consensus_queue.cc:237] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.522727  7829 raft_consensus.cc:740] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.531473  7829 consensus_queue.cc:260] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.534006  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.536150  7824 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.536686  7824 ts_tablet_manager.cc:1403] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.143s	user 0.030s	sys 0.019s
I20260709 13:01:17.537096  7838 raft_consensus.cc:697] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:17.542131  7829 ts_tablet_manager.cc:1434] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:01:17.533325  7894 leader_election.cc:290] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:17.544101  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:17.545204  7826 tablet_bootstrap.cc:654] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.546989  7829 tablet_bootstrap.cc:492] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.546200  7521 leader_election.cc:304] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:17.562045  7848 raft_consensus.cc:493] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.562608  7848 raft_consensus.cc:515] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.559597  7824 raft_consensus.cc:359] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.564783  7824 raft_consensus.cc:385] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.565274  7824 raft_consensus.cc:740] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.567729  7829 tablet_bootstrap.cc:654] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.567919  7824 consensus_queue.cc:260] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.573609  7848 leader_election.cc:290] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:17.574859  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3cae1107da44f5af6f20b55687be66" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.575364  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3cae1107da44f5af6f20b55687be66" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:17.575999  7779 raft_consensus.cc:2468] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
W20260709 13:01:17.576552  7671 leader_election.cc:343] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.585378  7670 leader_election.cc:304] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:17.586270  7848 raft_consensus.cc:2804] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.558073  7894 raft_consensus.cc:2749] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.587570  7824 ts_tablet_manager.cc:1434] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:01:17.589313  7824 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:17.586668  7848 raft_consensus.cc:493] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.592860  7848 raft_consensus.cc:3060] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.593257  7557 raft_consensus.cc:3060] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.609223  7934 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.609977  7934 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.586910  7838 consensus_queue.cc:237] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.621484  7825 tablet_bootstrap.cc:492] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.622237  7825 ts_tablet_manager.cc:1403] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.020s
I20260709 13:01:17.642081  7825 raft_consensus.cc:359] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.643065  7825 raft_consensus.cc:385] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.643417  7825 raft_consensus.cc:740] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.648783  7825 consensus_queue.cc:260] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.651410  7934 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.654666  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.656291  7703 raft_consensus.cc:2393] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:17.656701  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.657130  7825 ts_tablet_manager.cc:1434] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:01:17.658108  7825 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.644797  7451 catalog_manager.cc:5697] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.661434  7826 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:17.661948  7826 ts_tablet_manager.cc:1403] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.028s
I20260709 13:01:17.664170  7597 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:17.665468  7934 raft_consensus.cc:3060] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.643936  7453 catalog_manager.cc:5697] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.671655  7705 raft_consensus.cc:2468] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:17.674533  7934 raft_consensus.cc:2749] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.675889  7824 tablet_bootstrap.cc:654] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.640262  7848 raft_consensus.cc:515] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.686657  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3cae1107da44f5af6f20b55687be66" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:17.686841  7929 raft_consensus.cc:493] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.687301  7780 raft_consensus.cc:3060] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.687536  7929 raft_consensus.cc:515] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.688980  7848 leader_election.cc:290] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:17.690357  7929 leader_election.cc:290] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:17.691593  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:17.695731  7670 leader_election.cc:343] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.692559  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.684315  7826 raft_consensus.cc:359] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.692781  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3cae1107da44f5af6f20b55687be66" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:17.697592  7671 leader_election.cc:343] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.698796  7671 leader_election.cc:304] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.699605  7825 tablet_bootstrap.cc:654] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:17.700060  7671 leader_election.cc:343] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.698133  7826 raft_consensus.cc:385] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.701341  7826 raft_consensus.cc:740] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.700825  7848 raft_consensus.cc:2749] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.702103  7826 consensus_queue.cc:260] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.707993  7896 consensus_queue.cc:1048] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.708415  7829 tablet_bootstrap.cc:492] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.711835  7829 ts_tablet_manager.cc:1403] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.169s	user 0.024s	sys 0.000s
I20260709 13:01:17.714385  7780 raft_consensus.cc:2468] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:17.715827  7670 leader_election.cc:304] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:17.723493  7831 raft_consensus.cc:2804] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.723393  7829 raft_consensus.cc:359] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.724325  7829 raft_consensus.cc:385] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.724659  7829 raft_consensus.cc:740] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.729285  7831 raft_consensus.cc:697] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:17.730430  7831 consensus_queue.cc:237] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.732355  7824 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.733028  7835 raft_consensus.cc:493] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.733772  7835 raft_consensus.cc:515] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.735466  7829 consensus_queue.cc:260] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.737633  7829 ts_tablet_manager.cc:1434] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:01:17.733001  7824 ts_tablet_manager.cc:1403] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.018s
I20260709 13:01:17.738778  7835 leader_election.cc:290] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:17.726982  7826 ts_tablet_manager.cc:1434] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 13:01:17.741354  7829 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.741578  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.742280  7453 catalog_manager.cc:5697] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.745361  7824 raft_consensus.cc:359] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.746044  7824 raft_consensus.cc:385] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.746297  7824 raft_consensus.cc:740] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.747030  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:17.748636  7745 leader_election.cc:343] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.742269  7557 raft_consensus.cc:2468] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:17.749876  7826 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:17.753086  7745 leader_election.cc:304] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.753718  7829 tablet_bootstrap.cc:654] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.754525  7896 consensus_queue.cc:1048] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.757068  7835 raft_consensus.cc:2804] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.750435  7824 consensus_queue.cc:260] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.757517  7835 raft_consensus.cc:493] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.758031  7835 raft_consensus.cc:3060] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.759428  7824 ts_tablet_manager.cc:1434] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
I20260709 13:01:17.760425  7824 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:17.767582  7824 tablet_bootstrap.cc:654] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.773972  7826 tablet_bootstrap.cc:654] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.782775  7835 raft_consensus.cc:515] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.785284  7835 leader_election.cc:290] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:17.790975  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:17.791114  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:17.791687  7557 raft_consensus.cc:3060] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.793135  7745 leader_election.cc:343] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.803654  7825 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.804406  7825 ts_tablet_manager.cc:1403] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.017s
I20260709 13:01:17.810446  7557 raft_consensus.cc:2468] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:17.807971  7825 raft_consensus.cc:359] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.812614  7745 leader_election.cc:304] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.812888  7896 consensus_queue.cc:1048] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.814364  7928 consensus_queue.cc:1048] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.811146  7452 catalog_manager.cc:5697] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.812666  7825 raft_consensus.cc:385] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.817978  7825 raft_consensus.cc:740] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.819190  7825 consensus_queue.cc:260] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.824451  7826 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:17.824576  7825 ts_tablet_manager.cc:1434] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:01:17.825165  7826 ts_tablet_manager.cc:1403] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.006s
I20260709 13:01:17.825964  7825 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.828197  7826 raft_consensus.cc:359] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.829071  7826 raft_consensus.cc:385] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.829352  7826 raft_consensus.cc:740] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.829526  7829 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.830103  7829 ts_tablet_manager.cc:1403] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.089s	user 0.005s	sys 0.017s
I20260709 13:01:17.830152  7826 consensus_queue.cc:260] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.818423  7835 raft_consensus.cc:2804] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.831615  7835 raft_consensus.cc:697] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:17.832731  7825 tablet_bootstrap.cc:654] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.832564  7835 consensus_queue.cc:237] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.835731  7826 ts_tablet_manager.cc:1434] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:01:17.836776  7829 raft_consensus.cc:359] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.837492  7829 raft_consensus.cc:385] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.837779  7829 raft_consensus.cc:740] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.838474  7829 consensus_queue.cc:260] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.836802  7826 tablet_bootstrap.cc:492] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:17.844417  7824 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.845108  7824 ts_tablet_manager.cc:1403] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.006s
I20260709 13:01:17.847133  7824 raft_consensus.cc:359] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.847630  7824 raft_consensus.cc:385] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.847863  7824 raft_consensus.cc:740] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.848627  7824 consensus_queue.cc:260] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.849080  7928 raft_consensus.cc:493] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.849817  7928 raft_consensus.cc:515] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.852399  7825 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.852885  7825 ts_tablet_manager.cc:1403] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.007s
I20260709 13:01:17.854010  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.854645  7705 raft_consensus.cc:2468] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:17.856200  7825 raft_consensus.cc:359] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:17.856870  7825 raft_consensus.cc:385] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.857614  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.858261  7629 raft_consensus.cc:2468] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:17.859454  7522 leader_election.cc:304] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:17.857107  7825 raft_consensus.cc:740] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.860980  7896 raft_consensus.cc:2804] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.861388  7896 raft_consensus.cc:493] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.861722  7896 raft_consensus.cc:3060] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.852041  7928 leader_election.cc:290] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.863369  7453 catalog_manager.cc:5697] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.869313  7824 ts_tablet_manager.cc:1434] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:01:17.869221  7896 raft_consensus.cc:515] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.870757  7824 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:17.872203  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:17.872817  7629 raft_consensus.cc:3060] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.876439  7826 tablet_bootstrap.cc:654] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.882380  7837 raft_consensus.cc:493] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.882968  7837 raft_consensus.cc:515] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.885391  7837 leader_election.cc:290] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.887470  7629 raft_consensus.cc:2468] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:17.889739  7824 tablet_bootstrap.cc:654] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.890192  7829 ts_tablet_manager.cc:1434] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.006s
I20260709 13:01:17.891307  7829 tablet_bootstrap.cc:492] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:17.897604  7829 tablet_bootstrap.cc:654] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.898248  7887 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.898790  7887 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:17.899641  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.900832  7887 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
W20260709 13:01:17.902642  7745 leader_election.cc:343] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.903882  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:17.903988  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:17.904580  7703 raft_consensus.cc:2468] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:17.900866  7522 leader_election.cc:304] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:17.906132  7894 raft_consensus.cc:2804] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.906605  7746 leader_election.cc:304] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.906858  7894 raft_consensus.cc:697] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:17.896971  7825 consensus_queue.cc:260] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
W20260709 13:01:17.907091  7745 leader_election.cc:343] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.907755  7894 consensus_queue.cc:237] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.908406  7887 raft_consensus.cc:2804] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.908803  7887 raft_consensus.cc:493] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.909128  7887 raft_consensus.cc:3060] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.909513  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:17.909933  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:17.910179  7703 raft_consensus.cc:3060] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.911422  7745 leader_election.cc:343] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.911917  7745 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:17.913005  7896 leader_election.cc:290] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.909890  7825 ts_tablet_manager.cc:1434] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:01:17.914861  7825 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.920044  7703 raft_consensus.cc:2468] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:17.915217  7837 raft_consensus.cc:2749] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.917260  7887 raft_consensus.cc:515] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.933147  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:17.933280  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:17.933823  7703 raft_consensus.cc:3060] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.935273  7745 leader_election.cc:343] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.930258  7826 tablet_bootstrap.cc:492] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:17.940461  7826 ts_tablet_manager.cc:1403] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.004s
I20260709 13:01:17.942147  7825 tablet_bootstrap.cc:654] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.944347  7826 raft_consensus.cc:359] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.939898  7887 leader_election.cc:290] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:17.945112  7826 raft_consensus.cc:385] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.945513  7826 raft_consensus.cc:740] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.946282  7826 consensus_queue.cc:260] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.949055  7824 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:17.949584  7824 ts_tablet_manager.cc:1403] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.006s
I20260709 13:01:17.949628  7703 raft_consensus.cc:2468] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:17.950836  7746 leader_election.cc:304] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:17.951996  7887 raft_consensus.cc:2804] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.953284  7887 raft_consensus.cc:697] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:17.953567  7826 ts_tablet_manager.cc:1434] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:17.954308  7887 consensus_queue.cc:237] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:17.955498  7826 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:17.957412  7455 catalog_manager.cc:5697] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.962190  7894 consensus_queue.cc:1048] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.963997  7826 tablet_bootstrap.cc:654] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.970541  7894 consensus_queue.cc:1048] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.971280  7825 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:17.971097  7837 consensus_queue.cc:1048] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.971827  7825 ts_tablet_manager.cc:1403] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.003s
I20260709 13:01:17.974716  7825 raft_consensus.cc:359] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.975404  7825 raft_consensus.cc:385] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.975689  7825 raft_consensus.cc:740] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.976423  7825 consensus_queue.cc:260] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.978907  7825 ts_tablet_manager.cc:1434] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:17.952196  7824 raft_consensus.cc:359] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.980978  7824 raft_consensus.cc:385] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.981338  7824 raft_consensus.cc:740] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.983086  7825 tablet_bootstrap.cc:492] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:17.984522  7824 consensus_queue.cc:260] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:17.984678  7455 catalog_manager.cc:5697] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.992158  7825 tablet_bootstrap.cc:654] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.996791  7829 tablet_bootstrap.cc:492] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:17.997892  7829 ts_tablet_manager.cc:1403] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.012s
I20260709 13:01:17.999177  7838 consensus_queue.cc:1048] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.000756  7829 raft_consensus.cc:359] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.003414  7829 raft_consensus.cc:385] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.004002  7829 raft_consensus.cc:740] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.004937  7829 consensus_queue.cc:260] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.009569  7825 tablet_bootstrap.cc:492] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:18.014598  7825 ts_tablet_manager.cc:1403] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.011s
I20260709 13:01:18.017334  7825 raft_consensus.cc:359] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.018035  7825 raft_consensus.cc:385] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.018311  7825 raft_consensus.cc:740] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.019165  7825 consensus_queue.cc:260] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.021600  7826 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.022186  7826 ts_tablet_manager.cc:1403] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.018s
I20260709 13:01:18.023702  7829 ts_tablet_manager.cc:1434] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:01:18.025195  7826 raft_consensus.cc:359] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.027737  7826 raft_consensus.cc:385] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.028108  7826 raft_consensus.cc:740] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.028644  7829 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.028827  7826 consensus_queue.cc:260] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.001546  7824 ts_tablet_manager.cc:1434] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:01:18.030449  7824 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:18.030983  7826 ts_tablet_manager.cc:1434] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:18.027690  7825 ts_tablet_manager.cc:1434] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:01:18.035493  7837 consensus_queue.cc:1048] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.043372  7825 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:18.045209  7838 consensus_queue.cc:1048] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.040093  7829 tablet_bootstrap.cc:654] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.049634  7825 tablet_bootstrap.cc:654] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.053108  7838 raft_consensus.cc:493] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.053807  7838 raft_consensus.cc:515] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.056792  7831 raft_consensus.cc:493] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.057081  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.057345  7831 raft_consensus.cc:515] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.057917  7704 raft_consensus.cc:2393] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:18.059412  7831 leader_election.cc:290] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.059746  7826 tablet_bootstrap.cc:492] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.061802  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed0433b495a4adab9c75e40ec020b60" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.062562  7557 raft_consensus.cc:2468] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:18.063277  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f242eb526cd4973918a7293d825cbbe" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.063771  7671 leader_election.cc:304] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:18.065086  7831 raft_consensus.cc:2804] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.065562  7831 raft_consensus.cc:493] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.065987  7831 raft_consensus.cc:3060] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.064939  7596 leader_election.cc:304] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:18.066713  7826 tablet_bootstrap.cc:654] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.066962  7934 raft_consensus.cc:3060] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.083508  7929 raft_consensus.cc:493] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.084309  7929 raft_consensus.cc:515] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.084923  7934 raft_consensus.cc:2749] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.086643  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed0433b495a4adab9c75e40ec020b60" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:18.087215  7838 leader_election.cc:290] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:18.088200  7929 leader_election.cc:290] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.088779  7631 raft_consensus.cc:2468] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:18.093676  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821c72ad05541a680bf7e51256d96c5" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:18.095181  7670 leader_election.cc:343] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.095607  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821c72ad05541a680bf7e51256d96c5" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.098196  7831 raft_consensus.cc:515] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
W20260709 13:01:18.098393  7671 leader_election.cc:343] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.099371  7671 leader_election.cc:304] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.100193  7929 raft_consensus.cc:2749] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.100529  7831 leader_election.cc:290] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.102365  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed0433b495a4adab9c75e40ec020b60" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:18.102926  7829 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:18.103016  7556 raft_consensus.cc:3060] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.103518  7829 ts_tablet_manager.cc:1403] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.003s
I20260709 13:01:18.106366  7829 raft_consensus.cc:359] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.107031  7829 raft_consensus.cc:385] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.107316  7829 raft_consensus.cc:740] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.108330  7829 consensus_queue.cc:260] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.110574  7829 ts_tablet_manager.cc:1434] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:18.111047  7556 raft_consensus.cc:2468] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:18.111518  7829 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.064038  7824 tablet_bootstrap.cc:654] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.113276  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed0433b495a4adab9c75e40ec020b60" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:18.114018  7631 raft_consensus.cc:3060] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.120193  7671 leader_election.cc:304] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:18.121222  7929 raft_consensus.cc:2804] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.121697  7929 raft_consensus.cc:697] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:18.122519  7929 consensus_queue.cc:237] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.142318  7829 tablet_bootstrap.cc:654] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.155612  7825 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:18.156175  7825 ts_tablet_manager.cc:1403] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.113s	user 0.022s	sys 0.056s
I20260709 13:01:18.160751  7825 raft_consensus.cc:359] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.161469  7825 raft_consensus.cc:385] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.161767  7825 raft_consensus.cc:740] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.162415  7825 consensus_queue.cc:260] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.164562  7825 ts_tablet_manager.cc:1434] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:18.165580  7825 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:18.166697  7826 tablet_bootstrap.cc:492] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.167320  7826 ts_tablet_manager.cc:1403] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.108s	user 0.032s	sys 0.027s
I20260709 13:01:18.171206  7894 raft_consensus.cc:493] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.171178  7826 raft_consensus.cc:359] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.172003  7894 raft_consensus.cc:515] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.172721  7826 raft_consensus.cc:385] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.173269  7826 raft_consensus.cc:740] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.174337  7826 consensus_queue.cc:260] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.176049  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3cae1107da44f5af6f20b55687be66" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.176057  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3cae1107da44f5af6f20b55687be66" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.178013  7780 raft_consensus.cc:2393] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate ebe6c341a95a4deda3fd323405e42608 in this term.
I20260709 13:01:18.178392  7824 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:18.178884  7824 ts_tablet_manager.cc:1403] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.000s
I20260709 13:01:18.180078  7894 leader_election.cc:290] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:18.180991  7826 ts_tablet_manager.cc:1434] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:01:18.181003  7934 raft_consensus.cc:493] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.182121  7826 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.181917  7934 raft_consensus.cc:515] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.182384  7829 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:18.182888  7829 ts_tablet_manager.cc:1403] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.004s
I20260709 13:01:18.187925  7825 tablet_bootstrap.cc:654] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.187356  7824 raft_consensus.cc:359] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.181438  7521 leader_election.cc:304] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:18.189791  7824 raft_consensus.cc:385] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.190143  7824 raft_consensus.cc:740] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.191084  7826 tablet_bootstrap.cc:654] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.190822  7824 consensus_queue.cc:260] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.190894  7452 catalog_manager.cc:5697] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.194175  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba54050b634067a6e55c28cfa270ba" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.194389  7631 raft_consensus.cc:2468] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:18.194933  7705 raft_consensus.cc:2468] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.195218  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba54050b634067a6e55c28cfa270ba" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.195840  7780 raft_consensus.cc:2468] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.184090  7934 leader_election.cc:290] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:18.186117  7829 raft_consensus.cc:359] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.197225  7829 raft_consensus.cc:385] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.197526  7829 raft_consensus.cc:740] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.198436  7928 raft_consensus.cc:3060] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.198244  7829 consensus_queue.cc:260] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
W20260709 13:01:18.199754  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:18.203930  7829 ts_tablet_manager.cc:1434] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:01:18.205292  7829 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.206139  7824 ts_tablet_manager.cc:1434] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:01:18.197019  7598 leader_election.cc:304] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:18.208139  7934 raft_consensus.cc:2804] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.208683  7934 raft_consensus.cc:493] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.209105  7934 raft_consensus.cc:3060] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.211302  7829 tablet_bootstrap.cc:654] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.219002  7826 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.219534  7826 ts_tablet_manager.cc:1403] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:01:18.222265  7826 raft_consensus.cc:359] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.222935  7826 raft_consensus.cc:385] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.223227  7826 raft_consensus.cc:740] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.223644  7928 raft_consensus.cc:2749] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.223939  7826 consensus_queue.cc:260] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.225400  7934 raft_consensus.cc:515] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.226507  7826 ts_tablet_manager.cc:1434] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:01:18.227519  7826 tablet_bootstrap.cc:492] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.233266  7934 leader_election.cc:290] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:18.233371  7826 tablet_bootstrap.cc:654] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.233438  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba54050b634067a6e55c28cfa270ba" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:18.234694  7705 raft_consensus.cc:3060] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.235415  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba54050b634067a6e55c28cfa270ba" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:18.235999  7780 raft_consensus.cc:3060] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.242606  7705 raft_consensus.cc:2468] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:18.245270  7825 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:18.242975  7780 raft_consensus.cc:2468] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:18.245797  7825 ts_tablet_manager.cc:1403] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:01:18.244211  7824 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:18.248692  7825 raft_consensus.cc:359] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.249398  7825 raft_consensus.cc:385] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.249692  7825 raft_consensus.cc:740] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.250407  7825 consensus_queue.cc:260] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.255019  7824 tablet_bootstrap.cc:654] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.256656  7596 leader_election.cc:304] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:18.259651  7825 ts_tablet_manager.cc:1434] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:01:18.269405  7825 tablet_bootstrap.cc:492] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:18.269706  7934 raft_consensus.cc:2804] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.270296  7934 raft_consensus.cc:697] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:18.266506  7826 tablet_bootstrap.cc:492] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.271149  7826 ts_tablet_manager.cc:1403] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.024s
I20260709 13:01:18.271111  7934 consensus_queue.cc:237] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.272356  7838 raft_consensus.cc:493] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.272837  7838 raft_consensus.cc:515] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.274077  7826 raft_consensus.cc:359] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.274756  7826 raft_consensus.cc:385] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.274947  7838 leader_election.cc:290] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.275031  7826 raft_consensus.cc:740] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.275946  7825 tablet_bootstrap.cc:654] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.275799  7826 consensus_queue.cc:260] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.277822  7826 ts_tablet_manager.cc:1434] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:18.282688  7928 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.282966  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.283490  7928 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.284113  7557 raft_consensus.cc:2393] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:18.291303  7928 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.297392  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:18.298146  7631 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:18.299353  7522 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:18.300249  7928 raft_consensus.cc:2804] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.300642  7928 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.301003  7928 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.302798  7826 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.310453  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.311180  7779 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:18.314561  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.319844  7596 leader_election.cc:304] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.321028  7933 raft_consensus.cc:3060] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.324280  7887 raft_consensus.cc:493] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.324831  7929 consensus_queue.cc:1048] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.324973  7887 raft_consensus.cc:515] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.327155  7887 leader_election.cc:290] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.324365  7928 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.329691  7928 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.332091  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:18.337924  7824 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:18.339593  7826 tablet_bootstrap.cc:654] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.341928  7631 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.342286  7824 ts_tablet_manager.cc:1403] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.020s
I20260709 13:01:18.339299  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:18.347149  7780 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.334085  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.335054  7929 consensus_queue.cc:1048] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.337342  7825 tablet_bootstrap.cc:492] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:18.349210  7825 ts_tablet_manager.cc:1403] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.000s
I20260709 13:01:18.351413  7631 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:18.353199  7522 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:18.337975  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.354565  7706 raft_consensus.cc:2468] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:18.351996  7825 raft_consensus.cc:359] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.355453  7825 raft_consensus.cc:385] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.355954  7825 raft_consensus.cc:740] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.355350  7892 raft_consensus.cc:2804] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.333540  7829 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
W20260709 13:01:18.356477  7745 leader_election.cc:343] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.356886  7892 raft_consensus.cc:697] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:18.357225  7887 consensus_queue.cc:1048] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.357800  7892 consensus_queue.cc:237] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.358484  7746 leader_election.cc:304] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.357177  7829 ts_tablet_manager.cc:1403] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.036s
I20260709 13:01:18.361384  7825 consensus_queue.cc:260] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.364966  7825 ts_tablet_manager.cc:1434] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:01:18.366281  7933 raft_consensus.cc:2749] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.366533  7829 raft_consensus.cc:359] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.367544  7829 raft_consensus.cc:385] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.341631  7453 catalog_manager.cc:5697] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.370062  7887 raft_consensus.cc:2804] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.367810  7829 raft_consensus.cc:740] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.370527  7887 raft_consensus.cc:493] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.371027  7887 raft_consensus.cc:3060] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.371832  7829 consensus_queue.cc:260] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.373970  7825 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:18.374810  7829 ts_tablet_manager.cc:1434] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:01:18.376169  7829 tablet_bootstrap.cc:492] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.386629  7829 tablet_bootstrap.cc:654] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.387049  7929 raft_consensus.cc:493] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.387701  7929 raft_consensus.cc:515] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.391045  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868bb0c5915543b7bd6a7644aa0fc361" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.391736  7929 leader_election.cc:290] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.391985  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868bb0c5915543b7bd6a7644aa0fc361" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:18.394238  7671 leader_election.cc:343] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:18.396816  7671 leader_election.cc:343] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.397269  7671 leader_election.cc:304] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.398564  7831 raft_consensus.cc:2749] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.402860  7835 consensus_queue.cc:1048] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.403771  7829 tablet_bootstrap.cc:492] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:18.404429  7829 ts_tablet_manager.cc:1403] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.009s
I20260709 13:01:18.407462  7829 raft_consensus.cc:359] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.408190  7829 raft_consensus.cc:385] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.408921  7829 raft_consensus.cc:740] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.409642  7829 consensus_queue.cc:260] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.412026  7829 ts_tablet_manager.cc:1434] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:18.407884  7824 raft_consensus.cc:359] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.412963  7824 raft_consensus.cc:385] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.413285  7824 raft_consensus.cc:740] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.415262  7829 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.413988  7824 consensus_queue.cc:260] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.428355  7824 ts_tablet_manager.cc:1434] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:01:18.431159  7829 tablet_bootstrap.cc:654] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.440786  7824 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:18.443688  7896 consensus_queue.cc:1048] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.454007  7824 tablet_bootstrap.cc:654] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.457924  7835 consensus_queue.cc:1048] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.458283  7780 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:18.469111  7887 raft_consensus.cc:515] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.480203  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:18.480886  7705 raft_consensus.cc:3060] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.473551  7887 leader_election.cc:290] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.494693  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:18.496254  7745 leader_election.cc:343] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.501050  7892 consensus_queue.cc:1048] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.506829  7838 raft_consensus.cc:493] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.507622  7838 raft_consensus.cc:515] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.514969  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa66f85089b48afada6adb174712a9a" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.515462  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa66f85089b48afada6adb174712a9a" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.515733  7778 raft_consensus.cc:2468] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.516130  7704 raft_consensus.cc:2468] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.522893  7825 tablet_bootstrap.cc:654] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.525112  7596 leader_election.cc:304] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:18.524173  7835 raft_consensus.cc:493] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.525833  7835 raft_consensus.cc:515] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.520730  7838 leader_election.cc:290] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:18.531939  7837 consensus_queue.cc:1048] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.534914  7835 leader_election.cc:290] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.529111  7934 raft_consensus.cc:2804] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.535660  7934 raft_consensus.cc:493] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.536145  7934 raft_consensus.cc:3060] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.541455  7826 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.541935  7826 ts_tablet_manager.cc:1403] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.239s	user 0.044s	sys 0.058s
I20260709 13:01:18.546481  7929 raft_consensus.cc:493] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.559742  7829 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:18.547786  7929 raft_consensus.cc:515] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.560576  7829 ts_tablet_manager.cc:1403] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.037s
I20260709 13:01:18.562690  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821c72ad05541a680bf7e51256d96c5" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.564337  7824 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:18.586386  7824 ts_tablet_manager.cc:1403] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.015s
I20260709 13:01:18.568626  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821c72ad05541a680bf7e51256d96c5" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.576383  7835 raft_consensus.cc:493] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.567981  7705 raft_consensus.cc:2468] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:18.585925  7826 raft_consensus.cc:359] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.587450  7826 raft_consensus.cc:385] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.587903  7826 raft_consensus.cc:740] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.594451  7929 leader_election.cc:290] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.595602  7824 raft_consensus.cc:359] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.595947  7934 raft_consensus.cc:515] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.596663  7824 raft_consensus.cc:385] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.592653  7555 raft_consensus.cc:2468] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:18.597224  7824 raft_consensus.cc:740] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.591133  7706 raft_consensus.cc:2468] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:18.598745  7745 leader_election.cc:304] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:18.598462  7824 consensus_queue.cc:260] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.591545  7835 raft_consensus.cc:515] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.601847  7826 consensus_queue.cc:260] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.605314  7826 ts_tablet_manager.cc:1434] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:01:18.606011  7824 ts_tablet_manager.cc:1434] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:01:18.602478  7835 leader_election.cc:290] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.600033  7887 raft_consensus.cc:2804] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.607501  7824 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:18.609189  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa66f85089b48afada6adb174712a9a" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:18.614884  7705 raft_consensus.cc:3060] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.615170  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:18.617436  7745 leader_election.cc:343] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.618268  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:18.619715  7745 leader_election.cc:343] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.620152  7745 leader_election.cc:304] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.606082  7826 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.610052  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:18.621953  7671 leader_election.cc:343] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.612577  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.611835  7746 leader_election.cc:304] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.625985  7835 raft_consensus.cc:2804] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.626356  7705 raft_consensus.cc:2468] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:18.627269  7837 raft_consensus.cc:2749] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:18.627391  7670 leader_election.cc:343] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.627884  7670 leader_election.cc:304] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.626469  7835 raft_consensus.cc:697] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:18.628610  7824 tablet_bootstrap.cc:654] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.629102  7835 consensus_queue.cc:237] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.629791  7598 leader_election.cc:304] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:18.633262  7829 raft_consensus.cc:359] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.616716  7887 raft_consensus.cc:493] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.633941  7998 raft_consensus.cc:2804] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.634327  7887 raft_consensus.cc:3060] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.634825  7998 raft_consensus.cc:697] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:18.635788  7998 consensus_queue.cc:237] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.637359  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa66f85089b48afada6adb174712a9a" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:18.637974  7780 raft_consensus.cc:3060] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.623773  7452 catalog_manager.cc:5697] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.639863  7999 raft_consensus.cc:2749] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.640322  7934 leader_election.cc:290] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:18.642144  7825 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:18.642992  7929 consensus_queue.cc:1048] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.646010  7825 ts_tablet_manager.cc:1403] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.272s	user 0.020s	sys 0.005s
I20260709 13:01:18.633960  7829 raft_consensus.cc:385] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.651434  7829 raft_consensus.cc:740] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.652108  7829 consensus_queue.cc:260] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.652654  7826 tablet_bootstrap.cc:654] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.653993  7780 raft_consensus.cc:2468] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:18.670787  7829 ts_tablet_manager.cc:1434] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:01:18.671916  7829 tablet_bootstrap.cc:492] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.673029  7825 raft_consensus.cc:359] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.673777  7825 raft_consensus.cc:385] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.674068  7825 raft_consensus.cc:740] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.674726  7825 consensus_queue.cc:260] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.675170  7929 consensus_queue.cc:1048] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.682461  7887 raft_consensus.cc:515] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.691632  7825 ts_tablet_manager.cc:1434] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:01:18.693012  7825 tablet_bootstrap.cc:492] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:18.698618  7829 tablet_bootstrap.cc:654] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.690025  7887 leader_election.cc:290] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.700809  7837 raft_consensus.cc:493] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.703732  7837 raft_consensus.cc:515] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.705644  7837 leader_election.cc:290] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.708532  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821c72ad05541a680bf7e51256d96c5" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:18.709205  7705 raft_consensus.cc:3060] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.717478  7825 tablet_bootstrap.cc:654] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.730212  7824 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:18.730722  7824 ts_tablet_manager.cc:1403] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.016s
I20260709 13:01:18.731132  7934 consensus_queue.cc:1048] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:18.748906  7824 raft_consensus.cc:359] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.749163  7998 consensus_queue.cc:1048] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.749650  7824 raft_consensus.cc:385] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.749958  7824 raft_consensus.cc:740] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
W20260709 13:01:18.724570  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36939, user_credentials={real_user=slave}} blocked reactor thread for 104894us
I20260709 13:01:18.750629  7824 consensus_queue.cc:260] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.761049  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821c72ad05541a680bf7e51256d96c5" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:18.761911  7556 raft_consensus.cc:3060] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.770768  7826 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.771472  7826 ts_tablet_manager.cc:1403] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.013s
I20260709 13:01:18.771521  7705 raft_consensus.cc:2468] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:18.773474  7746 leader_election.cc:304] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:18.774812  8002 raft_consensus.cc:2804] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.775449  8002 raft_consensus.cc:697] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:18.776587  8002 consensus_queue.cc:237] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:18.777434  7947 raft_consensus.cc:493] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.777971  7947 raft_consensus.cc:515] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.778525  7453 catalog_manager.cc:5697] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.777382  7824 ts_tablet_manager.cc:1434] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:01:18.783020  7824 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:18.784099  7826 raft_consensus.cc:359] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.784881  7826 raft_consensus.cc:385] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.785164  7826 raft_consensus.cc:740] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.785853  7826 consensus_queue.cc:260] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.766589  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.794538  7826 ts_tablet_manager.cc:1434] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:01:18.780174  7947 leader_election.cc:290] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:18.795491  7934 raft_consensus.cc:493] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.805267  7826 tablet_bootstrap.cc:492] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.796195  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557c070427344f13b3df4674a7f5f307" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:18.796947  7557 raft_consensus.cc:2468] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:18.815519  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557c070427344f13b3df4674a7f5f307" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.816798  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:18.817454  7671 leader_election.cc:343] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:18.818235  7671 leader_election.cc:343] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.818655  7671 leader_election.cc:304] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:18.823344  7947 raft_consensus.cc:2749] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.809659  7934 raft_consensus.cc:515] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.824501  7629 raft_consensus.cc:2468] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:18.826699  7934 leader_election.cc:290] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.827505  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:18.828147  7779 raft_consensus.cc:2468] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.826947  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.834411  7557 raft_consensus.cc:2468] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.834477  7596 leader_election.cc:304] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:18.840584  7892 consensus_queue.cc:1048] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.838235  7745 leader_election.cc:304] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:18.846926  7837 raft_consensus.cc:2804] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.847493  7837 raft_consensus.cc:493] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.847910  7837 raft_consensus.cc:3060] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.859673  7934 raft_consensus.cc:2804] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.860375  7934 raft_consensus.cc:493] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.860826  7934 raft_consensus.cc:3060] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.867856  7825 tablet_bootstrap.cc:492] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:18.868459  7825 ts_tablet_manager.cc:1403] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.176s	user 0.018s	sys 0.007s
I20260709 13:01:18.874413  7829 tablet_bootstrap.cc:492] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:18.874970  7829 ts_tablet_manager.cc:1403] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.203s	user 0.025s	sys 0.024s
I20260709 13:01:18.878911  7556 raft_consensus.cc:2468] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:18.883948  7826 tablet_bootstrap.cc:654] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.884541  7829 raft_consensus.cc:359] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.885351  7829 raft_consensus.cc:385] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.885747  7829 raft_consensus.cc:740] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.888393  7829 consensus_queue.cc:260] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.893501  7825 raft_consensus.cc:359] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.894057  7825 raft_consensus.cc:385] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.894275  7825 raft_consensus.cc:740] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.891213  7452 catalog_manager.cc:5697] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.895978  7829 ts_tablet_manager.cc:1434] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:01:18.896739  7825 consensus_queue.cc:260] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.898636  7825 ts_tablet_manager.cc:1434] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:01:18.899629  7825 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:18.909677  7829 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:18.915208  7934 raft_consensus.cc:515] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.918344  7824 tablet_bootstrap.cc:654] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.924271  7934 leader_election.cc:290] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:18.927639  7825 tablet_bootstrap.cc:654] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.888937  7837 raft_consensus.cc:515] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.931375  7934 raft_consensus.cc:493] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.943547  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:18.944252  7556 raft_consensus.cc:3060] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.942863  7934 raft_consensus.cc:515] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.950416  7556 raft_consensus.cc:2468] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:18.951997  7934 leader_election.cc:290] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:18.953939  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868bb0c5915543b7bd6a7644aa0fc361" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:18.954221  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868bb0c5915543b7bd6a7644aa0fc361" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:18.954733  7705 raft_consensus.cc:2468] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.954878  7557 raft_consensus.cc:2468] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:18.955042  7597 leader_election.cc:304] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:18.956044  7934 raft_consensus.cc:2804] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.956193  7598 leader_election.cc:304] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:18.957345  7838 raft_consensus.cc:2804] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.957703  7838 raft_consensus.cc:493] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.958019  7838 raft_consensus.cc:3060] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.956637  7934 raft_consensus.cc:697] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:18.959188  7934 consensus_queue.cc:237] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:18.961454  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:18.962302  7777 raft_consensus.cc:2393] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:18.964710  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:18.970010  7555 raft_consensus.cc:2393] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07d5308b5f834161a9f46b9565fa95e6 in current term 1: Already voted for candidate 53979e9879e74487a8a95daacdefdbcd in this term.
I20260709 13:01:18.973727  7928 consensus_queue.cc:1048] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.976379  7838 raft_consensus.cc:515] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:18.977952  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fb2def96cb455bbc7a536643f246c7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:18.977867  7826 tablet_bootstrap.cc:492] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:18.973220  7829 tablet_bootstrap.cc:654] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.992370  7826 ts_tablet_manager.cc:1403] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.015s
I20260709 13:01:18.987897  7453 catalog_manager.cc:5697] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.995174  7826 raft_consensus.cc:359] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.995914  7826 raft_consensus.cc:385] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.996188  7826 raft_consensus.cc:740] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.996868  7826 consensus_queue.cc:260] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:18.998891  7826 ts_tablet_manager.cc:1434] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:01:18.999058  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868bb0c5915543b7bd6a7644aa0fc361" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:18.999693  7557 raft_consensus.cc:3060] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.999817  7826 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:18.978808  7837 leader_election.cc:290] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:19.012884  7824 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:19.013408  7824 ts_tablet_manager.cc:1403] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.008s
I20260709 13:01:19.015005  7745 leader_election.cc:304] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.017166  7887 raft_consensus.cc:2749] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.017490  7825 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:19.018050  7825 ts_tablet_manager.cc:1403] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.003s
I20260709 13:01:19.019477  7826 tablet_bootstrap.cc:654] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.020704  7825 raft_consensus.cc:359] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.021405  7825 raft_consensus.cc:385] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.021673  7825 raft_consensus.cc:740] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.022186  7824 raft_consensus.cc:359] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.025053  7824 raft_consensus.cc:385] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.025287  7824 raft_consensus.cc:740] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.025889  7825 consensus_queue.cc:260] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.034576  7824 consensus_queue.cc:260] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.036218  7825 ts_tablet_manager.cc:1434] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:01:19.037662  7825 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:19.043296  7825 tablet_bootstrap.cc:654] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.046399  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868bb0c5915543b7bd6a7644aa0fc361" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:19.047083  7703 raft_consensus.cc:3060] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.053682  7452 catalog_manager.cc:5697] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.066087  7824 ts_tablet_manager.cc:1434] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.003s
I20260709 13:01:19.066982  7824 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:19.035210  7838 leader_election.cc:290] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.073349  7703 raft_consensus.cc:2468] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:19.075328  7829 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:19.076268  7829 ts_tablet_manager.cc:1403] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.168s	user 0.028s	sys 0.028s
I20260709 13:01:19.081976  7598 leader_election.cc:304] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:19.085191  7838 raft_consensus.cc:2804] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.085976  7838 raft_consensus.cc:697] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:19.086876  7838 consensus_queue.cc:237] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.087594  7837 consensus_queue.cc:1048] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.089277  7824 tablet_bootstrap.cc:654] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.089919  7557 raft_consensus.cc:2468] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:19.093765  7829 raft_consensus.cc:359] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.094741  7829 raft_consensus.cc:385] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.095088  7829 raft_consensus.cc:740] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.096011  7829 consensus_queue.cc:260] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.101616  7829 ts_tablet_manager.cc:1434] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:19.102967  7829 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:19.104076  7826 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:19.105003  7826 ts_tablet_manager.cc:1403] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.012s
I20260709 13:01:19.108740  7826 raft_consensus.cc:359] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.109658  7826 raft_consensus.cc:385] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.109999  7826 raft_consensus.cc:740] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.111089  7826 consensus_queue.cc:260] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.118126  7825 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:19.118602  7825 ts_tablet_manager.cc:1403] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.081s	user 0.004s	sys 0.013s
I20260709 13:01:19.122284  7824 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:19.122816  7824 ts_tablet_manager.cc:1403] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.008s
I20260709 13:01:19.123585  7829 tablet_bootstrap.cc:654] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.125485  7824 raft_consensus.cc:359] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.126174  7824 raft_consensus.cc:385] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.126433  7824 raft_consensus.cc:740] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.127046  7824 consensus_queue.cc:260] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.129026  7824 ts_tablet_manager.cc:1434] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:19.129920  7824 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:19.130908  7825 raft_consensus.cc:359] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.131664  7825 raft_consensus.cc:385] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.131924  7825 raft_consensus.cc:740] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.132635  7825 consensus_queue.cc:260] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.134974  7825 ts_tablet_manager.cc:1434] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:01:19.137768  7824 tablet_bootstrap.cc:654] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.138689  7826 ts_tablet_manager.cc:1434] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.005s
I20260709 13:01:19.139364  7825 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:19.140214  7454 catalog_manager.cc:5697] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.139765  7826 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:19.148757  7557 raft_consensus.cc:3060] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.150513  7825 tablet_bootstrap.cc:654] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.195423  7838 raft_consensus.cc:493] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.196064  7838 raft_consensus.cc:515] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.197727  7934 consensus_queue.cc:1048] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.199071  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:19.199725  7777 raft_consensus.cc:2468] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:19.200718  7837 consensus_queue.cc:1048] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.207171  7596 leader_election.cc:304] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:19.211118  7934 raft_consensus.cc:2804] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.211525  7934 raft_consensus.cc:493] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.211879  7934 raft_consensus.cc:3060] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.219751  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:19.221360  7597 leader_election.cc:343] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.222018  7838 leader_election.cc:290] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.229259  7825 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:19.229789  7825 ts_tablet_manager.cc:1403] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.023s
I20260709 13:01:19.230924  7838 consensus_queue.cc:1048] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.235858  7947 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.236430  7947 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.235445  7934 raft_consensus.cc:515] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.241642  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:19.243487  7671 leader_election.cc:343] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.272848  7837 raft_consensus.cc:493] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.273461  7837 raft_consensus.cc:515] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.232750  7826 tablet_bootstrap.cc:654] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.278648  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707d80b971064b8fbb0d0a9b353a53ae" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:19.279264  7947 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:19.279409  7703 raft_consensus.cc:2468] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:19.232558  7825 raft_consensus.cc:359] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.234114  7829 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:19.298062  7824 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:19.298062  7829 ts_tablet_manager.cc:1403] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.195s	user 0.022s	sys 0.044s
I20260709 13:01:19.298625  7824 ts_tablet_manager.cc:1403] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.169s	user 0.016s	sys 0.025s
I20260709 13:01:19.282023  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.299458  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:19.286665  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707d80b971064b8fbb0d0a9b353a53ae" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.279629  7837 leader_election.cc:290] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.283636  7746 leader_election.cc:304] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
W20260709 13:01:19.300541  7671 leader_election.cc:343] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.290163  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:19.301959  7671 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.302309  7835 raft_consensus.cc:2804] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.302743  7835 raft_consensus.cc:493] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.303007  7947 raft_consensus.cc:2749] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.303076  7835 raft_consensus.cc:3060] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.304337  7829 raft_consensus.cc:359] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.305035  7829 raft_consensus.cc:385] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.305303  7829 raft_consensus.cc:740] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.305790  7887 consensus_queue.cc:1048] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.308153  7829 consensus_queue.cc:260] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.288729  7934 leader_election.cc:290] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.300019  7778 raft_consensus.cc:3060] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.300601  7629 raft_consensus.cc:2468] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:19.314358  7824 raft_consensus.cc:359] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.315277  7824 raft_consensus.cc:385] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.315618  7824 raft_consensus.cc:740] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
W20260709 13:01:19.316385  7597 leader_election.cc:343] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.318120  7824 consensus_queue.cc:260] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.310259  7829 ts_tablet_manager.cc:1434] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
W20260709 13:01:19.282205  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:19.329567  7824 ts_tablet_manager.cc:1434] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.006s
I20260709 13:01:19.333482  7826 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:19.334022  7826 ts_tablet_manager.cc:1403] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.194s	user 0.010s	sys 0.003s
I20260709 13:01:19.338018  7824 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:19.339560  7829 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:19.297791  7825 raft_consensus.cc:385] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.340993  7825 raft_consensus.cc:740] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.341691  7826 raft_consensus.cc:359] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.342254  7826 raft_consensus.cc:385] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.342469  7826 raft_consensus.cc:740] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.348994  7826 consensus_queue.cc:260] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.354408  7825 consensus_queue.cc:260] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.355288  7837 raft_consensus.cc:493] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.359537  7826 ts_tablet_manager.cc:1434] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 13:01:19.363389  7837 raft_consensus.cc:515] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.364207  7826 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:19.365643  7837 leader_election.cc:290] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.366686  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:19.367359  7703 raft_consensus.cc:2468] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:19.368649  7746 leader_election.cc:304] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:19.327875  7778 raft_consensus.cc:2468] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:19.370400  7837 raft_consensus.cc:2804] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.370818  7837 raft_consensus.cc:493] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.371210  7837 raft_consensus.cc:3060] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.374143  7892 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.336977  7835 raft_consensus.cc:515] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.374672  7892 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.376533  7596 leader_election.cc:304] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.376828  7835 leader_election.cc:290] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.377414  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707d80b971064b8fbb0d0a9b353a53ae" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:19.377753  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707d80b971064b8fbb0d0a9b353a53ae" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:19.378016  7934 raft_consensus.cc:2804] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.378021  7703 raft_consensus.cc:3060] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.378424  7629 raft_consensus.cc:3060] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.378750  7934 raft_consensus.cc:697] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:19.379015  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.379705  7557 raft_consensus.cc:2468] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:19.384749  7887 consensus_queue.cc:1048] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.376740  7892 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.385362  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.379686  7934 consensus_queue.cc:237] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
W20260709 13:01:19.388847  7522 leader_election.cc:343] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.389891  7629 raft_consensus.cc:2468] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:19.387972  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:19.391185  7703 raft_consensus.cc:2468] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:19.394481  7825 ts_tablet_manager.cc:1434] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.164s	user 0.003s	sys 0.006s
I20260709 13:01:19.391580  7706 raft_consensus.cc:2468] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:19.397562  7523 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:19.398226  7829 tablet_bootstrap.cc:654] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.398699  7892 raft_consensus.cc:2804] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.399122  7892 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.399488  7892 raft_consensus.cc:3060] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.391199  7745 leader_election.cc:304] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:19.402456  7825 tablet_bootstrap.cc:492] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:19.404259  7838 consensus_queue.cc:1048] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.406215  7887 raft_consensus.cc:2804] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.406781  7887 raft_consensus.cc:697] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:19.411582  7837 raft_consensus.cc:515] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.407745  7887 consensus_queue.cc:237] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.429422  7825 tablet_bootstrap.cc:654] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.433544  7824 tablet_bootstrap.cc:654] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.439431  7826 tablet_bootstrap.cc:654] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.449426  7837 leader_election.cc:290] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.450506  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:19.451150  7557 raft_consensus.cc:3060] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.451467  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:19.452049  7705 raft_consensus.cc:3060] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.453894  7998 consensus_queue.cc:1048] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.454948  7892 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.460045  7452 catalog_manager.cc:5697] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.458077  7455 catalog_manager.cc:5697] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.477881  7705 raft_consensus.cc:2468] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:19.484614  7947 raft_consensus.cc:493] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.485258  7947 raft_consensus.cc:515] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.487453  7947 leader_election.cc:290] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:19.485384  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:19.484001  7746 leader_election.cc:304] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:19.489539  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.488690  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.490362  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:19.498131  7706 raft_consensus.cc:3060] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:19.490859  7522 leader_election.cc:343] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.489672  7892 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.490916  7887 raft_consensus.cc:2804] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.499836  7887 raft_consensus.cc:697] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:19.500739  7887 consensus_queue.cc:237] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.501829  7825 tablet_bootstrap.cc:492] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:19.502314  7825 ts_tablet_manager.cc:1403] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.003s
I20260709 13:01:19.495529  7826 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
W20260709 13:01:19.492403  7671 leader_election.cc:343] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.503486  7826 ts_tablet_manager.cc:1403] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.000s
W20260709 13:01:19.503926  7671 leader_election.cc:343] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.504415  7671 leader_election.cc:304] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.506012  7706 raft_consensus.cc:2468] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:19.506181  7826 raft_consensus.cc:359] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.506965  7826 raft_consensus.cc:385] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.507269  7826 raft_consensus.cc:740] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.507702  7947 raft_consensus.cc:2749] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.493295  7829 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:19.509179  7829 ts_tablet_manager.cc:1403] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.000s
I20260709 13:01:19.509632  7523 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:19.512030  7829 raft_consensus.cc:359] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.512800  7829 raft_consensus.cc:385] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.513132  7896 raft_consensus.cc:2804] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.513655  7896 raft_consensus.cc:697] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:19.513412  7826 consensus_queue.cc:260] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.514469  7896 consensus_queue.cc:237] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.515846  7826 ts_tablet_manager.cc:1434] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:19.513167  7829 raft_consensus.cc:740] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.516917  7826 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:19.497051  7557 raft_consensus.cc:2468] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:19.521879  7824 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:19.519361  7829 consensus_queue.cc:260] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.522658  7824 ts_tablet_manager.cc:1403] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.002s
I20260709 13:01:19.523350  7826 tablet_bootstrap.cc:654] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.524391  7829 ts_tablet_manager.cc:1434] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:01:19.526033  7829 tablet_bootstrap.cc:492] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:19.525655  7824 raft_consensus.cc:359] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.526433  7824 raft_consensus.cc:385] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.526768  7824 raft_consensus.cc:740] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.528424  7824 consensus_queue.cc:260] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.530915  7824 ts_tablet_manager.cc:1434] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:19.531973  7824 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:19.535548  7826 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:19.540161  7829 tablet_bootstrap.cc:654] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.544257  7826 ts_tablet_manager.cc:1403] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.012s
I20260709 13:01:19.543342  7824 tablet_bootstrap.cc:654] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.547179  7826 raft_consensus.cc:359] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.550864  7826 raft_consensus.cc:385] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.551173  7826 raft_consensus.cc:740] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.538050  7825 raft_consensus.cc:359] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.552500  7825 raft_consensus.cc:385] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.552783  7825 raft_consensus.cc:740] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.556543  7453 catalog_manager.cc:5697] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.559096  7829 tablet_bootstrap.cc:492] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:19.559216  7824 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:19.559777  7829 ts_tablet_manager.cc:1403] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.002s
I20260709 13:01:19.559849  7824 ts_tablet_manager.cc:1403] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 13:01:19.560541  7455 catalog_manager.cc:5697] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.554675  7826 consensus_queue.cc:260] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.553476  7825 consensus_queue.cc:260] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.566836  7825 ts_tablet_manager.cc:1434] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:01:19.567824  7947 raft_consensus.cc:493] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.568372  7947 raft_consensus.cc:515] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.569175  7826 ts_tablet_manager.cc:1434] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:01:19.570252  7825 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:19.571542  7947 leader_election.cc:290] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:19.573282  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.574822  7826 tablet_bootstrap.cc:492] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
W20260709 13:01:19.575256  7671 leader_election.cc:343] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.575393  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:19.577379  7670 leader_election.cc:343] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.577862  7670 leader_election.cc:304] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:19.579504  7947 raft_consensus.cc:2749] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.586210  7829 raft_consensus.cc:359] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.587213  7829 raft_consensus.cc:385] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.586894  7934 consensus_queue.cc:1048] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.587523  7829 raft_consensus.cc:740] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.588492  7829 consensus_queue.cc:260] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.592904  7825 tablet_bootstrap.cc:654] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.595345  7829 ts_tablet_manager.cc:1434] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:01:19.596378  7829 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:19.596457  7826 tablet_bootstrap.cc:654] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.605237  7824 raft_consensus.cc:359] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.607474  7824 raft_consensus.cc:385] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.607759  7824 raft_consensus.cc:740] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.608471  7824 consensus_queue.cc:260] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.609043  7837 raft_consensus.cc:493] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.609540  7837 raft_consensus.cc:515] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.610548  7824 ts_tablet_manager.cc:1434] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.000s
I20260709 13:01:19.611513  7824 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:19.611574  7837 leader_election.cc:290] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.618395  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.618964  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:19.622448  7829 tablet_bootstrap.cc:654] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.628757  7934 raft_consensus.cc:493] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.629308  7934 raft_consensus.cc:515] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
W20260709 13:01:19.629989  7745 leader_election.cc:343] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.631479  7934 leader_election.cc:290] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.627243  7706 raft_consensus.cc:2468] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:19.633208  7746 leader_election.cc:304] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.635954  7837 raft_consensus.cc:2804] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.636157  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.637406  7556 raft_consensus.cc:2468] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:19.636157  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:19.638988  7778 raft_consensus.cc:2468] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:19.639241  7597 leader_election.cc:304] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:19.640872  7933 raft_consensus.cc:2804] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.641258  7933 raft_consensus.cc:493] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.641577  7933 raft_consensus.cc:3060] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.644927  7837 raft_consensus.cc:493] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.645417  7837 raft_consensus.cc:3060] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.645709  7998 consensus_queue.cc:1048] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.656663  7933 raft_consensus.cc:515] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.670408  7933 leader_election.cc:290] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.671712  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:19.672441  7556 raft_consensus.cc:3060] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.672441  7824 tablet_bootstrap.cc:654] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.676071  7825 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:19.676725  7825 ts_tablet_manager.cc:1403] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.010s
I20260709 13:01:19.679905  7826 tablet_bootstrap.cc:492] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:19.680625  7826 ts_tablet_manager.cc:1403] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.019s
I20260709 13:01:19.680707  7825 raft_consensus.cc:359] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.683569  7825 raft_consensus.cc:385] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.684118  7826 raft_consensus.cc:359] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.685563  7826 raft_consensus.cc:385] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.683980  7825 raft_consensus.cc:740] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.686004  7826 raft_consensus.cc:740] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.686656  7825 consensus_queue.cc:260] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.688174  7829 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:19.688761  7829 ts_tablet_manager.cc:1403] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.027s
I20260709 13:01:19.689322  7825 ts_tablet_manager.cc:1434] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:01:19.687232  7826 consensus_queue.cc:260] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.689422  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:19.690241  7778 raft_consensus.cc:3060] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.691352  7826 ts_tablet_manager.cc:1434] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:19.693578  7829 raft_consensus.cc:359] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.694242  7829 raft_consensus.cc:385] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.694494  7829 raft_consensus.cc:740] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.695104  7829 consensus_queue.cc:260] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.696638  7829 ts_tablet_manager.cc:1434] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:19.697557  7829 tablet_bootstrap.cc:492] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:19.699852  7826 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:19.705184  7825 tablet_bootstrap.cc:492] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:19.706321  7826 tablet_bootstrap.cc:654] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.707145  7933 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.707811  7933 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.710525  7933 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.712453  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:19.713587  7706 raft_consensus.cc:2393] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:19.712513  7829 tablet_bootstrap.cc:654] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.715337  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.721101  7598 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:19.736657  7998 raft_consensus.cc:493] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.737404  7998 raft_consensus.cc:515] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.724809  7933 raft_consensus.cc:3060] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.744966  7825 tablet_bootstrap.cc:654] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.746353  7947 raft_consensus.cc:493] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.760744  7947 raft_consensus.cc:515] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.763473  7947 leader_election.cc:290] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.766314  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:19.771198  7670 leader_election.cc:343] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.773967  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.776793  7998 leader_election.cc:290] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
W20260709 13:01:19.777805  7671 leader_election.cc:343] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.778472  7671 leader_election.cc:304] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.778800  7896 raft_consensus.cc:493] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.779333  7896 raft_consensus.cc:515] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.782013  7929 raft_consensus.cc:2749] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.783133  7896 leader_election.cc:290] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:19.784621  8002 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.786576  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:19.787525  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557c070427344f13b3df4674a7f5f307" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.787801  7777 raft_consensus.cc:2393] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate 53979e9879e74487a8a95daacdefdbcd in this term.
I20260709 13:01:19.785470  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557c070427344f13b3df4674a7f5f307" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:19.788795  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30af4a33a3c84877bee300138641109b" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.790302  7706 raft_consensus.cc:2468] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:19.792090  7598 leader_election.cc:304] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
W20260709 13:01:19.793207  7597 leader_election.cc:343] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.798110  7998 raft_consensus.cc:2804] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.801749  7998 raft_consensus.cc:493] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.802330  7998 raft_consensus.cc:3060] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.807732  7522 leader_election.cc:304] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:19.724144  7837 raft_consensus.cc:515] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.814378  7887 consensus_queue.cc:1048] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.816601  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:19.818482  7745 leader_election.cc:343] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.811091  7894 raft_consensus.cc:3060] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.818868  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:19.819743  7706 raft_consensus.cc:3060] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.786659  8002 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.826507  8002 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:19.824380  7837 leader_election.cc:290] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:19.736071  7556 raft_consensus.cc:2468] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:19.837590  7778 raft_consensus.cc:2468] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:19.842075  7596 leader_election.cc:304] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:19.848109  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:19.848548  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:19.848701  7934 raft_consensus.cc:2804] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.849291  7934 raft_consensus.cc:697] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
W20260709 13:01:19.849754  7745 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:19.850487  7745 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.850940  7745 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.855580  7837 raft_consensus.cc:2749] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.850121  7934 consensus_queue.cc:237] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:19.857931  7933 raft_consensus.cc:2749] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.858424  7826 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:19.859620  7826 ts_tablet_manager.cc:1403] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.160s	user 0.031s	sys 0.032s
I20260709 13:01:19.859966  7824 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:19.863471  7826 raft_consensus.cc:359] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.866084  7826 raft_consensus.cc:385] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.866370  7826 raft_consensus.cc:740] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.867026  7826 consensus_queue.cc:260] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.864375  7824 ts_tablet_manager.cc:1403] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.253s	user 0.047s	sys 0.043s
I20260709 13:01:19.865754  7829 tablet_bootstrap.cc:492] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:19.868189  7829 ts_tablet_manager.cc:1403] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.045s
I20260709 13:01:19.870441  7826 ts_tablet_manager.cc:1434] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:01:19.875994  7826 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:19.878328  7829 raft_consensus.cc:359] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.885842  7829 raft_consensus.cc:385] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.886296  7829 raft_consensus.cc:740] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.886916  7824 raft_consensus.cc:359] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.888571  7824 raft_consensus.cc:385] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.888875  7824 raft_consensus.cc:740] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.889519  7824 consensus_queue.cc:260] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:19.890686  7829 consensus_queue.cc:260] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:19.893076  7829 ts_tablet_manager.cc:1434] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:01:19.897739  7824 ts_tablet_manager.cc:1434] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:01:19.898577  7824 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:19.901427  7829 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:19.911055  7826 tablet_bootstrap.cc:654] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.926357  7892 consensus_queue.cc:1048] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.926488  7835 consensus_queue.cc:1048] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.932394  8002 consensus_queue.cc:1048] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.946381  7894 raft_consensus.cc:2749] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.947716  7706 raft_consensus.cc:2468] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:19.969782  7829 tablet_bootstrap.cc:654] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.969944  7454 catalog_manager.cc:5697] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.980545  7746 leader_election.cc:304] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:19.982249  7825 tablet_bootstrap.cc:492] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:19.982790  7825 ts_tablet_manager.cc:1403] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.278s	user 0.021s	sys 0.012s
I20260709 13:01:19.948338  7998 raft_consensus.cc:515] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:19.983237  7887 raft_consensus.cc:2804] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.983768  7887 raft_consensus.cc:697] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:19.999374  7825 raft_consensus.cc:359] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.000026  7825 raft_consensus.cc:385] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.000386  7825 raft_consensus.cc:740] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.001099  7825 consensus_queue.cc:260] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.003933  7825 ts_tablet_manager.cc:1434] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:01:20.005312  7825 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:20.006975  7826 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:19.998320  7998 leader_election.cc:290] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:19.998456  7934 raft_consensus.cc:493] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.988389  8061 consensus_queue.cc:1048] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:01:20.008129  7826 ts_tablet_manager.cc:1403] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.137s	user 0.040s	sys 0.031s
I20260709 13:01:20.013617  7835 raft_consensus.cc:493] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.005827  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557c070427344f13b3df4674a7f5f307" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:20.014110  7835 raft_consensus.cc:515] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.028297  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557c070427344f13b3df4674a7f5f307" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:20.028995  7705 raft_consensus.cc:3060] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.036480  7835 leader_election.cc:290] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:20.040629  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.041391  7702 raft_consensus.cc:2468] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:20.002956  7887 consensus_queue.cc:237] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.044876  7746 leader_election.cc:304] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:20.045754  7835 raft_consensus.cc:2804] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.041970  7705 raft_consensus.cc:2468] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:20.046113  7835 raft_consensus.cc:493] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.046494  7835 raft_consensus.cc:3060] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.014599  7934 raft_consensus.cc:515] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.056031  7934 leader_election.cc:290] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.058797  8002 consensus_queue.cc:1048] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:20.052031  7597 leader_election.cc:343] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.062186  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.062176  7824 tablet_bootstrap.cc:654] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.021404  8064 consensus_queue.cc:1048] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
W20260709 13:01:20.064637  8063 log.cc:927] Time spent T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:01:20.062219  7835 raft_consensus.cc:515] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.069394  7826 raft_consensus.cc:359] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.070916  7826 raft_consensus.cc:385] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.071223  7826 raft_consensus.cc:740] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.071992  7835 leader_election.cc:290] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:20.072022  7826 consensus_queue.cc:260] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.075053  7826 ts_tablet_manager.cc:1434] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.000s
I20260709 13:01:20.076030  7826 tablet_bootstrap.cc:492] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:20.078114  7778 raft_consensus.cc:2393] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:20.071336  7896 consensus_queue.cc:1048] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:01:20.081815  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.082242  7826 tablet_bootstrap.cc:654] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.082538  7629 raft_consensus.cc:2468] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:20.088966  7829 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.089504  7829 ts_tablet_manager.cc:1403] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.008s
I20260709 13:01:20.091440  7598 leader_election.cc:304] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:20.092312  8061 raft_consensus.cc:2804] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.092761  8061 raft_consensus.cc:697] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:20.093583  8061 consensus_queue.cc:237] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.096127  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:20.120164  7829 raft_consensus.cc:359] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.126883  7829 raft_consensus.cc:385] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.127175  7829 raft_consensus.cc:740] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.131312  7829 consensus_queue.cc:260] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.134246  7825 tablet_bootstrap.cc:654] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.133252  7829 ts_tablet_manager.cc:1434] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:01:20.126000  7705 raft_consensus.cc:3060] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.135871  7829 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.133252  7998 raft_consensus.cc:493] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.145539  7998 raft_consensus.cc:515] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.154184  7947 raft_consensus.cc:493] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.154528  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.154776  7894 raft_consensus.cc:493] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.155275  7894 raft_consensus.cc:515] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.157413  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc999ec44e646bab1cfdf860801548c" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:20.158165  7631 raft_consensus.cc:3060] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.154778  7947 raft_consensus.cc:515] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.162720  7454 catalog_manager.cc:5697] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.186116  7824 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:20.186826  7824 ts_tablet_manager.cc:1403] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.288s	user 0.021s	sys 0.010s
I20260709 13:01:20.193240  7947 leader_election.cc:290] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.198593  7998 leader_election.cc:290] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:20.205763  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443a208ce4b24ce880e010a7916485d4" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.206514  7778 raft_consensus.cc:2468] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:20.207612  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443a208ce4b24ce880e010a7916485d4" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.213088  7631 raft_consensus.cc:2468] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:20.205770  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:20.214174  7670 leader_election.cc:304] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:20.215903  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.223793  7706 raft_consensus.cc:2468] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:20.216262  7894 leader_election.cc:290] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.216647  8061 raft_consensus.cc:493] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.224931  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.224761  8061 raft_consensus.cc:515] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.225831  7704 raft_consensus.cc:2393] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:20.226382  7824 raft_consensus.cc:359] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.226801  8057 raft_consensus.cc:2804] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.227087  7824 raft_consensus.cc:385] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.227178  8061 leader_election.cc:290] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
W20260709 13:01:20.227450  7671 leader_election.cc:343] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.227566  7824 raft_consensus.cc:740] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.210531  7598 leader_election.cc:304] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.229765  7829 tablet_bootstrap.cc:654] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.231240  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.224684  7826 tablet_bootstrap.cc:492] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:20.232623  7826 ts_tablet_manager.cc:1403] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.021s
I20260709 13:01:20.227249  8057 raft_consensus.cc:493] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.234802  8057 raft_consensus.cc:3060] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:20.234902  7596 leader_election.cc:343] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.235306  7826 raft_consensus.cc:359] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.235996  7826 raft_consensus.cc:385] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.222332  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0320ea4b71844851b35b9d1a05a5d2c6" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.241606  7826 raft_consensus.cc:740] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.228430  7824 consensus_queue.cc:260] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.242690  8061 raft_consensus.cc:2749] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.244213  7824 ts_tablet_manager.cc:1434] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:01:20.236722  7598 leader_election.cc:304] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
W20260709 13:01:20.246239  7597 leader_election.cc:343] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.247535  8061 raft_consensus.cc:2804] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.236125  7453 catalog_manager.cc:5697] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.248092  7745 leader_election.cc:304] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:20.249064  7835 raft_consensus.cc:2804] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.249516  7835 raft_consensus.cc:697] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:20.248111  8061 raft_consensus.cc:493] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.250247  7835 consensus_queue.cc:237] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.251482  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:20.252831  7597 leader_election.cc:343] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.253346  7597 leader_election.cc:304] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:20.254541  7998 raft_consensus.cc:2749] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.254762  7824 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:20.219437  7705 raft_consensus.cc:2468] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:20.250741  8061 raft_consensus.cc:3060] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.260596  8057 raft_consensus.cc:515] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.262584  7523 leader_election.cc:304] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.265184  8057 leader_election.cc:290] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.265254  7894 raft_consensus.cc:3060] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.265661  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443a208ce4b24ce880e010a7916485d4" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:20.266364  7777 raft_consensus.cc:3060] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.267832  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443a208ce4b24ce880e010a7916485d4" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
W20260709 13:01:20.270082  7671 leader_election.cc:343] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.275864  7998 consensus_queue.cc:1048] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.286044  7894 raft_consensus.cc:2749] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.242449  7826 consensus_queue.cc:260] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.290043  7824 tablet_bootstrap.cc:654] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.291487  7826 ts_tablet_manager.cc:1434] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.004s
I20260709 13:01:20.294763  7829 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.299762  7829 ts_tablet_manager.cc:1403] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.011s
I20260709 13:01:20.295413  7826 tablet_bootstrap.cc:492] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:20.312091  8065 consensus_queue.cc:1048] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.316635  7777 raft_consensus.cc:2468] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:20.318311  7670 leader_election.cc:304] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:20.316826  7829 raft_consensus.cc:359] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.319842  7829 raft_consensus.cc:385] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.319933  8057 raft_consensus.cc:2804] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.320401  7829 raft_consensus.cc:740] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.322261  7825 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:20.324821  7825 ts_tablet_manager.cc:1403] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.320s	user 0.015s	sys 0.017s
I20260709 13:01:20.327574  7825 raft_consensus.cc:359] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.328287  7826 tablet_bootstrap.cc:654] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.328678  8002 raft_consensus.cc:493] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.329229  8002 raft_consensus.cc:515] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.323678  7829 consensus_queue.cc:260] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.331413  8002 leader_election.cc:290] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:20.328729  7825 raft_consensus.cc:385] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.332198  7825 raft_consensus.cc:740] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.332350  8061 raft_consensus.cc:515] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.323264  7455 catalog_manager.cc:5697] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.334859  7825 consensus_queue.cc:260] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.337013  7824 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:20.337534  7824 ts_tablet_manager.cc:1403] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.011s
I20260709 13:01:20.338158  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6567006f2659467e8fa74d383dddd8c0" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.331516  7829 ts_tablet_manager.cc:1434] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:01:20.340243  7829 tablet_bootstrap.cc:492] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.341615  7824 raft_consensus.cc:359] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.342317  7824 raft_consensus.cc:385] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.342595  7824 raft_consensus.cc:740] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.342625  7825 ts_tablet_manager.cc:1434] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:01:20.343794  7825 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:20.344867  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:20.346284  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:20.346520  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6567006f2659467e8fa74d383dddd8c0" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:20.349138  7746 leader_election.cc:343] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.349131  7706 raft_consensus.cc:3060] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.352480  8061 leader_election.cc:290] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:20.355249  7826 tablet_bootstrap.cc:492] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:20.356058  7826 ts_tablet_manager.cc:1403] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 13:01:20.343354  7824 consensus_queue.cc:260] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.359155  7826 raft_consensus.cc:359] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.359920  7826 raft_consensus.cc:385] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.360136  7824 ts_tablet_manager.cc:1434] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:01:20.361721  7826 raft_consensus.cc:740] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.362416  7824 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:20.372555  7824 tablet_bootstrap.cc:654] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:20.376590  7745 leader_election.cc:343] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.377151  7745 leader_election.cc:304] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.378293  7837 raft_consensus.cc:2749] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:20.379274  7597 leader_election.cc:343] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.363389  7706 raft_consensus.cc:2468] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:20.373368  7826 consensus_queue.cc:260] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.362521  7829 tablet_bootstrap.cc:654] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.395744  7826 ts_tablet_manager.cc:1434] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:01:20.320863  8057 raft_consensus.cc:697] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:20.396780  7826 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:20.375067  7825 tablet_bootstrap.cc:654] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.397042  8057 consensus_queue.cc:237] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.403684  7826 tablet_bootstrap.cc:654] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.411881  7825 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:20.412587  7825 ts_tablet_manager.cc:1403] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.006s
I20260709 13:01:20.420068  7598 leader_election.cc:304] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:20.421281  8065 raft_consensus.cc:2804] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.422070  8065 raft_consensus.cc:697] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:20.423048  8065 consensus_queue.cc:237] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
W20260709 13:01:20.424371  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:20.428406  7826 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:20.429123  7826 ts_tablet_manager.cc:1403] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 13:01:20.429309  7829 tablet_bootstrap.cc:492] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.429816  7829 ts_tablet_manager.cc:1403] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.000s
I20260709 13:01:20.431660  8002 raft_consensus.cc:493] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.431808  7824 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:20.432529  7824 ts_tablet_manager.cc:1403] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.012s
I20260709 13:01:20.432176  8002 raft_consensus.cc:515] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.434554  8002 leader_election.cc:290] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:20.435431  7824 raft_consensus.cc:359] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.436244  7824 raft_consensus.cc:385] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.436556  7824 raft_consensus.cc:740] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.436940  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294ddc69dc9b4dcf862a83483747739f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.416062  7825 raft_consensus.cc:359] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.437827  7825 raft_consensus.cc:385] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.437338  7824 consensus_queue.cc:260] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.438140  7825 raft_consensus.cc:740] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.438849  7825 consensus_queue.cc:260] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.439543  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294ddc69dc9b4dcf862a83483747739f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:20.440037  7824 ts_tablet_manager.cc:1434] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:20.440250  7556 raft_consensus.cc:2468] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:20.439832  7454 catalog_manager.cc:5697] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.441037  7825 ts_tablet_manager.cc:1434] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:01:20.444633  7825 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:20.441169  7824 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:20.441417  7829 raft_consensus.cc:359] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.445864  7829 raft_consensus.cc:385] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.446151  7829 raft_consensus.cc:740] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.446820  7829 consensus_queue.cc:260] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.452189  7824 tablet_bootstrap.cc:654] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.448807  7829 ts_tablet_manager.cc:1434] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:01:20.457006  7829 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.463869  7825 tablet_bootstrap.cc:654] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.467284  7829 tablet_bootstrap.cc:654] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.476716  8061 raft_consensus.cc:493] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.476786  7825 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:20.477669  7825 ts_tablet_manager.cc:1403] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 13:01:20.477377  8061 raft_consensus.cc:515] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.481801  8061 leader_election.cc:290] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.481750  7829 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.482240  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.482551  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.483304  7777 raft_consensus.cc:2468] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
W20260709 13:01:20.484308  7598 leader_election.cc:343] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.483740  7829 ts_tablet_manager.cc:1403] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 13:01:20.486567  7824 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:20.487124  7824 ts_tablet_manager.cc:1403] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.007s
I20260709 13:01:20.486173  7825 raft_consensus.cc:359] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.488432  7825 raft_consensus.cc:385] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.489646  7829 raft_consensus.cc:359] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.490487  7829 raft_consensus.cc:385] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.490787  7829 raft_consensus.cc:740] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.490715  7824 raft_consensus.cc:359] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.491420  7596 leader_election.cc:304] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.491672  7824 raft_consensus.cc:385] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.492105  7824 raft_consensus.cc:740] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.491739  7829 consensus_queue.cc:260] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.492380  8061 raft_consensus.cc:2804] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.493088  7824 consensus_queue.cc:260] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.493886  8061 raft_consensus.cc:493] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.494289  8061 raft_consensus.cc:3060] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.495106  7829 ts_tablet_manager.cc:1434] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:20.495612  7824 ts_tablet_manager.cc:1434] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:20.496616  7824 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:20.496889  7829 tablet_bootstrap.cc:492] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.488767  7825 raft_consensus.cc:740] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.503371  7824 tablet_bootstrap.cc:654] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.504249  7829 tablet_bootstrap.cc:654] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.503793  7825 consensus_queue.cc:260] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.512641  7825 ts_tablet_manager.cc:1434] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:01:20.514014  7825 tablet_bootstrap.cc:492] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:20.514844  7824 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:20.515338  7824 ts_tablet_manager.cc:1403] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:01:20.516258  7829 tablet_bootstrap.cc:492] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.517038  7829 ts_tablet_manager.cc:1403] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 13:01:20.518103  7824 raft_consensus.cc:359] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.518836  7824 raft_consensus.cc:385] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.519111  7824 raft_consensus.cc:740] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.519995  7824 consensus_queue.cc:260] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.520493  7829 raft_consensus.cc:359] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.521420  7829 raft_consensus.cc:385] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.521634  7892 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.521776  7829 raft_consensus.cc:740] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.522179  7892 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.522770  7829 consensus_queue.cc:260] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.525475  7829 ts_tablet_manager.cc:1434] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:20.525991  7892 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:20.526214  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.526810  7829 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.527182  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.527773  7824 ts_tablet_manager.cc:1434] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:01:20.528532  7522 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.529857  7824 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:20.526849  7777 raft_consensus.cc:2468] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:20.531631  7521 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:20.534332  7829 tablet_bootstrap.cc:654] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.534329  7894 raft_consensus.cc:2804] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.536492  7894 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.537014  7894 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.537176  7824 tablet_bootstrap.cc:654] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.549371  7825 tablet_bootstrap.cc:654] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.551751  7894 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.557549  7947 raft_consensus.cc:493] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.558794  7894 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:20.558495  7947 raft_consensus.cc:515] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.556986  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:20.560150  7777 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.560714  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:20.561864  7947 leader_election.cc:290] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
W20260709 13:01:20.563156  7522 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.564877  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d666861897c64b54b998b0df834afc31" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:20.565795  7555 raft_consensus.cc:2468] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:20.567353  7671 leader_election.cc:304] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:20.568578  7947 raft_consensus.cc:2804] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.569097  7947 raft_consensus.cc:493] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.569547  7947 raft_consensus.cc:3060] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.569625  7777 raft_consensus.cc:2468] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:20.573235  7829 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.573609  7825 tablet_bootstrap.cc:492] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:20.573869  7829 ts_tablet_manager.cc:1403] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.008s
I20260709 13:01:20.574079  7825 ts_tablet_manager.cc:1403] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:01:20.577184  7745 leader_election.cc:304] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:20.584753  7887 raft_consensus.cc:2804] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.585188  7887 raft_consensus.cc:493] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.585513  7887 raft_consensus.cc:3060] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.585781  7454 catalog_manager.cc:5697] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.587191  7947 raft_consensus.cc:515] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.590699  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d666861897c64b54b998b0df834afc31" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.591692  7777 raft_consensus.cc:2468] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:20.577040  7825 raft_consensus.cc:359] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.578588  7837 consensus_queue.cc:1048] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.579162  7521 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:20.579777  7835 raft_consensus.cc:493] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.594470  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d666861897c64b54b998b0df834afc31" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:20.581586  7829 raft_consensus.cc:359] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.595013  7835 raft_consensus.cc:515] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.595120  7555 raft_consensus.cc:3060] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.595216  7829 raft_consensus.cc:385] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.595898  7829 raft_consensus.cc:740] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.597155  7835 leader_election.cc:290] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:20.597018  7829 consensus_queue.cc:260] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.597756  7894 raft_consensus.cc:2804] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.598276  7894 raft_consensus.cc:697] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:20.599052  7894 consensus_queue.cc:237] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.602114  7947 leader_election.cc:290] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:20.603814  7829 ts_tablet_manager.cc:1434] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:01:20.604936  7829 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.610507  7825 raft_consensus.cc:385] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.610862  7825 raft_consensus.cc:740] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.611145  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d666861897c64b54b998b0df834afc31" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:20.611755  7780 raft_consensus.cc:3060] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.611558  7825 consensus_queue.cc:260] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.612550  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.613413  7887 raft_consensus.cc:515] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.615526  7887 leader_election.cc:290] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
W20260709 13:01:20.620756  7746 leader_election.cc:343] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.507440  8061 raft_consensus.cc:515] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.623260  7555 raft_consensus.cc:2468] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:20.624007  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:20.624418  7780 raft_consensus.cc:2468] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:20.624722  7705 raft_consensus.cc:3060] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.625291  7671 leader_election.cc:304] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:20.631520  7829 tablet_bootstrap.cc:654] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.635365  7705 raft_consensus.cc:2468] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:20.636384  8057 raft_consensus.cc:2804] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.637064  8057 raft_consensus.cc:697] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:20.637466  7829 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:20.636987  7598 leader_election.cc:304] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:20.638110  7829 ts_tablet_manager.cc:1403] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:01:20.638409  8065 raft_consensus.cc:2804] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.638212  8057 consensus_queue.cc:237] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.639107  8065 raft_consensus.cc:697] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:20.640312  8065 consensus_queue.cc:237] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.641191  7829 raft_consensus.cc:359] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.642051  7829 raft_consensus.cc:385] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.642360  7829 raft_consensus.cc:740] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.643057  7829 consensus_queue.cc:260] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.645220  7829 ts_tablet_manager.cc:1434] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:20.646399  7829 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:20.653373  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294ddc69dc9b4dcf862a83483747739f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:20.653728  7745 leader_election.cc:343] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.654062  7554 raft_consensus.cc:3060] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.656188  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.658646  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294ddc69dc9b4dcf862a83483747739f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:20.660315  7825 ts_tablet_manager.cc:1434] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:01:20.661371  7825 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:20.666210  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:20.666896  7780 raft_consensus.cc:3060] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.668542  8061 leader_election.cc:290] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.643362  7826 raft_consensus.cc:359] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.670341  7826 raft_consensus.cc:385] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.670637  7826 raft_consensus.cc:740] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.671439  7826 consensus_queue.cc:260] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.672307  7629 raft_consensus.cc:3060] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.674669  7780 raft_consensus.cc:2468] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:20.679399  7629 raft_consensus.cc:2468] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:20.682147  7451 catalog_manager.cc:5697] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.683328  7826 ts_tablet_manager.cc:1434] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.254s	user 0.005s	sys 0.001s
I20260709 13:01:20.675238  7454 catalog_manager.cc:5697] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.688053  8061 consensus_queue.cc:1048] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.689935  7826 tablet_bootstrap.cc:492] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:20.694262  7892 raft_consensus.cc:493] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.694797  7892 raft_consensus.cc:515] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.696316  7826 tablet_bootstrap.cc:654] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.697933  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.698755  7706 raft_consensus.cc:2393] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate 53979e9879e74487a8a95daacdefdbcd in this term.
I20260709 13:01:20.698792  7892 leader_election.cc:290] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:20.700749  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ef9b1313942e19ca2a8e43a49ed8c" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.702731  7522 leader_election.cc:304] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.704149  7894 raft_consensus.cc:3060] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.704057  7453 catalog_manager.cc:5697] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.705916  7825 tablet_bootstrap.cc:654] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:20.713542  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 58727.8us
W20260709 13:01:20.714839  7746 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38267, user_credentials={real_user=slave}} blocked reactor thread for 59614.4us
W20260709 13:01:20.720584  7597 consensus_peers.cc:597] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:20.722222  7835 raft_consensus.cc:493] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.722746  7835 raft_consensus.cc:515] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.724690  7835 leader_election.cc:290] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:20.732363  7887 consensus_queue.cc:1048] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:20.734301  7894 raft_consensus.cc:2749] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.733940  7825 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:20.737277  7825 ts_tablet_manager.cc:1403] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 13:01:20.732216  7826 tablet_bootstrap.cc:492] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:20.740857  7826 ts_tablet_manager.cc:1403] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.002s
I20260709 13:01:20.742743  7554 raft_consensus.cc:2468] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:20.743714  7826 raft_consensus.cc:359] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.740093  7825 raft_consensus.cc:359] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.758780  7825 raft_consensus.cc:385] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.759147  7825 raft_consensus.cc:740] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.759817  7825 consensus_queue.cc:260] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.761700  7825 ts_tablet_manager.cc:1434] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:01:20.762785  7825 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:20.763237  7887 consensus_queue.cc:1048] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.765156  7745 leader_election.cc:304] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:20.770921  7826 raft_consensus.cc:385] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.772315  7835 raft_consensus.cc:2804] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.772620  7826 raft_consensus.cc:740] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.772815  7835 raft_consensus.cc:697] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:20.773658  7835 consensus_queue.cc:237] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.774560  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:20.776945  7826 consensus_queue.cc:260] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.780207  7826 ts_tablet_manager.cc:1434] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:01:20.781081  8064 raft_consensus.cc:493] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.781636  8064 raft_consensus.cc:515] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:20.784850  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.785491  7629 raft_consensus.cc:2468] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:20.786665  8064 leader_election.cc:290] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:20.786863  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443a208ce4b24ce880e010a7916485d4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.787990  7780 raft_consensus.cc:2393] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate ebe6c341a95a4deda3fd323405e42608 in this term.
I20260709 13:01:20.791018  7826 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:20.793126  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443a208ce4b24ce880e010a7916485d4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:20.795289  7825 tablet_bootstrap.cc:654] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.795878  7598 leader_election.cc:304] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.801458  8064 raft_consensus.cc:3060] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.802249  7829 tablet_bootstrap.cc:654] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.802052  8057 consensus_queue.cc:1048] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.815053  8064 raft_consensus.cc:2749] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.820730  8057 raft_consensus.cc:493] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.821348  8057 raft_consensus.cc:515] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.824435  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6567006f2659467e8fa74d383dddd8c0" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:20.825145  7777 raft_consensus.cc:2468] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:20.825354  7947 raft_consensus.cc:493] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.825419  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6567006f2659467e8fa74d383dddd8c0" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:20.826033  7947 raft_consensus.cc:515] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.826443  7670 leader_election.cc:304] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:20.827450  7824 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:20.827382  7929 raft_consensus.cc:2804] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.828085  7824 ts_tablet_manager.cc:1403] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.298s	user 0.103s	sys 0.099s
I20260709 13:01:20.828182  7947 leader_election.cc:290] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:20.828248  7929 raft_consensus.cc:493] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.835506  7929 raft_consensus.cc:3060] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.834770  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0b66f27b97469aa22ddc9191bad56d" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:20.841840  7555 raft_consensus.cc:2468] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
W20260709 13:01:20.829687  7671 leader_election.cc:343] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.845139  7671 leader_election.cc:304] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
W20260709 13:01:20.832932  7745 leader_election.cc:343] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.846889  7745 leader_election.cc:304] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:20.848320  8002 raft_consensus.cc:2749] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.849332  7745 leader_election.cc:304] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:20.851011  8002 raft_consensus.cc:2804] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.851500  8002 raft_consensus.cc:493] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.851882  8002 raft_consensus.cc:3060] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.852727  8057 leader_election.cc:290] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:20.853264  8119 raft_consensus.cc:2804] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.830729  7824 raft_consensus.cc:359] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.854825  7824 raft_consensus.cc:385] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.855130  7824 raft_consensus.cc:740] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.856082  7824 consensus_queue.cc:260] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.858489  7826 tablet_bootstrap.cc:654] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.861270  7824 ts_tablet_manager.cc:1434] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:01:20.868291  7824 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:20.856151  8119 raft_consensus.cc:493] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.872133  8119 raft_consensus.cc:3060] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.834555  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0b66f27b97469aa22ddc9191bad56d" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:20.898838  7929 raft_consensus.cc:515] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:20.901465  8002 raft_consensus.cc:515] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.903635  8002 leader_election.cc:290] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
W20260709 13:01:20.909595  7745 leader_election.cc:343] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.912549  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:20.934382  7671 leader_election.cc:343] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.935546  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:20.936209  7631 raft_consensus.cc:3060] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.936451  8057 consensus_queue.cc:1048] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.951021  8119 raft_consensus.cc:515] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:20.927886  7451 catalog_manager.cc:5697] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.954936  7835 consensus_queue.cc:1048] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.960155  7824 tablet_bootstrap.cc:654] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.983143  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6567006f2659467e8fa74d383dddd8c0" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:20.996459  7826 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:20.997035  7826 ts_tablet_manager.cc:1403] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.206s	user 0.046s	sys 0.031s
I20260709 13:01:20.993255  7556 raft_consensus.cc:3060] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.971894  7829 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:21.002686  7829 ts_tablet_manager.cc:1403] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.356s	user 0.022s	sys 0.018s
W20260709 13:01:20.963140  7745 leader_election.cc:343] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:21.008760  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 45672.3us
I20260709 13:01:21.007889  7829 raft_consensus.cc:359] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.009613  7835 raft_consensus.cc:493] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.009953  7829 raft_consensus.cc:385] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.010375  7835 raft_consensus.cc:515] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.010375  7829 raft_consensus.cc:740] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.014437  7829 consensus_queue.cc:260] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:20.972055  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6567006f2659467e8fa74d383dddd8c0" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:20.979858  7929 leader_election.cc:290] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:20.969787  7631 raft_consensus.cc:2468] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:21.027423  7829 ts_tablet_manager.cc:1434] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:01:21.029894  7829 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:21.034917  7825 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:21.035449  7825 ts_tablet_manager.cc:1403] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.002s
I20260709 13:01:21.018765  7780 raft_consensus.cc:3060] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.037832  7835 leader_election.cc:290] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:21.042609  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:21.044481  7745 leader_election.cc:304] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.046098  8113 raft_consensus.cc:2804] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.046555  8113 raft_consensus.cc:697] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:21.052073  7825 raft_consensus.cc:359] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.052800  7825 raft_consensus.cc:385] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.053097  7825 raft_consensus.cc:740] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.047346  7934 consensus_queue.cc:1048] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:21.053846  7825 consensus_queue.cc:260] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.057807  7826 raft_consensus.cc:359] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.059774  7826 raft_consensus.cc:385] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.060052  7826 raft_consensus.cc:740] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.057639  8064 consensus_queue.cc:1048] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:01:21.070868  8119 leader_election.cc:290] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:21.056603  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:21.074512  7706 raft_consensus.cc:2468] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:21.047379  8113 consensus_queue.cc:237] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.084126  7825 ts_tablet_manager.cc:1434] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:01:21.084734  7824 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:21.085439  7824 ts_tablet_manager.cc:1403] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.217s	user 0.010s	sys 0.018s
I20260709 13:01:21.085649  7825 tablet_bootstrap.cc:492] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
W20260709 13:01:21.058241  7745 leader_election.cc:343] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.090298  7826 consensus_queue.cc:260] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.096010  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0b66f27b97469aa22ddc9191bad56d" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
W20260709 13:01:21.098170  7671 leader_election.cc:343] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.098160  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0b66f27b97469aa22ddc9191bad56d" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:21.098445  7825 tablet_bootstrap.cc:654] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.099962  7824 raft_consensus.cc:359] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.104827  7824 raft_consensus.cc:385] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.102591  7555 raft_consensus.cc:3060] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.105230  7824 raft_consensus.cc:740] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.112840  7824 consensus_queue.cc:260] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.113631  7826 ts_tablet_manager.cc:1434] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.002s
W20260709 13:01:21.101426  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 44336.4us
I20260709 13:01:21.114945  7826 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:21.119285  7746 leader_election.cc:304] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.122561  7824 ts_tablet_manager.cc:1434] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:01:21.123559  7824 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:21.123502  8113 raft_consensus.cc:2804] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.127882  8113 raft_consensus.cc:493] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.132738  8113 raft_consensus.cc:3060] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.143476  8113 raft_consensus.cc:515] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.143112  7455 catalog_manager.cc:5697] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.145646  8113 leader_election.cc:290] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:21.150362  7824 tablet_bootstrap.cc:654] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.151805  7556 raft_consensus.cc:2468] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:21.153883  8113 raft_consensus.cc:493] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.156659  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:21.168206  8120 raft_consensus.cc:493] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.168630  7706 raft_consensus.cc:3060] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.168766  8120 raft_consensus.cc:515] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.169401  7555 raft_consensus.cc:2468] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:21.170280  7934 raft_consensus.cc:493] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.170785  7934 raft_consensus.cc:515] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.171018  8120 leader_election.cc:290] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:21.171963  7892 consensus_queue.cc:1048] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.172871  7934 leader_election.cc:290] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:21.174124  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539aa1a1c68405e955915052a212104" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:21.174798  7630 raft_consensus.cc:2468] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:21.175478  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539aa1a1c68405e955915052a212104" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:21.176148  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:21.177111  7778 raft_consensus.cc:2468] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:21.176201  7671 leader_election.cc:304] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:21.178390  7671 leader_election.cc:304] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:21.179292  7929 raft_consensus.cc:2804] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.179791  7929 raft_consensus.cc:697] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:21.180294  8113 raft_consensus.cc:515] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.180632  7929 consensus_queue.cc:237] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.182435  8113 leader_election.cc:290] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:21.184137  8057 raft_consensus.cc:2804] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.184882  8057 raft_consensus.cc:697] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:21.185778  8057 consensus_queue.cc:237] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.187381  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
W20260709 13:01:21.189575  7671 leader_election.cc:343] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.190016  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3022e4bfdc4b6db39017acd5786020" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:21.190768  8117 consensus_queue.cc:1048] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:21.191480  7745 leader_election.cc:343] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.195948  7596 leader_election.cc:304] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:21.196733  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:21.196879  7934 raft_consensus.cc:2804] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.197487  7934 raft_consensus.cc:493] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.197932  7934 raft_consensus.cc:3060] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:21.200592  7522 consensus_peers.cc:597] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:21.201093  7598 leader_election.cc:343] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.201368  7671 leader_election.cc:304] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.202356  8117 raft_consensus.cc:2804] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.202731  8117 raft_consensus.cc:493] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.203167  8117 raft_consensus.cc:3060] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.214529  7933 consensus_queue.cc:1048] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.161194  7780 raft_consensus.cc:2468] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:21.235181  7829 tablet_bootstrap.cc:654] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.239018  7826 tablet_bootstrap.cc:654] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.264385  8120 consensus_queue.cc:1048] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:21.276568  8120 raft_consensus.cc:493] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.277166  8120 raft_consensus.cc:515] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.279692  8120 leader_election.cc:290] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:21.281087  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:21.282678  7670 leader_election.cc:343] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.282570  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:21.289041  8117 raft_consensus.cc:515] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.274219  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3022e4bfdc4b6db39017acd5786020" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:21.305126  7824 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:21.307889  7824 ts_tablet_manager.cc:1403] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.009s
I20260709 13:01:21.306115  8117 leader_election.cc:290] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:21.274680  7706 raft_consensus.cc:2468] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
W20260709 13:01:21.306933  7671 leader_election.cc:343] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.312572  7557 raft_consensus.cc:3060] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.341404  7825 tablet_bootstrap.cc:492] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:21.341938  7825 ts_tablet_manager.cc:1403] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.257s	user 0.042s	sys 0.058s
I20260709 13:01:21.344246  7455 catalog_manager.cc:5697] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:21.318605  7745 leader_election.cc:343] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.345101  7825 raft_consensus.cc:359] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.347023  7825 raft_consensus.cc:385] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.347307  7825 raft_consensus.cc:740] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.347188  7455 catalog_manager.cc:5697] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.352351  7825 consensus_queue.cc:260] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.335788  7671 leader_election.cc:304] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.361887  7746 leader_election.cc:304] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.363090  7887 raft_consensus.cc:2804] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.365247  7933 consensus_queue.cc:1048] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.367390  7887 raft_consensus.cc:697] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
W20260709 13:01:21.369290  8134 log.cc:927] Time spent T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:01:21.368724  7887 consensus_queue.cc:237] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.385030  7825 ts_tablet_manager.cc:1434] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:01:21.387473  7825 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
W20260709 13:01:21.389071  7671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 85474.8us
I20260709 13:01:21.382822  8117 raft_consensus.cc:2749] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:21.400895  7824 raft_consensus.cc:359] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.405447  7824 raft_consensus.cc:385] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.405756  7824 raft_consensus.cc:740] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.407719  7824 consensus_queue.cc:260] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.424925  7826 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:21.425427  7826 ts_tablet_manager.cc:1403] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.311s	user 0.021s	sys 0.003s
W20260709 13:01:21.424201  7521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 55567.1us
I20260709 13:01:21.424494  7934 raft_consensus.cc:515] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.455277  7829 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:21.467028  7829 ts_tablet_manager.cc:1403] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.439s	user 0.018s	sys 0.004s
I20260709 13:01:21.440438  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539aa1a1c68405e955915052a212104" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:21.439101  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539aa1a1c68405e955915052a212104" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:21.479590  7824 ts_tablet_manager.cc:1434] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.171s	user 0.026s	sys 0.022s
I20260709 13:01:21.481518  7824 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:21.481480  8132 log.cc:927] Time spent T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:01:21.478499  7630 raft_consensus.cc:3060] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.501327  7829 raft_consensus.cc:359] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.502110  7829 raft_consensus.cc:385] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.502386  7829 raft_consensus.cc:740] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.503054  7829 consensus_queue.cc:260] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.510217  7829 ts_tablet_manager.cc:1434] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
W20260709 13:01:21.509820  7671 leader_election.cc:343] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:21.523723  7745 leader_election.cc:343] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.524287  7745 leader_election.cc:304] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.525871  8002 raft_consensus.cc:2749] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:21.526839  7835 consensus_queue.cc:1048] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.528087  7835 consensus_queue.cc:1048] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.528458  7453 catalog_manager.cc:5697] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.535477  7829 tablet_bootstrap.cc:492] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:21.564929  7630 raft_consensus.cc:2468] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:21.569590  7671 leader_election.cc:304] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:21.570830  8057 raft_consensus.cc:2804] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.570684  7837 consensus_queue.cc:1048] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.571412  8057 raft_consensus.cc:697] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:21.571803  7934 leader_election.cc:290] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:21.572345  8057 consensus_queue.cc:237] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.573557  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:21.574204  7777 raft_consensus.cc:3060] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.580410  8140 raft_consensus.cc:493] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.581043  8140 raft_consensus.cc:515] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.586480  7824 tablet_bootstrap.cc:654] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.587061  7829 tablet_bootstrap.cc:654] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:21.587349  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:21.600847  8057 consensus_queue.cc:1048] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.595599  7826 raft_consensus.cc:359] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.601626  7826 raft_consensus.cc:385] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.602031  7826 raft_consensus.cc:740] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.602926  7826 consensus_queue.cc:260] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.605855  7777 raft_consensus.cc:2468] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:21.607446  8140 leader_election.cc:290] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:21.609773  7596 leader_election.cc:304] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:21.610595  8064 raft_consensus.cc:2804] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.611059  8064 raft_consensus.cc:697] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:21.610824  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5e9a92801e4073b7efd1cf6ec0b299" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:21.612018  8064 consensus_queue.cc:237] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.628621  7826 ts_tablet_manager.cc:1434] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.203s	user 0.007s	sys 0.001s
I20260709 13:01:21.630249  7826 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
W20260709 13:01:21.631809  7522 leader_election.cc:343] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.649451  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:21.649922  7825 tablet_bootstrap.cc:654] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.650425  7706 raft_consensus.cc:3060] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.672659  7455 catalog_manager.cc:5697] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.692150  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5e9a92801e4073b7efd1cf6ec0b299" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:21.696822  7628 raft_consensus.cc:3060] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:21.701529  7523 leader_election.cc:343] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.702004  7523 leader_election.cc:304] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:21.711464  7892 raft_consensus.cc:2749] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:21.714069  8057 consensus_queue.cc:1048] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.723845  7929 consensus_queue.cc:1048] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.729001  7829 tablet_bootstrap.cc:492] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:21.729592  7829 ts_tablet_manager.cc:1403] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.194s	user 0.029s	sys 0.055s
I20260709 13:01:21.739503  7826 tablet_bootstrap.cc:654] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.744576  7706 raft_consensus.cc:2468] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:21.752876  7453 catalog_manager.cc:5697] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.769593  7829 raft_consensus.cc:359] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.770370  7829 raft_consensus.cc:385] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.770633  7829 raft_consensus.cc:740] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.773085  7829 consensus_queue.cc:260] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:21.783222  8137 raft_consensus.cc:493] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.783785  8137 raft_consensus.cc:515] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.789620  7829 ts_tablet_manager.cc:1434] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.002s
I20260709 13:01:21.791056  7829 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:21.801121  8137 leader_election.cc:290] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
W20260709 13:01:21.802160  7745 consensus_peers.cc:597] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:21.804693  8002 consensus_queue.cc:1048] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.806535  7824 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:21.807039  7824 ts_tablet_manager.cc:1403] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.326s	user 0.013s	sys 0.015s
I20260709 13:01:21.807374  7825 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:21.807886  7825 ts_tablet_manager.cc:1403] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.421s	user 0.013s	sys 0.007s
I20260709 13:01:21.810132  7824 raft_consensus.cc:359] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.811304  7824 raft_consensus.cc:385] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.811658  7824 raft_consensus.cc:740] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.813515  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0b66f27b97469aa22ddc9191bad56d" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:21.813357  7824 consensus_queue.cc:260] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.816087  7824 ts_tablet_manager.cc:1434] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:21.816628  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c0b66f27b97469aa22ddc9191bad56d" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:21.822247  7824 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:21.823784  7826 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:21.831364  7826 ts_tablet_manager.cc:1403] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.202s	user 0.017s	sys 0.000s
I20260709 13:01:21.832547  8117 consensus_queue.cc:1048] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.834928  7826 raft_consensus.cc:359] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.835769  7826 raft_consensus.cc:385] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.810472  7825 raft_consensus.cc:359] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.836485  7825 raft_consensus.cc:385] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.836740  7825 raft_consensus.cc:740] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.837656  7825 consensus_queue.cc:260] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.840150  7825 ts_tablet_manager.cc:1434] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:01:21.841143  7825 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:21.836092  7826 raft_consensus.cc:740] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.843200  7826 consensus_queue.cc:260] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.845634  7829 tablet_bootstrap.cc:654] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.843350  7598 leader_election.cc:304] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:21.849385  7826 ts_tablet_manager.cc:1434] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:01:21.857283  7826 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:21.859298  7824 tablet_bootstrap.cc:654] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.860308  7825 tablet_bootstrap.cc:654] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.864789  7826 tablet_bootstrap.cc:654] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.871340  7552 raft_consensus.cc:3060] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.907032  7929 raft_consensus.cc:493] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.911419  7824 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:21.911926  7824 ts_tablet_manager.cc:1403] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.004s
I20260709 13:01:21.912922  7929 raft_consensus.cc:515] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.916541  7929 leader_election.cc:290] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:21.917460  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5e9a92801e4073b7efd1cf6ec0b299" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:21.918210  7553 raft_consensus.cc:2468] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:21.920447  7671 leader_election.cc:304] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:21.921569  8137 raft_consensus.cc:2749] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:21.923683  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5e9a92801e4073b7efd1cf6ec0b299" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:21.922102  7929 raft_consensus.cc:2804] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.925776  7929 raft_consensus.cc:493] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.926123  7929 raft_consensus.cc:3060] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:21.927624  7671 leader_election.cc:343] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.930497  8142 raft_consensus.cc:493] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.931042  8142 raft_consensus.cc:515] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.934891  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:21.936183  7837 consensus_queue.cc:1048] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.937536  8142 leader_election.cc:290] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:21.938380  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744ab78ecf16420aa63391410de204e2" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:21.939874  7523 leader_election.cc:304] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:21.940955  8142 raft_consensus.cc:2749] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:21.942286  7825 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:21.942790  7825 ts_tablet_manager.cc:1403] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.009s
I20260709 13:01:21.943091  7824 raft_consensus.cc:359] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.950412  7824 raft_consensus.cc:385] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.950904  7824 raft_consensus.cc:740] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.945463  7825 raft_consensus.cc:359] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.954092  7825 raft_consensus.cc:385] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.954404  7825 raft_consensus.cc:740] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.946892  7826 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:21.955544  7826 ts_tablet_manager.cc:1403] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.000s
I20260709 13:01:21.958295  7826 raft_consensus.cc:359] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.958982  7826 raft_consensus.cc:385] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.959257  7826 raft_consensus.cc:740] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.954572  7824 consensus_queue.cc:260] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:21.955087  7825 consensus_queue.cc:260] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.962399  7825 ts_tablet_manager.cc:1434] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:01:21.959908  7826 consensus_queue.cc:260] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.963285  7825 tablet_bootstrap.cc:492] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:21.949312  7929 raft_consensus.cc:515] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:21.944892  7829 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:21.962821  7824 ts_tablet_manager.cc:1434] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:01:21.972693  7829 ts_tablet_manager.cc:1403] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.012s
I20260709 13:01:21.975446  7829 raft_consensus.cc:359] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.976136  7829 raft_consensus.cc:385] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.976441  7829 raft_consensus.cc:740] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.965095  7826 ts_tablet_manager.cc:1434] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:21.978012  7826 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:21.981917  7824 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:21.988900  7929 leader_election.cc:290] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:21.989614  7829 consensus_queue.cc:260] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:21.992564  7825 tablet_bootstrap.cc:654] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.993867  7829 ts_tablet_manager.cc:1434] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:01:21.994879  7829 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:21.995667  7826 tablet_bootstrap.cc:654] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.998893  7824 tablet_bootstrap.cc:654] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.998910  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5e9a92801e4073b7efd1cf6ec0b299" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:21.999740  7553 raft_consensus.cc:3060] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.004932  8002 raft_consensus.cc:493] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.005496  8002 raft_consensus.cc:515] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.009714  8002 leader_election.cc:290] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.011343  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:22.012046  7704 raft_consensus.cc:2468] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:21.991205  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5e9a92801e4073b7efd1cf6ec0b299" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:22.017004  7746 leader_election.cc:304] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:22.018015  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:22.018183  8002 raft_consensus.cc:2804] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.018672  8002 raft_consensus.cc:493] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.019012  8002 raft_consensus.cc:3060] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:22.022125  7745 leader_election.cc:343] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.022621  7630 raft_consensus.cc:3060] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.009842  7829 tablet_bootstrap.cc:654] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.032299  7826 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:22.032855  7826 ts_tablet_manager.cc:1403] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:01:22.038764  8151 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.039353  8151 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.044817  7826 raft_consensus.cc:359] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.045374  7826 raft_consensus.cc:385] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.045550  7826 raft_consensus.cc:740] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.046067  7826 consensus_queue.cc:260] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.048998  8002 raft_consensus.cc:515] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.051128  8002 leader_election.cc:290] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.055820  7553 raft_consensus.cc:2468] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:22.056169  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:22.056914  7704 raft_consensus.cc:3060] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.055859  8137 consensus_queue.cc:1048] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:22.060199  7671 leader_election.cc:304] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:22.064527  7929 raft_consensus.cc:2804] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.065239  7929 raft_consensus.cc:697] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:22.066360  7929 consensus_queue.cc:237] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.069767  7704 raft_consensus.cc:2468] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:22.070034  8151 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.070732  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:22.070909  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:22.071039  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:22.072508  7745 leader_election.cc:343] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.073005  7745 leader_election.cc:304] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:22.076918  7837 raft_consensus.cc:2804] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.077410  7837 raft_consensus.cc:697] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:22.081739  7826 ts_tablet_manager.cc:1434] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:01:22.083616  7826 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:22.078217  7837 consensus_queue.cc:237] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.087785  7824 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:22.088354  7824 ts_tablet_manager.cc:1403] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.006s
I20260709 13:01:22.095573  7825 tablet_bootstrap.cc:492] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:22.096660  7824 raft_consensus.cc:359] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.097513  7824 raft_consensus.cc:385] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.097867  7824 raft_consensus.cc:740] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.098743  7824 consensus_queue.cc:260] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.100271  7825 ts_tablet_manager.cc:1403] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.008s
I20260709 13:01:22.102749  7826 tablet_bootstrap.cc:654] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.103199  7825 raft_consensus.cc:359] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.105500  7825 raft_consensus.cc:385] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.105942  7825 raft_consensus.cc:740] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.106870  7825 consensus_queue.cc:260] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.108443  7824 ts_tablet_manager.cc:1434] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:01:22.109645  7824 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:22.110098  7825 ts_tablet_manager.cc:1434] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:01:22.111406  7825 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:22.115847  7829 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:22.072978  7597 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
W20260709 13:01:22.187913  7597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 114793us
I20260709 13:01:22.204069  7829 ts_tablet_manager.cc:1403] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.209s	user 0.026s	sys 0.012s
I20260709 13:01:22.204385  7837 raft_consensus.cc:493] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.201567  7929 consensus_queue.cc:1048] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:01:22.195289  7826 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:22.219492  8064 raft_consensus.cc:2749] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.220892  7826 ts_tablet_manager.cc:1403] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.000s
I20260709 13:01:22.242039  7552 raft_consensus.cc:3060] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.205513  7837 raft_consensus.cc:515] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.257372  8117 raft_consensus.cc:493] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.258165  8117 raft_consensus.cc:515] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.268133  8113 raft_consensus.cc:493] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.269083  8113 raft_consensus.cc:515] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.257033  7829 raft_consensus.cc:359] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.272087  7829 raft_consensus.cc:385] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.273314  7829 raft_consensus.cc:740] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.258684  7553 raft_consensus.cc:3060] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.278120  7829 consensus_queue.cc:260] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.292699  7630 raft_consensus.cc:2468] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:22.292466  7826 raft_consensus.cc:359] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.298584  7826 raft_consensus.cc:385] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.299023  7826 raft_consensus.cc:740] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.294409  8117 leader_election.cc:290] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:22.299932  7826 consensus_queue.cc:260] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.302809  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37832dc21511480f8c27bcc81ccafae7" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:22.303800  7627 raft_consensus.cc:2468] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:22.306807  7551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37832dc21511480f8c27bcc81ccafae7" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:22.318872  8113 leader_election.cc:290] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.320169  7551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:22.327050  7671 leader_election.cc:304] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
W20260709 13:01:22.328541  7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 45074us
W20260709 13:01:22.331426  7745 leader_election.cc:343] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.334180  7829 ts_tablet_manager.cc:1434] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.129s	user 0.004s	sys 0.010s
I20260709 13:01:22.340826  7824 tablet_bootstrap.cc:654] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.328008  7825 tablet_bootstrap.cc:654] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.336041  7929 raft_consensus.cc:2804] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.342007  7929 raft_consensus.cc:493] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.342481  7929 raft_consensus.cc:3060] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.343618  7454 catalog_manager.cc:5697] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.346240  7451 catalog_manager.cc:5697] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.347358  7837 leader_election.cc:290] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:22.339000  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:22.350288  7627 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.356186  7829 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:22.356361  7826 ts_tablet_manager.cc:1434] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.002s
W20260709 13:01:22.358608  7671 leader_election.cc:343] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.363965  8182 raft_consensus.cc:493] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.372395  7933 consensus_queue.cc:1048] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:22.370050  8182 raft_consensus.cc:515] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
W20260709 13:01:22.377978  7746 leader_election.cc:343] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.378628  7746 leader_election.cc:304] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:22.378881  8182 leader_election.cc:290] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:22.358493  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:22.384946  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539aa1a1c68405e955915052a212104" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:22.392920  8113 raft_consensus.cc:2749] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.438603  7826 tablet_bootstrap.cc:492] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:22.442930  7929 raft_consensus.cc:515] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.456866  8186 consensus_queue.cc:1048] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:22.461571  7929 leader_election.cc:290] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:22.439797  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:22.463301  7551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37832dc21511480f8c27bcc81ccafae7" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:22.469195  7671 leader_election.cc:343] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:22.483886  7670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 75260.8us
W20260709 13:01:22.505980  7746 leader_election.cc:343] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.489738  8186 raft_consensus.cc:493] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.505077  7837 raft_consensus.cc:493] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.514173  8186 raft_consensus.cc:515] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.528899  8186 leader_election.cc:290] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:22.522344  7837 raft_consensus.cc:515] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.530762  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37832dc21511480f8c27bcc81ccafae7" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:22.531785  7629 raft_consensus.cc:3060] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.533265  7837 leader_election.cc:290] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.535073  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e898bc5032410ca78cbdab796104c0" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:22.539177  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:22.543051  7745 leader_election.cc:343] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.544811  7829 tablet_bootstrap.cc:654] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:22.548128  7671 leader_election.cc:343] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.545002  7825 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:22.554086  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539aa1a1c68405e955915052a212104" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:22.555338  8183 consensus_queue.cc:1048] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:22.558149  7825 ts_tablet_manager.cc:1403] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.447s	user 0.011s	sys 0.013s
W20260709 13:01:22.560886  7745 leader_election.cc:343] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.573881  7745 leader_election.cc:304] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:22.576311  8147 raft_consensus.cc:2749] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.586745  7706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:22.601578  7522 leader_election.cc:304] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:22.604315  8146 raft_consensus.cc:2749] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:22.614253  7746 leader_election.cc:343] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.614852  7746 leader_election.cc:304] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:22.604948  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e898bc5032410ca78cbdab796104c0" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:22.618397  7826 tablet_bootstrap.cc:654] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.620491  7934 raft_consensus.cc:493] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.621191  7934 raft_consensus.cc:515] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.620666  8002 raft_consensus.cc:2749] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:22.645159  7670 leader_election.cc:343] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.628347  7934 leader_election.cc:290] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.656504  7825 raft_consensus.cc:359] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.662024  7824 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:22.661810  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3022e4bfdc4b6db39017acd5786020" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:22.663568  7825 raft_consensus.cc:385] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.665284  7825 raft_consensus.cc:740] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.666807  7670 leader_election.cc:304] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:22.671414  8186 raft_consensus.cc:2749] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.675357  7778 raft_consensus.cc:2468] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:22.673456  7824 ts_tablet_manager.cc:1403] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.564s	user 0.017s	sys 0.041s
I20260709 13:01:22.678715  7596 leader_election.cc:304] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:22.682542  7934 raft_consensus.cc:2804] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.683048  7934 raft_consensus.cc:493] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.683431  7934 raft_consensus.cc:3060] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.686659  7629 raft_consensus.cc:2468] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
W20260709 13:01:22.694430  7745 consensus_peers.cc:597] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.722586  8186 consensus_queue.cc:1048] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:22.702463  7824 raft_consensus.cc:359] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.728523  7824 raft_consensus.cc:385] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.729014  7824 raft_consensus.cc:740] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.729686  7934 raft_consensus.cc:515] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.680342  7825 consensus_queue.cc:260] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.704376  7829 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:22.732676  7829 ts_tablet_manager.cc:1403] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.377s	user 0.014s	sys 0.012s
I20260709 13:01:22.733242  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3022e4bfdc4b6db39017acd5786020" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:22.733911  7778 raft_consensus.cc:3060] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.735949  7829 raft_consensus.cc:359] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.738770  7671 leader_election.cc:304] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:22.746088  8117 raft_consensus.cc:2804] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.746611  8117 raft_consensus.cc:697] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:22.747720  8117 consensus_queue.cc:237] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.748128  7829 raft_consensus.cc:385] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.750168  7829 raft_consensus.cc:740] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.750916  7829 consensus_queue.cc:260] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.741852  7825 ts_tablet_manager.cc:1434] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.168s	user 0.004s	sys 0.005s
I20260709 13:01:22.729962  7824 consensus_queue.cc:260] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.754045  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3022e4bfdc4b6db39017acd5786020" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:22.754807  7553 raft_consensus.cc:2468] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:22.755488  7824 ts_tablet_manager.cc:1434] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.003s
I20260709 13:01:22.744513  7934 leader_election.cc:290] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:22.762065  8147 consensus_queue.cc:1048] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:22.770053  7551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3022e4bfdc4b6db39017acd5786020" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:22.770762  7551 raft_consensus.cc:3060] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.774097  7824 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:22.776275  7825 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:22.777602  7826 tablet_bootstrap.cc:492] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:22.778158  7826 ts_tablet_manager.cc:1403] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.340s	user 0.023s	sys 0.001s
I20260709 13:01:22.782347  7826 raft_consensus.cc:359] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.783217  7826 raft_consensus.cc:385] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.783574  7826 raft_consensus.cc:740] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.784739  7826 consensus_queue.cc:260] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.787606  7829 ts_tablet_manager.cc:1434] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:01:22.789019  7829 tablet_bootstrap.cc:492] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:22.791249  7826 ts_tablet_manager.cc:1434] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:01:22.796990  8184 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.799736  8184 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.804889  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:22.806941  7745 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.807041  8184 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:22.812525  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:22.813405  7824 tablet_bootstrap.cc:654] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.814991  7826 tablet_bootstrap.cc:492] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
W20260709 13:01:22.817322  7745 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.818007  7745 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:22.827003  7934 raft_consensus.cc:493] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.827785  7934 raft_consensus.cc:515] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.833956  7825 tablet_bootstrap.cc:654] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.840713  7934 leader_election.cc:290] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:22.843118  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e898bc5032410ca78cbdab796104c0" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:22.843851  7703 raft_consensus.cc:2468] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:22.845590  7598 leader_election.cc:304] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:22.846555  7933 raft_consensus.cc:2804] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.846942  7933 raft_consensus.cc:493] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.847265  7933 raft_consensus.cc:3060] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.853921  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e898bc5032410ca78cbdab796104c0" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
W20260709 13:01:22.855746  7596 leader_election.cc:343] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.825268  8184 raft_consensus.cc:2749] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.861168  7551 raft_consensus.cc:2468] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:22.865350  7778 raft_consensus.cc:2468] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:22.867432  7829 tablet_bootstrap.cc:654] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.868847  8186 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.869401  8186 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:22.875511  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:22.876109  7824 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:22.877113  7596 leader_election.cc:304] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:22.878216  7826 tablet_bootstrap.cc:654] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.880065  7824 ts_tablet_manager.cc:1403] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.042s
I20260709 13:01:22.880384  8186 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:22.882650  7934 raft_consensus.cc:2804] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.879194  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:22.884063  7934 raft_consensus.cc:697] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
W20260709 13:01:22.886790  7671 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.890654  7934 consensus_queue.cc:237] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
W20260709 13:01:22.895743  7671 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.896413  7671 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:22.919298  8186 raft_consensus.cc:2749] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.947104  7933 raft_consensus.cc:515] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.963318  7824 raft_consensus.cc:359] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.964211  7824 raft_consensus.cc:385] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.964555  7824 raft_consensus.cc:740] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.966485  7825 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:22.967037  7825 ts_tablet_manager.cc:1403] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.191s	user 0.011s	sys 0.005s
I20260709 13:01:22.969329  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e898bc5032410ca78cbdab796104c0" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:22.969806  7825 raft_consensus.cc:359] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.970736  7824 consensus_queue.cc:260] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:22.972543  7825 raft_consensus.cc:385] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.972973  7825 raft_consensus.cc:740] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.973508  7824 ts_tablet_manager.cc:1434] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.093s	user 0.018s	sys 0.050s
I20260709 13:01:22.973894  7829 tablet_bootstrap.cc:492] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:22.973816  7825 consensus_queue.cc:260] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.974643  7824 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:22.975809  7825 ts_tablet_manager.cc:1434] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:01:22.976959  7825 tablet_bootstrap.cc:492] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:22.972028  7704 raft_consensus.cc:3060] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.982641  7824 tablet_bootstrap.cc:654] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.974509  7829 ts_tablet_manager.cc:1403] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.012s
I20260709 13:01:22.987088  7829 raft_consensus.cc:359] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:22.987939  7829 raft_consensus.cc:385] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.988329  7829 raft_consensus.cc:740] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.995134  7933 leader_election.cc:290] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:22.996702  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e898bc5032410ca78cbdab796104c0" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:23.001196  7824 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:23.011104  7829 consensus_queue.cc:260] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
W20260709 13:01:23.010144  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:23.011646  7824 ts_tablet_manager.cc:1403] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.009s
I20260709 13:01:23.012123  7778 raft_consensus.cc:3060] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.005246  7825 tablet_bootstrap.cc:654] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.016333  7824 raft_consensus.cc:359] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.018546  7824 raft_consensus.cc:385] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.018914  7824 raft_consensus.cc:740] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.019726  7824 consensus_queue.cc:260] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:22.959733  7455 catalog_manager.cc:5697] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.020208  7778 raft_consensus.cc:2468] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:23.028749  7596 leader_election.cc:304] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:23.021706  7824 ts_tablet_manager.cc:1434] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:23.029608  7933 raft_consensus.cc:2804] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:23.030129  7933 raft_consensus.cc:697] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:23.030812  7824 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:23.030993  7933 consensus_queue.cc:237] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.023937  7704 raft_consensus.cc:2468] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:23.031713  7829 ts_tablet_manager.cc:1434] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:01:23.054394  7824 tablet_bootstrap.cc:654] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.190227  7825 tablet_bootstrap.cc:492] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:23.190929  7825 ts_tablet_manager.cc:1403] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.003s
I20260709 13:01:23.227505  7826 tablet_bootstrap.cc:492] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:23.228127  7826 ts_tablet_manager.cc:1403] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.413s	user 0.022s	sys 0.016s
I20260709 13:01:23.245566  7829 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
W20260709 13:01:23.251389  7670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 61133.8us
I20260709 13:01:23.253850  7825 raft_consensus.cc:359] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.254441  7825 raft_consensus.cc:385] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.254662  7825 raft_consensus.cc:740] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.265375  7824 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:23.265935  7824 ts_tablet_manager.cc:1403] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.235s	user 0.034s	sys 0.018s
I20260709 13:01:23.278769  7825 consensus_queue.cc:260] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.294482  7826 raft_consensus.cc:359] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.295979  7826 raft_consensus.cc:385] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.300582  7826 raft_consensus.cc:740] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.309158  7826 consensus_queue.cc:260] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.289188  7824 raft_consensus.cc:359] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.310855  7824 raft_consensus.cc:385] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.314180  7824 raft_consensus.cc:740] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.314814  7557 raft_consensus.cc:3060] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.324713  7824 consensus_queue.cc:260] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.325730  7826 ts_tablet_manager.cc:1434] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.001s
W20260709 13:01:23.336483  7671 consensus_peers.cc:597] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.344858  7825 ts_tablet_manager.cc:1434] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.154s	user 0.008s	sys 0.001s
I20260709 13:01:23.368728  8146 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.369562  8146 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.380931  7824 ts_tablet_manager.cc:1434] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.005s
I20260709 13:01:23.382120  7824 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:23.399030  7825 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:23.404528  7826 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:23.426278  7829 tablet_bootstrap.cc:654] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.428514  8146 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:23.431149  7826 tablet_bootstrap.cc:654] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.434414  7824 tablet_bootstrap.cc:654] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.437579  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:23.438311  7777 raft_consensus.cc:2468] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:23.448360  8186 raft_consensus.cc:493] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.448920  8186 raft_consensus.cc:515] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.451041  8186 leader_election.cc:290] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:23.454756  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:23.456655  8183 consensus_queue.cc:1048] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:23.463526  8137 consensus_queue.cc:1048] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:23.475142  7521 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:23.476194  8224 raft_consensus.cc:2804] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:23.471635  7451 catalog_manager.cc:5697] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.479095  8224 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.481045  8224 raft_consensus.cc:3060] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.481277  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:23.483772  7825 tablet_bootstrap.cc:654] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.488981  7829 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:23.489497  7829 ts_tablet_manager.cc:1403] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.255s	user 0.014s	sys 0.016s
I20260709 13:01:23.492200  7829 raft_consensus.cc:359] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.495538  7829 raft_consensus.cc:385] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.495813  7829 raft_consensus.cc:740] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.470599  7777 raft_consensus.cc:2468] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
W20260709 13:01:23.511688  7671 leader_election.cc:343] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.515535  8221 raft_consensus.cc:493] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07d5308b5f834161a9f46b9565fa95e6)
I20260709 13:01:23.511102  7829 consensus_queue.cc:260] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.516105  8221 raft_consensus.cc:515] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.546960  7670 leader_election.cc:304] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:23.551437  7929 raft_consensus.cc:2804] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:23.551862  7929 raft_consensus.cc:493] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.552258  7929 raft_consensus.cc:3060] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.553158  7826 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:23.553660  7826 ts_tablet_manager.cc:1403] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.015s
I20260709 13:01:23.554280  7829 ts_tablet_manager.cc:1434] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:01:23.552268  8215 consensus_queue.cc:1048] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:23.562639  7630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:23.545786  7933 raft_consensus.cc:493] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.564311  7933 raft_consensus.cc:515] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.566344  7933 leader_election.cc:290] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:23.566450  8151 consensus_queue.cc:1048] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:23.577539  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:23.578248  7704 raft_consensus.cc:2468] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:23.582510  8224 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.583839  8221 leader_election.cc:290] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:23.585269  7598 leader_election.cc:304] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:23.570775  7826 raft_consensus.cc:359] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.587210  7826 raft_consensus.cc:385] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.587499  7826 raft_consensus.cc:740] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.589026  7829 tablet_bootstrap.cc:492] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:23.584677  8224 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:23.596324  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:23.596993  7778 raft_consensus.cc:3060] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.598153  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:23.598825  7776 raft_consensus.cc:2468] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:23.599378  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:23.600574  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:23.601756  7826 consensus_queue.cc:260] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.614049  7826 ts_tablet_manager.cc:1434] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:01:23.616498  7826 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:23.637094  7523 leader_election.cc:304] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:23.603763  7933 raft_consensus.cc:2804] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:23.638023  7933 raft_consensus.cc:493] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.638337  7824 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:23.638446  7933 raft_consensus.cc:3060] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.639068  7824 ts_tablet_manager.cc:1403] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.257s	user 0.022s	sys 0.028s
I20260709 13:01:23.639375  8151 consensus_queue.cc:1048] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:23.639096  8221 raft_consensus.cc:2749] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:23.642113  7824 raft_consensus.cc:359] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.642799  7824 raft_consensus.cc:385] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.643051  7824 raft_consensus.cc:740] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.643658  7824 consensus_queue.cc:260] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
W20260709 13:01:23.669592  7522 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.671316  7825 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:23.671911  7825 ts_tablet_manager.cc:1403] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.275s	user 0.018s	sys 0.011s
I20260709 13:01:23.673277  8140 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.673830  8140 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.674800  7825 raft_consensus.cc:359] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.675544  7825 raft_consensus.cc:385] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.675844  7825 raft_consensus.cc:740] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.676995  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:23.677676  7704 raft_consensus.cc:2468] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:23.678118  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:23.678424  7778 raft_consensus.cc:2468] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:23.676532  7825 consensus_queue.cc:260] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.679667  7523 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:23.680464  7521 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:23.689551  7824 ts_tablet_manager.cc:1434] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:01:23.691200  7829 tablet_bootstrap.cc:654] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.688022  8221 raft_consensus.cc:2804] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:23.701993  8221 raft_consensus.cc:697] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:23.703198  8221 consensus_queue.cc:237] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.685652  8224 raft_consensus.cc:2804] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:23.684845  8140 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:23.718946  7825 ts_tablet_manager.cc:1434] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:01:23.729852  7824 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:23.712561  8224 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.737519  7825 tablet_bootstrap.cc:492] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:23.731415  8140 raft_consensus.cc:493] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.735651  8224 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.768189  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:23.771447  7826 tablet_bootstrap.cc:654] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.775475  7824 tablet_bootstrap.cc:654] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.736373  7929 raft_consensus.cc:515] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.781100  7929 leader_election.cc:290] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
W20260709 13:01:23.754161  7522 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.785420  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:23.748005  8140 raft_consensus.cc:515] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.787945  7552 raft_consensus.cc:3060] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.794615  8140 leader_election.cc:290] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:23.800962  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:23.804019  7777 raft_consensus.cc:2468] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:23.799587  7454 catalog_manager.cc:5697] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } }
I20260709 13:01:23.807441  7521 leader_election.cc:304] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:23.803063  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
W20260709 13:01:23.806881  7522 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.808666  7702 raft_consensus.cc:2393] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate ebe6c341a95a4deda3fd323405e42608 in this term.
I20260709 13:01:23.809757  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b18450fa44dabc35d7960e67a0bc" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:23.810359  7779 raft_consensus.cc:3060] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.810269  7552 raft_consensus.cc:2468] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:23.805405  8224 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.822929  8224 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:23.826639  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:23.827170  7705 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.817353  8227 raft_consensus.cc:2764] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:01:23.802606  7933 raft_consensus.cc:515] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.848272  7829 tablet_bootstrap.cc:492] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:23.848879  7829 ts_tablet_manager.cc:1403] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.294s	user 0.036s	sys 0.003s
I20260709 13:01:23.852056  7829 raft_consensus.cc:359] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.853955  7829 raft_consensus.cc:385] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.854291  7829 raft_consensus.cc:740] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.855599  7829 consensus_queue.cc:260] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.858464  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:23.858919  7933 leader_election.cc:290] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:23.860189  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:23.860908  7777 raft_consensus.cc:3060] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.865922  8184 raft_consensus.cc:493] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.866506  8184 raft_consensus.cc:515] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.878289  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:23.916812  7702 raft_consensus.cc:3060] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:23.884467  7522 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.892311  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:23.894160  7705 raft_consensus.cc:2468] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:23.894356  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:23.921882  7523 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:23.923035  8221 raft_consensus.cc:2804] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:23.923527  8221 raft_consensus.cc:697] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
W20260709 13:01:23.924160  7745 leader_election.cc:343] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.927312  7826 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:23.927860  7826 ts_tablet_manager.cc:1403] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.313s	user 0.016s	sys 0.004s
I20260709 13:01:23.909555  7934 raft_consensus.cc:493] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.929203  7934 raft_consensus.cc:515] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:23.930101  7628 raft_consensus.cc:2468] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:23.911954  7777 raft_consensus.cc:2468] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:23.931106  7934 leader_election.cc:290] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:23.932942  7596 leader_election.cc:304] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:23.933768  7934 raft_consensus.cc:2804] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:23.934178  7934 raft_consensus.cc:697] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:23.878592  7824 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:23.934897  7824 ts_tablet_manager.cc:1403] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.223s	user 0.023s	sys 0.018s
I20260709 13:01:23.928882  8221 consensus_queue.cc:237] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.934949  7934 consensus_queue.cc:237] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.936566  7745 leader_election.cc:304] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:23.908179  7671 leader_election.cc:304] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:23.938083  8225 raft_consensus.cc:2804] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:23.938537  8225 raft_consensus.cc:697] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:23.939301  8225 consensus_queue.cc:237] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.940029  7824 raft_consensus.cc:359] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.940703  7824 raft_consensus.cc:385] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.940959  7824 raft_consensus.cc:740] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.941614  7824 consensus_queue.cc:260] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:23.943099  7824 ts_tablet_manager.cc:1434] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:01:23.943511  8248 raft_consensus.cc:2804] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:23.943990  8248 raft_consensus.cc:493] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.944340  7829 ts_tablet_manager.cc:1434] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.007s
I20260709 13:01:23.944816  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:23.944340  8248 raft_consensus.cc:3060] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.882264  8184 leader_election.cc:290] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:23.910208  7779 raft_consensus.cc:2468] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:23.947248  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:23.949476  7597 leader_election.cc:343] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:23.949065  7829 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:23.871615  7825 tablet_bootstrap.cc:654] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.953572  7824 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:23.950614  7702 raft_consensus.cc:2468] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:23.962227  7826 raft_consensus.cc:359] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.962940  7826 raft_consensus.cc:385] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.963212  7826 raft_consensus.cc:740] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.971808  7824 tablet_bootstrap.cc:654] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.984755  7825 tablet_bootstrap.cc:492] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:23.985438  7825 ts_tablet_manager.cc:1403] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.248s	user 0.014s	sys 0.000s
I20260709 13:01:23.987504  7451 catalog_manager.cc:5697] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.987221  7826 consensus_queue.cc:260] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:23.988459  7825 raft_consensus.cc:359] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.993738  7825 raft_consensus.cc:385] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:23.994063  7825 raft_consensus.cc:740] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:23.994815  7825 consensus_queue.cc:260] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:23.997233  7825 ts_tablet_manager.cc:1434] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:01:23.998273  7825 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:24.002566  7826 ts_tablet_manager.cc:1434] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:01:24.014161  7829 tablet_bootstrap.cc:654] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:23.978019  8248 raft_consensus.cc:515] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.032753  7826 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:24.032487  8148 raft_consensus.cc:493] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.037966  8148 raft_consensus.cc:515] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:24.045178  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:24.045868  7702 raft_consensus.cc:2468] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:24.046903  7451 catalog_manager.cc:5697] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.048236  7778 raft_consensus.cc:2393] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:24.041445  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:24.048813  8248 leader_election.cc:290] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
W20260709 13:01:24.050608  7745 leader_election.cc:343] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.040192  8148 leader_election.cc:290] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:24.052552  7551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:24.050518  7596 leader_election.cc:304] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:24.054268  7825 tablet_bootstrap.cc:654] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.054790  7933 raft_consensus.cc:3060] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.055176  7746 leader_election.cc:304] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:24.059023  8249 raft_consensus.cc:2804] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:24.059435  8249 raft_consensus.cc:493] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.059758  8249 raft_consensus.cc:3060] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.059854  8225 raft_consensus.cc:493] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.060467  7745 leader_election.cc:343] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.073012  8225 raft_consensus.cc:515] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.076831  8225 leader_election.cc:290] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:24.078167  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:24.078800  7557 raft_consensus.cc:2468] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:24.079397  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:24.079939  7671 leader_election.cc:304] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:24.080020  7779 raft_consensus.cc:2468] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 0.
I20260709 13:01:24.065713  7453 catalog_manager.cc:5697] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.081645  8186 raft_consensus.cc:2804] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:24.082031  8186 raft_consensus.cc:493] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.082355  8186 raft_consensus.cc:3060] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.080669  7824 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:24.085166  7824 ts_tablet_manager.cc:1403] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.011s
I20260709 13:01:24.052023  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:24.096719  7826 tablet_bootstrap.cc:654] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.103603  7451 catalog_manager.cc:5697] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.118700  7824 raft_consensus.cc:359] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.119509  7824 raft_consensus.cc:385] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.119779  7824 raft_consensus.cc:740] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.120599  7829 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:24.121105  7829 ts_tablet_manager.cc:1403] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.017s
I20260709 13:01:24.117906  7933 raft_consensus.cc:2749] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:24.121888  7825 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:24.122352  7825 ts_tablet_manager.cc:1403] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.006s
I20260709 13:01:24.123869  7829 raft_consensus.cc:359] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.124604  7829 raft_consensus.cc:385] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.124869  7829 raft_consensus.cc:740] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.125599  7829 consensus_queue.cc:260] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.127668  7829 ts_tablet_manager.cc:1434] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:24.128664  7829 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: Bootstrap starting.
I20260709 13:01:24.131512  7826 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:24.132000  7826 ts_tablet_manager.cc:1403] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.003s
I20260709 13:01:24.134344  7829 tablet_bootstrap.cc:654] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.135743  8186 raft_consensus.cc:515] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.138724  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:24.139297  7778 raft_consensus.cc:3060] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.134344  8249 raft_consensus.cc:515] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:24.141693  7826 raft_consensus.cc:359] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.142377  7826 raft_consensus.cc:385] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.142645  7826 raft_consensus.cc:740] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.128993  7825 raft_consensus.cc:359] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.143744  7825 raft_consensus.cc:385] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.144042  7825 raft_consensus.cc:740] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.146634  7825 consensus_queue.cc:260] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.147764  7826 consensus_queue.cc:260] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.148517  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:24.149060  7557 raft_consensus.cc:3060] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.149837  7826 ts_tablet_manager.cc:1434] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:01:24.151602  7628 raft_consensus.cc:2468] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:24.155478  7825 ts_tablet_manager.cc:1434] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:01:24.152245  7824 consensus_queue.cc:260] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.159360  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:24.160354  8249 leader_election.cc:290] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
W20260709 13:01:24.160828  7745 leader_election.cc:343] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.162688  7778 raft_consensus.cc:2468] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:24.163359  7745 leader_election.cc:304] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:24.163686  7557 raft_consensus.cc:2468] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:24.161430  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:24.164425  8148 raft_consensus.cc:2804] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:24.164660  7702 raft_consensus.cc:3060] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.164795  7671 leader_election.cc:304] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:24.164969  8148 raft_consensus.cc:697] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:24.165570  8225 raft_consensus.cc:2804] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:24.166043  8225 raft_consensus.cc:697] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:24.165865  8148 consensus_queue.cc:237] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.166939  8225 consensus_queue.cc:237] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.175283  7825 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608: Bootstrap starting.
I20260709 13:01:24.175735  7702 raft_consensus.cc:2468] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:24.177183  7746 leader_election.cc:304] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:24.177937  8184 raft_consensus.cc:2804] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:24.178582  8184 raft_consensus.cc:697] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:24.179514  8184 consensus_queue.cc:237] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:24.161794  7824 ts_tablet_manager.cc:1434] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.002s
I20260709 13:01:24.191995  7824 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:24.192411  8186 leader_election.cc:290] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:24.199735  7825 tablet_bootstrap.cc:654] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.204481  7829 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: No bootstrap required, opened a new log
I20260709 13:01:24.205042  7829 ts_tablet_manager.cc:1403] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.006s
I20260709 13:01:24.207379  7825 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608: No bootstrap required, opened a new log
I20260709 13:01:24.207842  7829 raft_consensus.cc:359] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.208597  7829 raft_consensus.cc:385] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.208886  7829 raft_consensus.cc:740] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.207872  7825 ts_tablet_manager.cc:1403] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.001s
I20260709 13:01:24.212271  7829 consensus_queue.cc:260] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.212688  7826 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:24.214772  7829 ts_tablet_manager.cc:1434] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:24.219542  7451 catalog_manager.cc:5697] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.217679  7825 raft_consensus.cc:359] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.220809  7825 raft_consensus.cc:385] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.221091  7825 raft_consensus.cc:740] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.221732  7825 consensus_queue.cc:260] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.223649  7824 tablet_bootstrap.cc:654] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.223879  7825 ts_tablet_manager.cc:1434] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:01:24.225663  7826 tablet_bootstrap.cc:654] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.239329  7824 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:24.239894  7824 ts_tablet_manager.cc:1403] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.004s
I20260709 13:01:24.241525  7453 catalog_manager.cc:5697] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.246742  7826 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
W20260709 13:01:24.246913  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:24.246618  7824 raft_consensus.cc:359] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.247378  7826 ts_tablet_manager.cc:1403] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.005s
I20260709 13:01:24.248294  7824 raft_consensus.cc:385] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.248673  7824 raft_consensus.cc:740] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.249358  7824 consensus_queue.cc:260] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.250227  7826 raft_consensus.cc:359] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.250939  7826 raft_consensus.cc:385] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.251215  7826 raft_consensus.cc:740] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.251500  7824 ts_tablet_manager.cc:1434] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:01:24.251911  7826 consensus_queue.cc:260] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.271144  7824 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:24.273480  8148 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.274039  8148 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.275995  8148 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:24.278162  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:24.280864  7745 leader_election.cc:343] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.282378  7826 ts_tablet_manager.cc:1434] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:01:24.283428  7826 tablet_bootstrap.cc:492] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:24.286556  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:24.291426  8224 consensus_queue.cc:1048] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:24.294947  7745 leader_election.cc:343] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.295385  7745 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:24.296375  8250 raft_consensus.cc:2749] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:24.298458  8137 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.298966  8137 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.304903  8137 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:24.304591  7628 raft_consensus.cc:3060] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.306612  7824 tablet_bootstrap.cc:654] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.306432  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:24.309046  7826 tablet_bootstrap.cc:654] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.310510  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:24.301827  7451 catalog_manager.cc:5697] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.323797  7597 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:24.330804  7824 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:24.331357  7824 ts_tablet_manager.cc:1403] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.007s
I20260709 13:01:24.331776  8137 raft_consensus.cc:493] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.332314  8137 raft_consensus.cc:515] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.333014  8216 raft_consensus.cc:2749] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:24.334394  8137 leader_election.cc:290] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:24.338829  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61892e5f699c46bbb647be64c3a48f96" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:24.339700  7702 raft_consensus.cc:2468] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:24.342700  7598 leader_election.cc:304] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:24.343719  7933 raft_consensus.cc:2804] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:24.344245  7933 raft_consensus.cc:493] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.344703  7933 raft_consensus.cc:3060] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.345310  8227 consensus_queue.cc:1048] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:24.348898  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61892e5f699c46bbb647be64c3a48f96" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:24.358457  7826 tablet_bootstrap.cc:492] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:24.359019  7826 ts_tablet_manager.cc:1403] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.021s
I20260709 13:01:24.361675  7826 raft_consensus.cc:359] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:24.361970  7933 raft_consensus.cc:515] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.362407  7826 raft_consensus.cc:385] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.362735  7826 raft_consensus.cc:740] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.363440  7826 consensus_queue.cc:260] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:24.365867  7826 ts_tablet_manager.cc:1434] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:24.364764  7824 raft_consensus.cc:359] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.366804  7824 raft_consensus.cc:385] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.368031  7826 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd: Bootstrap starting.
I20260709 13:01:24.371824  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61892e5f699c46bbb647be64c3a48f96" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:24.372493  7704 raft_consensus.cc:3060] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.374648  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61892e5f699c46bbb647be64c3a48f96" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:24.369480  7824 raft_consensus.cc:740] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.376071  7824 consensus_queue.cc:260] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.376802  7826 tablet_bootstrap.cc:654] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.376968  7552 raft_consensus.cc:3060] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.385226  7552 raft_consensus.cc:2468] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:24.387591  7824 ts_tablet_manager.cc:1434] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:01:24.390002  7826 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd: No bootstrap required, opened a new log
I20260709 13:01:24.390268  7824 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:24.390540  7826 ts_tablet_manager.cc:1403] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 13:01:24.393174  7826 raft_consensus.cc:359] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.393888  7826 raft_consensus.cc:385] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.394155  7826 raft_consensus.cc:740] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.394979  7826 consensus_queue.cc:260] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.397074  7826 ts_tablet_manager.cc:1434] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:01:24.397863  7933 leader_election.cc:290] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:24.403223  8225 consensus_queue.cc:1048] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:24.408638  7597 leader_election.cc:304] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:24.413070  7933 raft_consensus.cc:2804] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:24.413748  7933 raft_consensus.cc:697] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:24.414573  7933 consensus_queue.cc:237] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.422974  7824 tablet_bootstrap.cc:654] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.424050  7704 raft_consensus.cc:2468] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:24.424568  8250 raft_consensus.cc:493] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.427214  8227 raft_consensus.cc:493] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.450721  7934 consensus_queue.cc:1048] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:24.453364  8137 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.465791  8137 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:24.461509  8250 raft_consensus.cc:515] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.465426  7454 catalog_manager.cc:5697] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.469908  8137 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:24.472954  8250 leader_election.cc:290] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:24.473450  8151 consensus_queue.cc:1048] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:24.473884  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:24.475348  7745 leader_election.cc:343] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.473479  7557 raft_consensus.cc:3060] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.479944  7705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:24.480751  7705 raft_consensus.cc:2393] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:24.463251  8227 raft_consensus.cc:515] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.482586  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:24.483340  7703 raft_consensus.cc:2468] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 0.
I20260709 13:01:24.484058  8227 leader_election.cc:290] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:24.487569  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:24.487674  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:24.507899  7597 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:24.516559  8151 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:24.515589  8275 log.cc:927] Time spent T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:24.525079  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d70fce73a46409dbc64e66b30cf76fb" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:24.537671  7628 raft_consensus.cc:2393] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:24.545970  8151 raft_consensus.cc:2749] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:24.550769  8057 consensus_queue.cc:1048] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:24.553164  8277 consensus_queue.cc:1048] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:24.556618  7746 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38267, user_credentials={real_user=slave}} blocked reactor thread for 77581.4us
I20260709 13:01:24.562573  7746 leader_election.cc:304] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:24.564594  7522 leader_election.cc:304] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:24.565752  8224 raft_consensus.cc:3060] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.567193  7824 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:24.567389  8148 raft_consensus.cc:2804] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:24.567811  7824 ts_tablet_manager.cc:1403] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.001s
I20260709 13:01:24.567834  8148 raft_consensus.cc:493] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.569492  8148 raft_consensus.cc:3060] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.566531  8221 consensus_queue.cc:1048] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:24.583709  7824 raft_consensus.cc:359] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.584749  7824 raft_consensus.cc:385] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:24.585078  7824 raft_consensus.cc:740] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.588828  7934 raft_consensus.cc:493] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.589339  7934 raft_consensus.cc:515] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:24.591172  7934 leader_election.cc:290] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:24.591068  8148 raft_consensus.cc:515] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.593518  7824 consensus_queue.cc:260] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.595626  7824 ts_tablet_manager.cc:1434] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:01:24.596880  7824 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:24.599820  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:24.600659  7702 raft_consensus.cc:2393] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:24.606317  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:24.610821  7596 leader_election.cc:304] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:24.611642  7934 raft_consensus.cc:3060] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.612825  8148 leader_election.cc:290] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:24.617007  7556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:24.617185  8250 consensus_queue.cc:1048] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:24.621125  7745 leader_election.cc:343] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:24.622473  8224 raft_consensus.cc:2749] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:24.649463  7824 tablet_bootstrap.cc:654] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:24.645789  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:24.660758  7702 raft_consensus.cc:3060] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:24.686702  7934 raft_consensus.cc:2749] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:24.741144  7824 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: No bootstrap required, opened a new log
I20260709 13:01:24.741710  7824 ts_tablet_manager.cc:1403] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.007s
W20260709 13:01:24.740760  8275 log.cc:927] Time spent T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:01:24.767022  7597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 78556.4us
I20260709 13:01:24.814673  7824 raft_consensus.cc:359] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.815662  7824 raft_consensus.cc:385] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:24.817101  8285 log.cc:927] Time spent T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:24.815989  7824 raft_consensus.cc:740] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:24.838409  7824 consensus_queue.cc:260] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.864770  7934 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.865330  7934 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.869202  7824 ts_tablet_manager.cc:1434] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.001s
W20260709 13:01:24.878769  8283 log.cc:927] Time spent T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
W20260709 13:01:24.884887  8287 log.cc:927] Time spent T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:24.909015  7934 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:24.900209  7702 raft_consensus.cc:2468] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:24.938374  7557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:24.937685  8278 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.937305  8249 consensus_queue.cc:1048] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:01:24.954368  8186 consensus_queue.cc:1048] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:01:24.966210  8278 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:24.982024  8303 raft_consensus.cc:493] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.982565  8303 raft_consensus.cc:515] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:24.983477  8278 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:24.984356  7557 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
W20260709 13:01:25.009739  7597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 71558.5us
W20260709 13:01:25.012672  7523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38267, user_credentials={real_user=slave}} blocked reactor thread for 72730.3us
W20260709 13:01:25.015264  7522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36939, user_credentials={real_user=slave}} blocked reactor thread for 73347.5us
W20260709 13:01:25.051965  7671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36939, user_credentials={real_user=slave}} blocked reactor thread for 62736us
I20260709 13:01:25.061630  7597 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:25.048342  7702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:25.069927  8216 raft_consensus.cc:2804] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:25.083405  7702 raft_consensus.cc:2393] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:25.083578  8216 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.084139  8216 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:25.066866  7780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:25.085045  7780 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 0.
I20260709 13:01:25.071492  7746 leader_election.cc:304] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:25.090162  8184 raft_consensus.cc:2804] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:25.090675  8184 raft_consensus.cc:697] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:25.091476  8184 consensus_queue.cc:237] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:25.093042  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:25.093807  7777 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 0.
I20260709 13:01:25.096807  8148 consensus_queue.cc:1048] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:25.097157  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:25.051165  8303 leader_election.cc:290] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:25.142545  7521 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:25.144305  7521 leader_election.cc:304] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e; no voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:25.149086  8221 raft_consensus.cc:2804] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:25.155136  8227 raft_consensus.cc:3060] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:25.166878  8221 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.174234  8221 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:25.184194  7929 consensus_queue.cc:1048] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:25.189492  8137 consensus_queue.cc:1048] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:01:25.236091  8250 consensus_queue.cc:1048] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
W20260709 13:01:25.317812  8314 log.cc:927] Time spent T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:25.326633  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
W20260709 13:01:25.334364  7503 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:01:25.339327  7597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 197094us
W20260709 13:01:25.316056  8312 log.cc:927] Time spent T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:01:25.385612  8216 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:25.387244  8221 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:25.390781  7627 raft_consensus.cc:2393] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f0ca605b31c4386b93d83ddb820c36e in current term 1: Already voted for candidate 53979e9879e74487a8a95daacdefdbcd in this term.
W20260709 13:01:25.419013  7597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 66456.8us
I20260709 13:01:25.407822  8227 raft_consensus.cc:2749] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:25.387907  8216 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
W20260709 13:01:25.430672  7521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 56763.6us
I20260709 13:01:25.509368  8315 consensus_queue.cc:1048] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:01:25.521644  7552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:25.522863  7552 raft_consensus.cc:2393] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 1: Already voted for candidate 8f0ca605b31c4386b93d83ddb820c36e in this term.
I20260709 13:01:25.529232  8221 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:25.536000  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:25.536700  7778 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:25.566756  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:25.598407  7778 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 1.
I20260709 13:01:25.601293  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:25.636837  8148 consensus_queue.cc:1048] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:01:25.654482  8316 consensus_queue.cc:1048] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:25.663338  7521 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 53979e9879e74487a8a95daacdefdbcd
I20260709 13:01:25.667136  8224 raft_consensus.cc:2804] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:25.667704  8224 raft_consensus.cc:697] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:25.668568  8224 consensus_queue.cc:237] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:25.692472  7596 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:25.695674  8216 raft_consensus.cc:2749] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:25.706419  7453 catalog_manager.cc:5697] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.791671  7454 catalog_manager.cc:5697] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.236474  8224 consensus_queue.cc:1048] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:26.246752  8342 consensus_queue.cc:1048] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:27.015874   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:27.033402  7597 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 178 similar messages]
W20260709 13:01:27.037569  7597 consensus_peers.cc:597] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.059688   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:27.060199  7745 consensus_peers.cc:597] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.060693   431 tablet_replica.cc:333] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.061678   431 raft_consensus.cc:2243] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.062253   431 raft_consensus.cc:2272] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.064847   431 tablet_replica.cc:333] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.065652   431 raft_consensus.cc:2243] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.066182   431 raft_consensus.cc:2272] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.075489   431 tablet_replica.cc:333] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.076371   431 raft_consensus.cc:2243] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.076910   431 raft_consensus.cc:2272] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.078644   431 tablet_replica.cc:333] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.079355   431 raft_consensus.cc:2243] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.080344   431 raft_consensus.cc:2272] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.082755   431 tablet_replica.cc:333] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.083580   431 raft_consensus.cc:2243] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.084506   431 raft_consensus.cc:2272] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.086699   431 tablet_replica.cc:333] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.087536   431 raft_consensus.cc:2243] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.088109   431 raft_consensus.cc:2272] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.089845  7671 consensus_peers.cc:597] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.090381   431 tablet_replica.cc:333] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.091151   431 raft_consensus.cc:2243] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.091651   431 raft_consensus.cc:2272] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.094189   431 tablet_replica.cc:333] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.095063   431 raft_consensus.cc:2243] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.095592   431 raft_consensus.cc:2272] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.097613   431 tablet_replica.cc:333] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.098289   431 raft_consensus.cc:2243] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.098714   431 raft_consensus.cc:2272] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.101024   431 tablet_replica.cc:333] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.101868   431 raft_consensus.cc:2243] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.102319   431 raft_consensus.cc:2272] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.104861   431 tablet_replica.cc:333] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.105789   431 raft_consensus.cc:2243] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.106602   431 raft_consensus.cc:2272] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.108547   431 tablet_replica.cc:333] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.109119   431 raft_consensus.cc:2243] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.109534   431 raft_consensus.cc:2272] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.111413   431 tablet_replica.cc:333] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.111964   431 raft_consensus.cc:2243] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.112428   431 raft_consensus.cc:2272] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.114292   431 tablet_replica.cc:333] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.114888   431 raft_consensus.cc:2243] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.115343   431 raft_consensus.cc:2272] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.117719   431 tablet_replica.cc:333] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.118387   431 raft_consensus.cc:2243] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.118891   431 raft_consensus.cc:2272] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.120558  7671 consensus_peers.cc:597] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.121513   431 tablet_replica.cc:333] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
W20260709 13:01:27.122148  7597 consensus_peers.cc:597] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.122476   431 raft_consensus.cc:2243] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.123081   431 raft_consensus.cc:2272] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.123044  7745 consensus_peers.cc:597] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.126000   431 tablet_replica.cc:333] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.126678   431 raft_consensus.cc:2243] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.127218   431 raft_consensus.cc:2272] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.128005  7671 consensus_peers.cc:597] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.129351   431 tablet_replica.cc:333] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.130007   431 raft_consensus.cc:2243] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.130442   431 raft_consensus.cc:2272] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.132124   431 tablet_replica.cc:333] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.132674   431 raft_consensus.cc:2243] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.133085   431 raft_consensus.cc:2272] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.135102   431 tablet_replica.cc:333] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.135793   431 raft_consensus.cc:2243] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.136291   431 raft_consensus.cc:2272] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.138942  7745 consensus_peers.cc:597] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.139313   431 tablet_replica.cc:333] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
W20260709 13:01:27.139710  7745 consensus_peers.cc:597] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.140187   431 raft_consensus.cc:2243] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.141052   431 raft_consensus.cc:2272] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.143095   431 tablet_replica.cc:333] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.143708   431 raft_consensus.cc:2243] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.144125   431 raft_consensus.cc:2272] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.146126   431 tablet_replica.cc:333] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.146679   431 raft_consensus.cc:2243] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.147090   431 raft_consensus.cc:2272] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.149304   431 tablet_replica.cc:333] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.150096   431 raft_consensus.cc:2243] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.150571   431 raft_consensus.cc:2272] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.153167   431 tablet_replica.cc:333] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.153966   431 raft_consensus.cc:2243] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.154510   431 raft_consensus.cc:2272] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.156291  7671 consensus_peers.cc:597] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.157033  7745 consensus_peers.cc:597] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.157218   431 tablet_replica.cc:333] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.158161   431 raft_consensus.cc:2243] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:27.158350  7597 consensus_peers.cc:597] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.158708   431 raft_consensus.cc:2272] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.160723   431 tablet_replica.cc:333] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.161293   431 raft_consensus.cc:2243] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.161701   431 raft_consensus.cc:2272] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.163612   431 tablet_replica.cc:333] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.164165   431 raft_consensus.cc:2243] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.165200   431 raft_consensus.cc:2272] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.167868   431 tablet_replica.cc:333] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.168886   431 raft_consensus.cc:2243] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.169404   431 raft_consensus.cc:2272] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.172132   431 tablet_replica.cc:333] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
W20260709 13:01:27.172676  7745 consensus_peers.cc:597] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.172734   431 raft_consensus.cc:2243] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.173465   431 raft_consensus.cc:2272] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.176010   431 tablet_replica.cc:333] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.176795   431 raft_consensus.cc:2243] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.177313   431 raft_consensus.cc:2272] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.179880   431 tablet_replica.cc:333] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.180637   431 raft_consensus.cc:2243] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.181180   431 raft_consensus.cc:2272] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.183048  7671 consensus_peers.cc:597] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.183656   431 tablet_replica.cc:333] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.184491   431 raft_consensus.cc:2243] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.185062   431 raft_consensus.cc:2272] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.188030   431 tablet_replica.cc:333] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
W20260709 13:01:27.187996  7597 consensus_peers.cc:597] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.188900   431 raft_consensus.cc:2243] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.189491   431 raft_consensus.cc:2272] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.191936   431 tablet_replica.cc:333] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.192536   431 raft_consensus.cc:2243] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.192880   431 raft_consensus.cc:2272] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.194481   431 tablet_replica.cc:333] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.194968   431 raft_consensus.cc:2243] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.195622   431 raft_consensus.cc:2272] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.197945   431 tablet_replica.cc:333] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.198495   431 raft_consensus.cc:2243] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.199296   431 raft_consensus.cc:2272] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.201326   431 tablet_replica.cc:333] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.201792   431 raft_consensus.cc:2243] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.202498   431 raft_consensus.cc:2272] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.204773   431 tablet_replica.cc:333] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.205416   431 raft_consensus.cc:2243] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.206012   431 raft_consensus.cc:2272] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.208505   431 tablet_replica.cc:333] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.209084   431 raft_consensus.cc:2243] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.210107   431 raft_consensus.cc:2272] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.213161   431 tablet_replica.cc:333] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.214046   431 raft_consensus.cc:2243] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.215509   431 raft_consensus.cc:2272] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.218652   431 tablet_replica.cc:333] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.219329   431 raft_consensus.cc:2243] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:27.220171   431 raft_consensus.cc:2272] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.222501   431 tablet_replica.cc:333] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.223052   431 raft_consensus.cc:2243] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.223551   431 raft_consensus.cc:2272] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.226261   431 tablet_replica.cc:333] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.227057   431 raft_consensus.cc:2243] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:27.225190  7745 consensus_peers.cc:597] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.227556   431 raft_consensus.cc:2272] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.230823   431 tablet_replica.cc:333] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: stopping tablet replica
I20260709 13:01:27.231464   431 raft_consensus.cc:2243] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:01:27.232511  7597 consensus_peers.cc:597] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.232573   431 raft_consensus.cc:2272] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:27.245059  7597 consensus_peers.cc:597] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.247283  7597 consensus_peers.cc:597] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.309914   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:27.325837  7745 consensus_peers.cc:597] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.349817  7745 consensus_peers.cc:597] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.352209  7671 consensus_peers.cc:597] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.357944  7745 consensus_peers.cc:597] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.365154  7745 consensus_peers.cc:597] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.373257  7597 consensus_peers.cc:597] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.382424  7671 consensus_peers.cc:597] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.388885  7597 consensus_peers.cc:597] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.398243   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:27.403043  7671 consensus_peers.cc:597] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.408021  8354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:27.408427  8355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:27.412294   431 server_base.cc:1061] running on GCE node
W20260709 13:01:27.414824  8357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:27.419100   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:27.419448   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:27.419713   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602087419689 us; error 0 us; skew 500 ppm
I20260709 13:01:27.420563   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:01:27.422343  7671 consensus_peers.cc:597] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.439704   431 webserver.cc:533] Webserver started at http://127.0.107.193:45581/ using document root <none> and password file <none>
I20260709 13:01:27.440548   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:27.440810   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:01:27.445264   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:01:27.453096  8363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:27.454001   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:01:27.454347   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "8f0ca605b31c4386b93d83ddb820c36e"
format_stamp: "Formatted at 2026-07-09 13:01:14 on dist-test-slave-vcr9"
I20260709 13:01:27.455924   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:27.491290   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:27.492683   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:27.494361   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:27.499804  8371 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:01:27.510452  7671 consensus_peers.cc:597] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.513365  7671 consensus_peers.cc:597] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.577111  7745 consensus_peers.cc:597] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:27.596500  7745 consensus_peers.cc:597] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.801540   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:01:27.801978   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.303s	user 0.007s	sys 0.001s
I20260709 13:01:27.802345   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:01:27.810701  8371 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:27.826287  8371 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.827042  8371 tablet_bootstrap.cc:492] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:27.827631  8371 ts_tablet_manager.cc:1403] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:01:27.830173  8371 raft_consensus.cc:359] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:27.830888  8371 raft_consensus.cc:740] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:27.831600  8371 consensus_queue.cc:260] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:27.836840  8371 ts_tablet_manager.cc:1434] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 13:01:27.837747  8371 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:27.850358  8371 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.851114  8371 tablet_bootstrap.cc:492] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:27.851629  8371 ts_tablet_manager.cc:1403] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:01:27.853533  8371 raft_consensus.cc:359] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:27.854122  8371 raft_consensus.cc:740] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:27.854789  8371 consensus_queue.cc:260] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:27.857055  8371 ts_tablet_manager.cc:1434] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:01:27.857797  8371 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:27.919785  8371 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.920625  8371 tablet_bootstrap.cc:492] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:27.921195  8371 ts_tablet_manager.cc:1403] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.030s
I20260709 13:01:27.923192  8371 raft_consensus.cc:359] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:27.923732  8371 raft_consensus.cc:740] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:27.924427  8371 consensus_queue.cc:260] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:27.926019  8371 ts_tablet_manager.cc:1434] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:01:27.926828  8371 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:27.940658  8371 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.941494  8371 tablet_bootstrap.cc:492] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:27.942015  8371 ts_tablet_manager.cc:1403] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:01:27.943776  8371 raft_consensus.cc:359] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:27.944296  8371 raft_consensus.cc:740] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:27.944819  8371 consensus_queue.cc:260] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:27.946205  8371 ts_tablet_manager.cc:1434] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:27.946818  8371 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:27.986263  8371 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.987236  8371 tablet_bootstrap.cc:492] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:27.987949  8371 ts_tablet_manager.cc:1403] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.025s
I20260709 13:01:27.990226  8371 raft_consensus.cc:359] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:27.990864  8371 raft_consensus.cc:740] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:27.991453  8371 consensus_queue.cc:260] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:27.993444  8371 ts_tablet_manager.cc:1434] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:27.994201  8371 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.008882  8371 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.009828  8371 tablet_bootstrap.cc:492] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.010429  8371 ts_tablet_manager.cc:1403] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:01:28.012867  8371 raft_consensus.cc:359] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.013490  8371 raft_consensus.cc:740] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.014120  8371 consensus_queue.cc:260] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.015913  8371 ts_tablet_manager.cc:1434] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:28.016680  8371 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.030951  8371 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.031869  8371 tablet_bootstrap.cc:492] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.032528  8371 ts_tablet_manager.cc:1403] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:01:28.034855  8371 raft_consensus.cc:359] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.035497  8371 raft_consensus.cc:740] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.036132  8371 consensus_queue.cc:260] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.038000  8371 ts_tablet_manager.cc:1434] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:28.038743  8371 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.053617  8371 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.054540  8371 tablet_bootstrap.cc:492] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.055125  8371 ts_tablet_manager.cc:1403] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:01:28.057641  8371 raft_consensus.cc:359] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.058418  8371 raft_consensus.cc:740] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.059154  8371 consensus_queue.cc:260] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.061266  8371 ts_tablet_manager.cc:1434] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:28.062005  8371 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.079625  8371 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.080576  8371 tablet_bootstrap.cc:492] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.081187  8371 ts_tablet_manager.cc:1403] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:01:28.083534  8371 raft_consensus.cc:359] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.084201  8371 raft_consensus.cc:740] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.084920   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:01:28.084821  8371 consensus_queue.cc:260] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.085289   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.283s	user 0.246s	sys 0.006s
I20260709 13:01:28.086660  8371 ts_tablet_manager.cc:1434] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:01:28.087366  8371 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.096814  8379 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.097545  8379 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.101150  8371 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.100186  8379 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.103600  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.110081  8371 tablet_bootstrap.cc:492] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.110836  8371 ts_tablet_manager.cc:1403] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
W20260709 13:01:28.111650  7671 leader_election.cc:336] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111)
I20260709 13:01:28.113272  7671 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.113469  8371 raft_consensus.cc:359] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.115255  8371 raft_consensus.cc:740] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.115411  8379 raft_consensus.cc:2749] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.116215  8371 consensus_queue.cc:260] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.118569  8371 ts_tablet_manager.cc:1434] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:28.119256  8371 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.134500  8371 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.135390  8371 tablet_bootstrap.cc:492] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.136008  8371 ts_tablet_manager.cc:1403] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:01:28.138423  8371 raft_consensus.cc:359] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.139108  8371 raft_consensus.cc:740] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.139734  8371 consensus_queue.cc:260] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.142143  8371 ts_tablet_manager.cc:1434] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:28.142836  8371 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.160768  8373 raft_consensus.cc:493] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.161303  8373 raft_consensus.cc:515] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.168102  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
W20260709 13:01:28.169415  7597 leader_election.cc:336] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111)
I20260709 13:01:28.170028  7598 leader_election.cc:304] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:28.170466  8373 leader_election.cc:290] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.170945  8375 raft_consensus.cc:2749] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.172896  8371 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.173930  8371 tablet_bootstrap.cc:492] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.174553  8371 ts_tablet_manager.cc:1403] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:01:28.177446  8371 raft_consensus.cc:359] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.178140  8371 raft_consensus.cc:740] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.178854  8371 consensus_queue.cc:260] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.180910  8371 ts_tablet_manager.cc:1434] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:28.181702  8371 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.182314  8148 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.182848  8148 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.184700   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42081
I20260709 13:01:28.184762  8148 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.201629  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.184918  8446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42081 every 8 connection(s)
I20260709 13:01:28.240361  8371 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.241664  8371 tablet_bootstrap.cc:492] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.242899  8371 ts_tablet_manager.cc:1403] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.020s
I20260709 13:01:28.245729  8371 raft_consensus.cc:359] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.249569  8371 raft_consensus.cc:740] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.247890  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.250476  8371 consensus_queue.cc:260] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.253386  8368 raft_consensus.cc:493] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.253968  8371 ts_tablet_manager.cc:1434] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:28.255230  8371 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.253993  8368 raft_consensus.cc:515] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.264365  8375 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.265007  8375 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.267925  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:28.268308  7745 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.268656  8420 raft_consensus.cc:2468] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.268821  7745 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.269941  7597 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:28.273909  8373 raft_consensus.cc:2804] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.274587  8373 raft_consensus.cc:493] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.275168  8373 raft_consensus.cc:3060] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.279330  8368 leader_election.cc:290] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.285362  8383 raft_consensus.cc:2749] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.296164  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.298638  8375 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.306543  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:28.307310  7698 raft_consensus.cc:2468] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.328922  8374 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.329702  8374 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.334908  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.335632  8420 raft_consensus.cc:2468] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.339025  8374 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.339214  7597 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:28.340029  7933 raft_consensus.cc:2804] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.340811  7933 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.341300  7933 raft_consensus.cc:3060] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.367822  8375 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.368642  8375 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.374410  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:28.377046  7597 leader_election.cc:343] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.387449  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.388907  8368 raft_consensus.cc:493] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.389778  7596 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.389792  8368 raft_consensus.cc:515] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.393040  8368 leader_election.cc:290] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.397149  8374 raft_consensus.cc:2749] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.399478  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.400018  8379 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.400151  7632 raft_consensus.cc:2468] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 1.
I20260709 13:01:28.400813  8379 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.402851  8379 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.404213  7933 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.405129  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.409042  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.409685  8419 raft_consensus.cc:3060] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.410542  8373 raft_consensus.cc:515] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.411098  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.416608  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.417412  8419 raft_consensus.cc:2468] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.416611  8148 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.418505  8148 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.421051  8148 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.424624  8447 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44269
I20260709 13:01:28.425369  8447 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:28.426612  8447 heartbeater.cc:507] Master 127.0.107.254:44269 requested a full tablet report, sending...
I20260709 13:01:28.424590  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.431604  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:28.432855  7745 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.433286  7745 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.434248  8148 raft_consensus.cc:2749] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.438421  7597 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:28.441164  8375 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.441769  8374 raft_consensus.cc:2804] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.442014  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:28.442387  8374 raft_consensus.cc:697] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.442435  7701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:28.443429  8374 consensus_queue.cc:237] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
W20260709 13:01:28.447307  7671 leader_election.cc:343] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.447794  7671 leader_election.cc:304] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.448527  8368 raft_consensus.cc:2749] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.449671  8368 raft_consensus.cc:493] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.450145  8368 raft_consensus.cc:515] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.450536  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.451746  7933 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.452301  8368 leader_election.cc:290] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.456933  8292 raft_consensus.cc:493] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
W20260709 13:01:28.457894  7671 leader_election.cc:343] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:28.459290  7671 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.459676  7671 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.460841  8057 raft_consensus.cc:2749] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.457504  8292 raft_consensus.cc:515] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.461498  8373 leader_election.cc:290] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.461925  7453 ts_manager.cc:194] Re-registered known tserver with Master: 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.463066  7671 leader_election.cc:304] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.463522  8292 leader_election.cc:290] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.463941  8368 raft_consensus.cc:2804] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.464682  8368 raft_consensus.cc:493] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.465051  8368 raft_consensus.cc:3060] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.465541  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.465698  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.465728  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.466427  8418 raft_consensus.cc:2393] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe6c341a95a4deda3fd323405e42608 in current term 2: Already voted for candidate 53979e9879e74487a8a95daacdefdbcd in this term.
I20260709 13:01:28.466557  8419 raft_consensus.cc:3060] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.469134  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fce8895f7140c1bb5c58216f2018ca" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:28.469434  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:28.469755  7700 raft_consensus.cc:3060] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.470103  7698 raft_consensus.cc:2468] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.470320  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f472af11ec9e424ea42c848b20e97c35" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.464010  7451 catalog_manager.cc:5697] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:28.471990  7597 leader_election.cc:343] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.474062  7671 leader_election.cc:304] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.477411  7700 raft_consensus.cc:2468] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.480667  8057 raft_consensus.cc:3060] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.481895  8419 raft_consensus.cc:2468] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.479879  8368 raft_consensus.cc:515] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.484939  8371 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.484963  8368 leader_election.cc:290] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.486207  8457 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.485917  8371 tablet_bootstrap.cc:492] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.486944  8457 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.487322  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.487506  8371 ts_tablet_manager.cc:1403] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.233s	user 0.077s	sys 0.098s
I20260709 13:01:28.488677  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74589dcef6c479c90e97df23e516a12" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:28.489289  7632 raft_consensus.cc:3060] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:28.489516  7671 leader_election.cc:343] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.490895  8371 raft_consensus.cc:359] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.491595  8371 raft_consensus.cc:740] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.492324  8371 consensus_queue.cc:260] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.494539  8371 ts_tablet_manager.cc:1434] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:28.495334  8371 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.495042  7597 leader_election.cc:304] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:28.496260  8292 raft_consensus.cc:2804] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.496927  8292 raft_consensus.cc:697] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.498066  8292 consensus_queue.cc:237] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.498740  7632 raft_consensus.cc:2468] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 2.
I20260709 13:01:28.501251  7598 leader_election.cc:304] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.502120  8373 raft_consensus.cc:2804] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.502483  8373 raft_consensus.cc:493] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.502835  8373 raft_consensus.cc:3060] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.504911  8457 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.515209  7671 leader_election.cc:304] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.516094  8373 raft_consensus.cc:515] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.519153  8368 raft_consensus.cc:2804] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.519618  8368 raft_consensus.cc:697] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 2 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:28.520488  8368 consensus_queue.cc:237] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.522037  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.526023  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.527249  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c729997968264c78bbdf7e19a94ba7bf" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:28.527855  7698 raft_consensus.cc:3060] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.528680  8057 raft_consensus.cc:2749] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.520663  8373 leader_election.cc:290] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
W20260709 13:01:28.530435  7597 leader_election.cc:343] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.535564  8371 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.539338  8371 tablet_bootstrap.cc:492] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.541616  8371 ts_tablet_manager.cc:1403] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.000s
I20260709 13:01:28.543272  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.544757  7698 raft_consensus.cc:2468] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.545614  8371 raft_consensus.cc:359] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
W20260709 13:01:28.546078  7671 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.549307  8371 raft_consensus.cc:740] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.549461  7671 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe6c341a95a4deda3fd323405e42608; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.550683  8057 raft_consensus.cc:2749] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.550922  8383 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.551643  8383 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.552748  8371 consensus_queue.cc:260] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.555135  8371 ts_tablet_manager.cc:1434] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:01:28.555619  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.555966  8371 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.556315  8418 raft_consensus.cc:2468] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:28.556586  7598 leader_election.cc:304] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.557530  8373 raft_consensus.cc:2804] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.557994  8373 raft_consensus.cc:697] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.558018  7745 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:28.559008  8148 raft_consensus.cc:2804] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.558960  8373 consensus_queue.cc:237] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.559516  8148 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.559926  8148 raft_consensus.cc:3060] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.567253  8375 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.568084  8375 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.569034  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.571825  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:28.573834  7597 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.566236  8383 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.576699  8375 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.579059  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:28.580809  7698 raft_consensus.cc:2468] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.584848  8373 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.586359  8373 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.587867  7598 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.590209  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.592092  7772 raft_consensus.cc:2468] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.593421  7596 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:28.594372  8374 raft_consensus.cc:2804] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.594365  8292 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.595057  8292 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.594365  7455 catalog_manager.cc:5697] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.594826  8374 raft_consensus.cc:493] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.596812  8374 raft_consensus.cc:3060] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.597270  8292 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.598932  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.599367  8372 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.600737  8292 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.601318  8292 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.603967  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.599884  8372 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.604925  8374 raft_consensus.cc:515] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.606348  8372 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.607213  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.608063  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:28.608717  7773 raft_consensus.cc:3060] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.608619  8148 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
W20260709 13:01:28.610170  7597 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.610523  8148 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.611471  8374 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.612648  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.613058  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.613160  7772 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.613694  8420 raft_consensus.cc:3060] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:28.613966  7745 leader_election.cc:343] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.617236  7596 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:28.617319  8372 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.618009  8372 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.618357  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2299a78017b149c09890c26668ba6fd4" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:28.620146  7597 leader_election.cc:343] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.620445  8372 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.621069  8421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.621464  8292 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
W20260709 13:01:28.622779  7745 leader_election.cc:343] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.622901  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.618894  8374 raft_consensus.cc:2804] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.623654  8374 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.624033  8374 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.625444  8292 raft_consensus.cc:2804] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.625895  8292 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.626287  8292 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:28.633241  7597 leader_election.cc:343] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.633323  8373 leader_election.cc:290] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.633870  7597 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.634581  8373 raft_consensus.cc:2749] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.635540  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
W20260709 13:01:28.636931  7597 leader_election.cc:343] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.638166  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.639523  8420 raft_consensus.cc:2468] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:28.640072  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:28.641148  7745 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:28.641539  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.642354  7632 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:28.642545  8280 raft_consensus.cc:2804] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.639331  7933 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.643131  8280 raft_consensus.cc:697] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:28.643144  8371 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.643450  7933 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.644407  8371 tablet_bootstrap.cc:492] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.645133  8371 ts_tablet_manager.cc:1403] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.015s
I20260709 13:01:28.647109  8292 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.647691  8371 raft_consensus.cc:359] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.648433  8371 raft_consensus.cc:740] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.648384  8280 consensus_queue.cc:237] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.634771  8374 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.649503  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.649889  7624 raft_consensus.cc:2393] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07d5308b5f834161a9f46b9565fa95e6 in current term 2: Already voted for candidate 53979e9879e74487a8a95daacdefdbcd in this term.
I20260709 13:01:28.655151  8375 raft_consensus.cc:493] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.655895  8375 raft_consensus.cc:515] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.651356  8374 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.651665  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.651907  8371 consensus_queue.cc:260] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.653725  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
W20260709 13:01:28.658366  7597 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.658488  7776 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.659245  7933 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.659904  7772 raft_consensus.cc:2468] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 1.
I20260709 13:01:28.661342  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.659732  8371 ts_tablet_manager.cc:1434] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 13:01:28.663244  7597 leader_election.cc:343] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.663537  8371 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.666319  7776 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.675354  7596 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:28.653219  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:28.677925  7597 leader_election.cc:343] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.678350  7933 raft_consensus.cc:2804] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.677934  7596 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.679783  8373 raft_consensus.cc:2804] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.680167  8373 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.680543  8373 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.678931  7933 raft_consensus.cc:697] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.684855  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:28.687088  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.662482  8292 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:28.675374  7773 raft_consensus.cc:2468] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.689715  7596 leader_election.cc:304] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.690006  8373 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.687222  7698 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.693578  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:28.695848  7455 catalog_manager.cc:5697] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.696377  7451 catalog_manager.cc:5697] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.706709  7451 catalog_manager.cc:5697] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.707733  8280 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.710446  8373 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.708498  8280 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.715145  8280 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.716159  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
W20260709 13:01:28.717742  7597 leader_election.cc:343] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.717950  8280 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.718523  8280 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.720681  7453 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49734
I20260709 13:01:28.721259  7701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608" is_pre_election: true
I20260709 13:01:28.721997  7701 raft_consensus.cc:2468] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:28.723254  7746 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:28.724062  8148 raft_consensus.cc:2804] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.724453  8148 raft_consensus.cc:493] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.724790  8148 raft_consensus.cc:3060] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.685520  8375 leader_election.cc:290] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.732532  8375 raft_consensus.cc:2804] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.733038  8375 raft_consensus.cc:697] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.734203  8375 consensus_queue.cc:237] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.684897  7933 consensus_queue.cc:237] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
W20260709 13:01:28.735977  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42081, user_credentials={real_user=slave}} blocked reactor thread for 47786.3us
I20260709 13:01:28.688078  8418 raft_consensus.cc:2393] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53979e9879e74487a8a95daacdefdbcd in current term 2: Already voted for candidate 07d5308b5f834161a9f46b9565fa95e6 in this term.
I20260709 13:01:28.737052  7745 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.699131  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbc5ef8c78a4759a2bb8fe7a52b49d3" candidate_uuid: "53979e9879e74487a8a95daacdefdbcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07d5308b5f834161a9f46b9565fa95e6" is_pre_election: true
I20260709 13:01:28.704599  7773 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.738484  7745 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.741128  8473 raft_consensus.cc:2804] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.741654  8473 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.742645  8383 raft_consensus.cc:2749] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.730798  8447 heartbeater.cc:499] Master 127.0.107.254:44269 was elected leader, sending a full tablet report...
I20260709 13:01:28.751358  7773 raft_consensus.cc:2468] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.753548  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.742092  8473 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.780390  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e" is_pre_election: true
I20260709 13:01:28.734230  8280 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
W20260709 13:01:28.786669  7745 leader_election.cc:343] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.792178  8148 raft_consensus.cc:515] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.798429  7596 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.799701  7596 leader_election.cc:304] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd; no voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.800335  8471 raft_consensus.cc:2804] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.800761  8470 raft_consensus.cc:3060] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.801431  8471 raft_consensus.cc:697] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.801800  8371 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.802816  8371 tablet_bootstrap.cc:492] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.806808  8371 ts_tablet_manager.cc:1403] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.036s
I20260709 13:01:28.809469  8371 raft_consensus.cc:359] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.810122  8371 raft_consensus.cc:740] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.810411  8473 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.810886  8371 consensus_queue.cc:260] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.813350  8371 ts_tablet_manager.cc:1434] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
W20260709 13:01:28.813740  7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38267, user_credentials={real_user=slave}} blocked reactor thread for 131049us
I20260709 13:01:28.814106  8371 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.792414  7698 raft_consensus.cc:2468] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53979e9879e74487a8a95daacdefdbcd in term 2.
I20260709 13:01:28.802384  8471 consensus_queue.cc:237] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.828377  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd" is_pre_election: true
I20260709 13:01:28.829166  7624 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 1.
I20260709 13:01:28.836819  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:28.837492  7698 raft_consensus.cc:3060] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.845096  7598 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.845932  8292 raft_consensus.cc:2804] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.846426  8292 raft_consensus.cc:697] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Leader. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:28.847316  8292 consensus_queue.cc:237] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.851347  8473 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.853098  8470 raft_consensus.cc:2749] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.856701  8148 leader_election.cc:290] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:28.871492  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.872287  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:28.872978  7632 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.880018  7632 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:28.891722  7745 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:28.898806  8473 raft_consensus.cc:2804] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.899248  8473 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:28.899590  8473 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.906455  7698 raft_consensus.cc:2468] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:28.908800  7746 leader_election.cc:304] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:28.909261  8473 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.911461  8473 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:28.912055  8473 raft_consensus.cc:2804] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.912770  8473 raft_consensus.cc:697] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:28.913703  8473 consensus_queue.cc:237] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:28.931456  7632 raft_consensus.cc:1275] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer ebe6c341a95a4deda3fd323405e42608: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.933550  7745 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:28.935227  7701 raft_consensus.cc:1275] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.935506  8368 consensus_queue.cc:1048] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.937085  8475 raft_consensus.cc:2804] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.937811  8475 raft_consensus.cc:697] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:28.937573  8470 consensus_queue.cc:1048] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.938731  8475 consensus_queue.cc:237] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:28.921635  7453 catalog_manager.cc:5697] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.942569  7453 catalog_manager.cc:5697] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:28.943961  7597 consensus_peers.cc:597] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:28.946167  7453 catalog_manager.cc:5697] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:28.948813  7745 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:28.951354  7745 leader_election.cc:343] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:28.953492  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc971cb81cf49afa0b8d663a0b267a2" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.954262  8371 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.955283  8371 tablet_bootstrap.cc:492] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.955960  8371 ts_tablet_manager.cc:1403] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.142s	user 0.026s	sys 0.082s
I20260709 13:01:28.959262  8371 raft_consensus.cc:359] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.959942  8371 raft_consensus.cc:740] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:28.960641  8371 consensus_queue.cc:260] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.962874  8371 ts_tablet_manager.cc:1434] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:28.963660  8371 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:28.973498  8420 raft_consensus.cc:1275] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.977560  8470 consensus_queue.cc:1048] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.982267  8420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
I20260709 13:01:28.986306  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:28.986956  7624 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.993305  8371 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.995294  8371 tablet_bootstrap.cc:492] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:28.995966  8371 ts_tablet_manager.cc:1403] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.011s
I20260709 13:01:28.998610  8371 raft_consensus.cc:359] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:28.999440  8371 raft_consensus.cc:740] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.000193  8371 consensus_queue.cc:260] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.002363  8371 ts_tablet_manager.cc:1434] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:01:29.003813  7624 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:29.011754  8371 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.011590  8421 raft_consensus.cc:1275] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.025211  7451 catalog_manager.cc:5697] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.045244  7701 raft_consensus.cc:1275] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.048269  8471 consensus_queue.cc:1048] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.043850  8373 consensus_queue.cc:1048] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 13:01:29.066427  7671 consensus_peers.cc:597] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.075068  7670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 45062.3us
I20260709 13:01:29.081480  8371 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.083613  8371 tablet_bootstrap.cc:492] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.084573  8371 ts_tablet_manager.cc:1403] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.082s	user 0.044s	sys 0.024s
W20260709 13:01:29.088089  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36939, user_credentials={real_user=slave}} blocked reactor thread for 55094.6us
I20260709 13:01:29.089066  8371 raft_consensus.cc:359] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.089895  8371 raft_consensus.cc:740] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.089071  7745 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 53979e9879e74487a8a95daacdefdbcd; no voters: 
I20260709 13:01:29.090653  8371 consensus_queue.cc:260] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.091300  8280 raft_consensus.cc:2804] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:29.091800  8280 raft_consensus.cc:697] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:29.092653  8280 consensus_queue.cc:237] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.093255  8371 ts_tablet_manager.cc:1434] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:29.094621  8371 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:29.097616  7745 leader_election.cc:343] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:29.098829  7745 leader_election.cc:343] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:29.096199  7453 catalog_manager.cc:5697] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 53979e9879e74487a8a95daacdefdbcd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53979e9879e74487a8a95daacdefdbcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.115664  7624 raft_consensus.cc:1275] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.132069  8280 consensus_queue.cc:1048] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.145937  8371 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.147245  8371 tablet_bootstrap.cc:492] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.147904  8371 ts_tablet_manager.cc:1403] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.054s	user 0.034s	sys 0.012s
I20260709 13:01:29.149331  7772 raft_consensus.cc:1275] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.150290  8371 raft_consensus.cc:359] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.151089  8371 raft_consensus.cc:740] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.151360  8373 consensus_queue.cc:1048] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.151901  8371 consensus_queue.cc:260] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.154111  8371 ts_tablet_manager.cc:1434] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:29.154925  8371 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.167640  7451 catalog_manager.cc:5697] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.179857  7701 raft_consensus.cc:1275] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.184293  8373 consensus_queue.cc:1048] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:29.188264  7597 consensus_peers.cc:597] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.199010  7597 consensus_peers.cc:597] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.184940  7451 catalog_manager.cc:5697] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 1 to 2, leader changed from 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193) to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.251299  8420 raft_consensus.cc:1275] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.266086  8473 consensus_queue.cc:1048] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.280284  7776 raft_consensus.cc:1275] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.284416  8471 consensus_queue.cc:1048] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.286578  8371 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.287623  8371 tablet_bootstrap.cc:492] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.288296  8371 ts_tablet_manager.cc:1403] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.134s	user 0.063s	sys 0.052s
I20260709 13:01:29.290784  8371 raft_consensus.cc:359] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.291479  8371 raft_consensus.cc:740] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.292243  8371 consensus_queue.cc:260] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.294343  8371 ts_tablet_manager.cc:1434] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:29.301999  8371 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.310030  7701 raft_consensus.cc:1275] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.311796  8471 consensus_queue.cc:1048] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.337188  7700 raft_consensus.cc:1275] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.339568  8372 consensus_queue.cc:1048] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.341161  8371 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.342265  8371 tablet_bootstrap.cc:492] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.342999  8371 ts_tablet_manager.cc:1403] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.002s
I20260709 13:01:29.345875  8371 raft_consensus.cc:359] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.348237  8371 raft_consensus.cc:740] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.349116  8371 consensus_queue.cc:260] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.351475  8371 ts_tablet_manager.cc:1434] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:29.352356  8371 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.355569  8420 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:29.389340  7597 consensus_peers.cc:597] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.400750  7597 consensus_peers.cc:597] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.413267  8420 raft_consensus.cc:1275] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.436198  8371 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:29.413616  7597 consensus_peers.cc:597] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.437170  8371 tablet_bootstrap.cc:492] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.437861  8371 ts_tablet_manager.cc:1403] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.044s
I20260709 13:01:29.440441  8371 raft_consensus.cc:359] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.441102  8371 raft_consensus.cc:740] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.441296  7772 raft_consensus.cc:1275] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 53979e9879e74487a8a95daacdefdbcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.441782  8371 consensus_queue.cc:260] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.444010  8371 ts_tablet_manager.cc:1434] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:01:29.444430  8374 consensus_queue.cc:1048] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.445309  8373 consensus_queue.cc:1048] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.453696  8371 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:29.453987  7745 consensus_peers.cc:597] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.496476  8371 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.497475  7632 raft_consensus.cc:1275] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.499603  8473 consensus_queue.cc:1048] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.497468  8371 tablet_bootstrap.cc:492] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.505663  8371 ts_tablet_manager.cc:1403] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.013s
I20260709 13:01:29.508502  8371 raft_consensus.cc:359] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.509178  8371 raft_consensus.cc:740] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.515862  7631 raft_consensus.cc:1275] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:29.516638  8371 consensus_queue.cc:260] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.517709  8148 consensus_queue.cc:1048] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.518940  8371 ts_tablet_manager.cc:1434] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:01:29.520478  8371 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:29.524202  7745 consensus_peers.cc:597] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.536407  7745 consensus_peers.cc:597] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.557749  8371 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.558841  8371 tablet_bootstrap.cc:492] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.559573  8371 ts_tablet_manager.cc:1403] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.015s
I20260709 13:01:29.562471  8371 raft_consensus.cc:359] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.563287  8371 raft_consensus.cc:740] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.564203  8371 consensus_queue.cc:260] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.566198  8371 ts_tablet_manager.cc:1434] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:01:29.567796  8371 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.599037  8371 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.599826  8371 tablet_bootstrap.cc:492] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.600436  8371 ts_tablet_manager.cc:1403] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.011s
I20260709 13:01:29.602299  8371 raft_consensus.cc:359] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.602856  8371 raft_consensus.cc:740] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.603446  8371 consensus_queue.cc:260] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.605221  8371 ts_tablet_manager.cc:1434] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:29.606281  8371 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:29.623374  7671 consensus_peers.cc:597] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.626617  8371 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.627681  8371 tablet_bootstrap.cc:492] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.628366  8371 ts_tablet_manager.cc:1403] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:01:29.630643  8371 raft_consensus.cc:359] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.631219  8371 raft_consensus.cc:740] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.631760  8371 consensus_queue.cc:260] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.633471  8371 ts_tablet_manager.cc:1434] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:01:29.634495  8371 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.646798  8371 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.647531  8371 tablet_bootstrap.cc:492] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.648043  8371 ts_tablet_manager.cc:1403] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:01:29.650197  8371 raft_consensus.cc:359] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.650828  8371 raft_consensus.cc:740] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.651413  8371 consensus_queue.cc:260] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.653240  8371 ts_tablet_manager.cc:1434] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:29.654356  8371 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:29.662668  7597 consensus_peers.cc:597] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.670544  8371 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.671911  8371 tablet_bootstrap.cc:492] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.673163  8371 ts_tablet_manager.cc:1403] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:01:29.675247  8371 raft_consensus.cc:359] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.675806  8371 raft_consensus.cc:740] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.676508  8371 consensus_queue.cc:260] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.678045  8371 ts_tablet_manager.cc:1434] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:01:29.678849  8371 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.705423  8371 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.706422  8371 tablet_bootstrap.cc:492] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.707142  8371 ts_tablet_manager.cc:1403] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.006s
I20260709 13:01:29.709649  8371 raft_consensus.cc:359] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.710381  8371 raft_consensus.cc:740] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
W20260709 13:01:29.710704  7745 consensus_peers.cc:597] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.711122  8371 consensus_queue.cc:260] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.713409  8371 ts_tablet_manager.cc:1434] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:29.714249  8371 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.728116  8371 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.728883  8371 tablet_bootstrap.cc:492] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.729385  8371 ts_tablet_manager.cc:1403] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:01:29.731251  8371 raft_consensus.cc:359] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.731783  8371 raft_consensus.cc:740] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.732393  8371 consensus_queue.cc:260] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.733826  8371 ts_tablet_manager.cc:1434] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:29.734795  8371 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.746712  8371 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.747754  8371 tablet_bootstrap.cc:492] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.748487  8371 ts_tablet_manager.cc:1403] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:01:29.750833  8371 raft_consensus.cc:359] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.751482  8371 raft_consensus.cc:740] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.752097  8371 consensus_queue.cc:260] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.754267  8371 ts_tablet_manager.cc:1434] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:29.755079  8371 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.770371  8371 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.771248  8371 tablet_bootstrap.cc:492] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.771965  8371 ts_tablet_manager.cc:1403] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:01:29.773965  8371 raft_consensus.cc:359] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.774549  8371 raft_consensus.cc:740] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.775084  8371 consensus_queue.cc:260] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.776818  8371 ts_tablet_manager.cc:1434] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:01:29.777913  8371 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.797410  8371 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.798329  8371 tablet_bootstrap.cc:492] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.799000  8371 ts_tablet_manager.cc:1403] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:01:29.801569  8371 raft_consensus.cc:359] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.802232  8371 raft_consensus.cc:740] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.802964  8371 consensus_queue.cc:260] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.805124  8371 ts_tablet_manager.cc:1434] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:29.805944  8371 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.820186  8371 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.821496  8371 tablet_bootstrap.cc:492] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.822207  8371 ts_tablet_manager.cc:1403] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:01:29.824692  8371 raft_consensus.cc:359] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.825364  8371 raft_consensus.cc:740] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.825975  8371 consensus_queue.cc:260] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:29.827975  8371 ts_tablet_manager.cc:1434] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:01:29.829190  8371 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.845826  8371 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.846791  8371 tablet_bootstrap.cc:492] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.847460  8371 ts_tablet_manager.cc:1403] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:01:29.850021  8371 raft_consensus.cc:359] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.850680  8371 raft_consensus.cc:740] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.851478  8371 consensus_queue.cc:260] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.852988  8371 ts_tablet_manager.cc:1434] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:01:29.853766  8371 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.857232  8421 raft_consensus.cc:3060] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.875957  8371 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.876928  8371 tablet_bootstrap.cc:492] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.877533  8371 ts_tablet_manager.cc:1403] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:01:29.879945  8371 raft_consensus.cc:359] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.880594  8371 raft_consensus.cc:740] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.881300  8371 consensus_queue.cc:260] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.883533  8371 ts_tablet_manager.cc:1434] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:29.884925  8371 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
W20260709 13:01:29.891897  7671 consensus_peers.cc:597] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:29.901499  7745 consensus_peers.cc:597] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.916465  8371 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.917500  8371 tablet_bootstrap.cc:492] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.918185  8371 ts_tablet_manager.cc:1403] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.004s
I20260709 13:01:29.925216  8371 raft_consensus.cc:359] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.925938  8371 raft_consensus.cc:740] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.927680  8371 consensus_queue.cc:260] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:29.929816  8371 ts_tablet_manager.cc:1434] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:29.930430  8371 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.944209  8371 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.945277  8371 tablet_bootstrap.cc:492] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.945947  8371 ts_tablet_manager.cc:1403] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:01:29.948367  8371 raft_consensus.cc:359] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.949036  8371 raft_consensus.cc:740] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:29.949684  8371 consensus_queue.cc:260] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.951702  8371 ts_tablet_manager.cc:1434] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:29.952955  8371 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:29.970350  8418 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.978139  8420 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.980726  8371 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.981738  8371 tablet_bootstrap.cc:492] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:29.982427  8371 ts_tablet_manager.cc:1403] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.009s
I20260709 13:01:29.984894  8371 raft_consensus.cc:359] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.985564  8371 raft_consensus.cc:740] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
W20260709 13:01:29.985865  7745 consensus_peers.cc:597] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:29.986364  8371 consensus_queue.cc:260] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:29.988807  8371 ts_tablet_manager.cc:1434] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:29.989861  8371 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:30.006573  8371 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.007282  8371 tablet_bootstrap.cc:492] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:30.007927  8371 ts_tablet_manager.cc:1403] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:01:30.010257  8371 raft_consensus.cc:359] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:30.010764  8371 raft_consensus.cc:740] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:30.011382  8371 consensus_queue.cc:260] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:30.012902  8418 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.013389  8371 ts_tablet_manager.cc:1434] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:01:30.014679  8371 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:30.028479  8371 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.029412  8371 tablet_bootstrap.cc:492] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:30.030084  8371 ts_tablet_manager.cc:1403] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:01:30.032646  8371 raft_consensus.cc:359] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:30.033341  8371 raft_consensus.cc:740] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:30.033979  8371 consensus_queue.cc:260] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:30.036273  8371 ts_tablet_manager.cc:1434] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:30.036999  8371 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:30.039667  8421 raft_consensus.cc:3060] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.079454  8371 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.080542  8371 tablet_bootstrap.cc:492] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:30.081210  8371 ts_tablet_manager.cc:1403] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.024s
I20260709 13:01:30.083654  8371 raft_consensus.cc:359] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:30.086496  8371 raft_consensus.cc:740] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:30.087149  8371 consensus_queue.cc:260] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:30.090288  8371 ts_tablet_manager.cc:1434] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:30.091048  8371 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap starting.
I20260709 13:01:30.107268  8418 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.110090  8371 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:30.110910  8371 tablet_bootstrap.cc:492] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Bootstrap complete.
I20260709 13:01:30.111449  8371 ts_tablet_manager.cc:1403] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:01:30.113345  8371 raft_consensus.cc:359] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:30.113866  8371 raft_consensus.cc:740] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Initialized, Role: FOLLOWER
I20260709 13:01:30.114493  8371 consensus_queue.cc:260] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:30.116024  8371 ts_tablet_manager.cc:1434] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:30.168090  8418 raft_consensus.cc:3060] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.265282  8421 raft_consensus.cc:3060] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:32.404211  7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42107, user_credentials={real_user=slave}} blocked reactor thread for 55171.9us
I20260709 13:01:38.230786   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:38.285701  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cabd51630341128537276b69e1d771"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "ebe6c341a95a4deda3fd323405e42608"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:38.286755  7773 raft_consensus.cc:606] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:38.289943  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:38.290587  7773 raft_consensus.cc:606] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:38.302503  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:38.303040  7624 raft_consensus.cc:606] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:38.305501  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:38.306063  7773 raft_consensus.cc:606] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:38.308702  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:38.309245  7772 raft_consensus.cc:606] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:38.311641  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e140450c826d47e194aad76501966c61"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:38.312242  7772 raft_consensus.cc:606] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:38.313479   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:38.315034   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:38.444011  8570 raft_consensus.cc:993] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.444792  8566 raft_consensus.cc:1081] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.446647  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:38.447366  8417 raft_consensus.cc:493] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.447857  8417 raft_consensus.cc:3060] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.457412  8417 raft_consensus.cc:515] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:38.460565  8417 leader_election.cc:290] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:38.477443  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:38.478165  7700 raft_consensus.cc:3060] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.483250  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf282a249724a72ab2d1ad22cdc3ebb" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:38.483970  7773 raft_consensus.cc:3055] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.484275  7773 raft_consensus.cc:740] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:38.486744  7700 raft_consensus.cc:2468] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:38.488927  8367 leader_election.cc:304] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:38.485076  7773 consensus_queue.cc:260] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:38.491328  7773 raft_consensus.cc:3060] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.505636  7773 raft_consensus.cc:2468] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:38.506979  8566 raft_consensus.cc:993] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.508440  8566 raft_consensus.cc:1081] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.512109  8580 raft_consensus.cc:2804] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.516162  8421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:38.516862  8421 raft_consensus.cc:493] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.517251  8421 raft_consensus.cc:3060] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.525422  8421 raft_consensus.cc:515] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.533802  8421 leader_election.cc:290] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:38.536399  8580 raft_consensus.cc:697] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:38.537541  8580 consensus_queue.cc:237] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:38.539168  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:38.539834  7773 raft_consensus.cc:3055] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.540136  7773 raft_consensus.cc:740] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:38.541174  7773 consensus_queue.cc:260] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.542887  7773 raft_consensus.cc:3060] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.545253  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f93e1711174847b286ab0ede1a21c8" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:38.545955  7624 raft_consensus.cc:3060] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.552860  7624 raft_consensus.cc:2468] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:38.554195  8366 leader_election.cc:304] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:38.555125  8583 raft_consensus.cc:2804] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.558915  7773 raft_consensus.cc:2468] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:38.562397  8583 raft_consensus.cc:697] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:38.564486  8583 consensus_queue.cc:237] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.574110  7451 catalog_manager.cc:5697] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.596336  7451 catalog_manager.cc:5697] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.689481  8578 raft_consensus.cc:993] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.690182  8581 raft_consensus.cc:1081] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.692606  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:38.693151  8417 raft_consensus.cc:493] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.693439  8417 raft_consensus.cc:3060] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.709929  8582 raft_consensus.cc:993] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.710656  8566 raft_consensus.cc:1081] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.710876  8417 raft_consensus.cc:515] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.713433  8417 leader_election.cc:290] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:38.713552  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:38.714169  7773 raft_consensus.cc:3055] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.714455  7773 raft_consensus.cc:740] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:38.714614  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e140450c826d47e194aad76501966c61"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:38.714638  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8e41c6979b4cb5a279abaf4c65007c" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:38.715351  8418 raft_consensus.cc:493] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.715196  7773 consensus_queue.cc:260] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.715384  7631 raft_consensus.cc:3060] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.715941  8418 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.716392  7773 raft_consensus.cc:3060] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.722982  7773 raft_consensus.cc:2468] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:38.723229  7631 raft_consensus.cc:2468] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:38.723836  8418 raft_consensus.cc:515] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.724210  8365 leader_election.cc:304] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:38.725114  8583 raft_consensus.cc:2804] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.725611  8583 raft_consensus.cc:697] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:38.726505  8583 consensus_queue.cc:237] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.727771  8579 raft_consensus.cc:993] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.728478  8571 raft_consensus.cc:1081] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:38.730266  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51266
I20260709 13:01:38.730983  8417 raft_consensus.cc:493] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.731561  8417 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.733542  8418 leader_election.cc:290] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:38.734256  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:38.733436  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e140450c826d47e194aad76501966c61" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:38.734867  7631 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.734967  7773 raft_consensus.cc:3055] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:38.735399  7773 raft_consensus.cc:740] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:38.736423  7773 consensus_queue.cc:260] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.737636  7773 raft_consensus.cc:3060] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.739481  8417 raft_consensus.cc:515] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.741858  7631 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:38.743132  8366 leader_election.cc:304] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:38.743789  8417 leader_election.cc:290] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:38.744728  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:38.745360  7772 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.746017  7451 catalog_manager.cc:5697] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.744628  8583 raft_consensus.cc:2804] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:38.748450  8583 raft_consensus.cc:697] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:38.749348  8583 consensus_queue.cc:237] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.750300  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f8a79b4a1f4ba1b853e27bb9a44736" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:38.750937  7631 raft_consensus.cc:3055] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:38.751282  7631 raft_consensus.cc:740] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:38.752199  7631 consensus_queue.cc:260] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.752664  7772 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:38.753718  7631 raft_consensus.cc:3060] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.754854  8365 leader_election.cc:304] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:38.757047  8580 raft_consensus.cc:2804] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:38.757546  8580 raft_consensus.cc:697] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:38.758477  8580 consensus_queue.cc:237] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:38.761291  7631 raft_consensus.cc:2468] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:38.765633  7773 raft_consensus.cc:2468] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:38.770071  8582 raft_consensus.cc:993] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower ebe6c341a95a4deda3fd323405e42608 to start an election
I20260709 13:01:38.770732  8582 raft_consensus.cc:1081] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer ebe6c341a95a4deda3fd323405e42608 to start an election
I20260709 13:01:38.772995  7700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78cabd51630341128537276b69e1d771"
dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:01:38.773734  7700 raft_consensus.cc:493] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.774166  7700 raft_consensus.cc:3060] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.784024  7700 raft_consensus.cc:515] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:38.787796  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:38.788436  7773 raft_consensus.cc:3055] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.788738  7773 raft_consensus.cc:740] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:38.788787  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cabd51630341128537276b69e1d771" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:38.789454  7631 raft_consensus.cc:3060] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.788807  7700 leader_election.cc:290] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:38.789526  7773 consensus_queue.cc:260] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:38.796612  7773 raft_consensus.cc:3060] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.796335  7451 catalog_manager.cc:5697] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 2 to 3, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 3 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.797307  7631 raft_consensus.cc:2468] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 2.
I20260709 13:01:38.798007  7451 catalog_manager.cc:5697] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 2 to 3, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 3 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.798823  7671 leader_election.cc:304] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:38.800151  8594 raft_consensus.cc:2804] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.800652  8594 raft_consensus.cc:697] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 2 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:38.801506  8594 consensus_queue.cc:237] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:38.813212  7773 raft_consensus.cc:2468] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 2.
I20260709 13:01:38.823904  7451 catalog_manager.cc:5697] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.979822  7698 raft_consensus.cc:1275] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.981449  8580 consensus_queue.cc:1048] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.984725  7631 raft_consensus.cc:1275] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.986368  8583 consensus_queue.cc:1048] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.994283  7773 raft_consensus.cc:1275] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.997390  8580 consensus_queue.cc:1048] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.997872  7773 raft_consensus.cc:1275] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.000473  8580 consensus_queue.cc:1048] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.160220  7773 raft_consensus.cc:1275] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:39.161532  8580 consensus_queue.cc:1048] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.171005  7631 raft_consensus.cc:1275] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:39.173935  8583 consensus_queue.cc:1048] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.195343  7631 raft_consensus.cc:1275] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer ebe6c341a95a4deda3fd323405e42608: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.196916  8594 consensus_queue.cc:1048] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.210902  7772 raft_consensus.cc:1275] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer ebe6c341a95a4deda3fd323405e42608: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.212488  8594 consensus_queue.cc:1048] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.235505  7631 raft_consensus.cc:1275] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:39.236822  8583 consensus_queue.cc:1048] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.249615  7772 raft_consensus.cc:1275] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:39.251892  8580 consensus_queue.cc:1048] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.261541  7631 raft_consensus.cc:1275] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.263782  8585 consensus_queue.cc:1048] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.269775  7772 raft_consensus.cc:1275] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.271235  8585 consensus_queue.cc:1048] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.316032   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:39.353938   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:39.388875  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:39.389501  7772 raft_consensus.cc:606] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:39.392462  7631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "07d5308b5f834161a9f46b9565fa95e6"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:39.392977  7631 raft_consensus.cc:606] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Received request to transfer leadership to TS 07d5308b5f834161a9f46b9565fa95e6
I20260709 13:01:39.395392  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:39.395949  7772 raft_consensus.cc:606] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:39.398463  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:39.398898  7772 raft_consensus.cc:606] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:39.401621  7632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:39.402141  7632 raft_consensus.cc:606] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:39.403090   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:39.404429   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:39.523897  8570 raft_consensus.cc:993] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.524510  8566 raft_consensus.cc:1081] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.525976  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:39.526479  8417 raft_consensus.cc:493] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.526772  8417 raft_consensus.cc:3060] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.531621  8417 raft_consensus.cc:515] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.533309  8417 leader_election.cc:290] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:39.534010  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:39.534296  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e06caf0de81404985683e0fa4c93453" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:39.534631  7700 raft_consensus.cc:3060] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.534886  7772 raft_consensus.cc:3055] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.535207  7772 raft_consensus.cc:740] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:39.535777  7772 consensus_queue.cc:260] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.536953  7772 raft_consensus.cc:3060] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.541772  7700 raft_consensus.cc:2468] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:39.543097  8367 leader_election.cc:304] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:39.543926  8585 raft_consensus.cc:2804] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.544440  7772 raft_consensus.cc:2468] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:39.544462  8585 raft_consensus.cc:697] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:39.545626  8585 consensus_queue.cc:237] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.555262  7455 catalog_manager.cc:5697] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.583401  8566 raft_consensus.cc:993] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.583863  8570 raft_consensus.cc:1081] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.585366  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:39.585884  8418 raft_consensus.cc:493] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.586241  8418 raft_consensus.cc:3060] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.592952  8418 raft_consensus.cc:515] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.596246  8418 leader_election.cc:290] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:39.597487  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:39.598158  7698 raft_consensus.cc:3060] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.601931  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c1d3edcbd24605885f5aece16869f1" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:39.602666  7772 raft_consensus.cc:3055] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.603044  7772 raft_consensus.cc:740] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:39.603914  7772 consensus_queue.cc:260] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.604389  7698 raft_consensus.cc:2468] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:39.605098  7772 raft_consensus.cc:3060] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.605444  8367 leader_election.cc:304] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:39.606169  8585 raft_consensus.cc:2804] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.606633  8585 raft_consensus.cc:697] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:39.607465  8585 consensus_queue.cc:237] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.612675  7772 raft_consensus.cc:2468] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:39.620117  7455 catalog_manager.cc:5697] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.646591  8578 raft_consensus.cc:993] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.647189  8568 raft_consensus.cc:993] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower 07d5308b5f834161a9f46b9565fa95e6 to start an election
I20260709 13:01:39.647141  8578 raft_consensus.cc:1081] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.647810  8571 raft_consensus.cc:1081] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Signalling peer 07d5308b5f834161a9f46b9565fa95e6 to start an election
I20260709 13:01:39.649379  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
 from {username='slave'} at 127.0.0.1:40092
I20260709 13:01:39.649372  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:39.650032  7772 raft_consensus.cc:493] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.650133  8418 raft_consensus.cc:493] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.650458  7772 raft_consensus.cc:3060] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.650636  8418 raft_consensus.cc:3060] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.656605  7772 raft_consensus.cc:515] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:39.656625  8418 raft_consensus.cc:515] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.659655  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:39.659797  7772 leader_election.cc:290] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:39.660214  7632 raft_consensus.cc:3055] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.660567  7632 raft_consensus.cc:740] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:39.660880  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c8390fe4c4f5f869c4f9bd12d1f72" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:39.661396  7700 raft_consensus.cc:3060] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.661255  7632 consensus_queue.cc:260] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:39.662382  7632 raft_consensus.cc:3060] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.666074  7700 raft_consensus.cc:2468] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:39.666527  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:39.667390  7698 raft_consensus.cc:3060] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.668000  7746 leader_election.cc:304] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:39.669078  8578 raft_consensus.cc:2804] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.669500  8578 raft_consensus.cc:697] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:39.670221  8578 consensus_queue.cc:237] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:39.671653  8418 leader_election.cc:290] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:39.674768  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b58c7b55d3458f90d62cb7cd4491f3" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:39.675314  7772 raft_consensus.cc:3055] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.675118  7698 raft_consensus.cc:2468] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:39.675705  7772 raft_consensus.cc:740] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:39.676607  8367 leader_election.cc:304] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:39.676664  7772 consensus_queue.cc:260] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.677630  8585 raft_consensus.cc:2804] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.677865  7632 raft_consensus.cc:2468] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:39.678112  7772 raft_consensus.cc:3060] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.678977  8585 raft_consensus.cc:697] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:39.680322  8585 consensus_queue.cc:237] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:39.685405  7455 catalog_manager.cc:5697] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 1 to 2, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.686164  7772 raft_consensus.cc:2468] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:39.691391  7454 catalog_manager.cc:5697] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.697319  8568 raft_consensus.cc:993] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.697862  8568 raft_consensus.cc:1081] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:39.699378  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51266
I20260709 13:01:39.699911  8417 raft_consensus.cc:493] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.700268  8417 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.708279  8417 raft_consensus.cc:515] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:39.710711  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:39.711225  8417 leader_election.cc:290] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:39.711249  7772 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.715291  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8124d5cf96b48d688ce6481f676f0e7" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:39.715960  7632 raft_consensus.cc:3055] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:39.716697  7772 raft_consensus.cc:2468] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:39.718875  8365 leader_election.cc:304] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:39.719130  7632 raft_consensus.cc:740] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:39.720064  8580 raft_consensus.cc:2804] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:39.720304  7632 consensus_queue.cc:260] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:39.721716  7632 raft_consensus.cc:3060] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.728171  8580 raft_consensus.cc:697] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:39.728577  7632 raft_consensus.cc:2468] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:39.729305  8580 consensus_queue.cc:237] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:39.738246  7454 catalog_manager.cc:5697] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 2 to 3, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 3 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.959005  7772 raft_consensus.cc:1275] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.960471  8580 consensus_queue.cc:1048] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.970340  7698 raft_consensus.cc:1275] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.974957  8580 consensus_queue.cc:1048] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.058028  7698 raft_consensus.cc:1275] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.059403  8570 consensus_queue.cc:1048] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.069067  7624 raft_consensus.cc:1275] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.070616  8570 consensus_queue.cc:1048] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.094986  7772 raft_consensus.cc:1275] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.096285  8580 consensus_queue.cc:1048] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.109323  7700 raft_consensus.cc:1275] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.117002  8583 consensus_queue.cc:1048] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.117506  7776 raft_consensus.cc:1275] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.119379  8583 consensus_queue.cc:1048] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:40.137523  7700 raft_consensus.cc:1275] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.140153  8585 consensus_queue.cc:1048] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.164666  7631 raft_consensus.cc:1275] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.166252  8580 consensus_queue.cc:1048] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:40.176162  7772 raft_consensus.cc:1275] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.177737  8585 consensus_queue.cc:1048] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:40.405285   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.445123   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.480684  7776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:40.481251  7776 raft_consensus.cc:606] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:40.482303  8566 raft_consensus.cc:993] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:40.482757  8570 raft_consensus.cc:1081] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:40.484138  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:40.484272  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:40.485045  7624 raft_consensus.cc:606] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:40.485126  8417 raft_consensus.cc:493] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.485621  8417 raft_consensus.cc:3060] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.487725  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:40.488381  7624 raft_consensus.cc:606] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:40.490705  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "07d5308b5f834161a9f46b9565fa95e6"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:40.491171  7624 raft_consensus.cc:606] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Received request to transfer leadership to TS 07d5308b5f834161a9f46b9565fa95e6
I20260709 13:01:40.491758  8417 raft_consensus.cc:515] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:40.493927  8417 leader_election.cc:290] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:40.494125  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:40.494730  7700 raft_consensus.cc:3060] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.495425  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4"
dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
mode: GRACEFUL
new_leader_uuid: "ebe6c341a95a4deda3fd323405e42608"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:01:40.495846  7624 raft_consensus.cc:606] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Received request to transfer leadership to TS ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:40.497390   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:40.497897  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1981e10fe1f543fcb29a57e7cd592155" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:40.498538  7776 raft_consensus.cc:3055] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.498797  7776 raft_consensus.cc:740] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:40.500052   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:40.501235  7776 consensus_queue.cc:260] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:40.501892  7700 raft_consensus.cc:2468] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:40.502681  7776 raft_consensus.cc:3060] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.502920  8367 leader_election.cc:304] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:40.503731  8580 raft_consensus.cc:2804] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.504168  8580 raft_consensus.cc:697] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:40.504933  8580 consensus_queue.cc:237] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:40.508932  7776 raft_consensus.cc:2468] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:40.516254  7453 catalog_manager.cc:5697] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.698271  8568 raft_consensus.cc:993] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:40.698722  8568 raft_consensus.cc:1081] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:40.706286  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51266
I20260709 13:01:40.707099  8417 raft_consensus.cc:493] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.707752  8417 raft_consensus.cc:3060] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.709364  8571 raft_consensus.cc:993] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:40.709945  8642 raft_consensus.cc:1081] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:40.711568  8421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51266
I20260709 13:01:40.712085  8421 raft_consensus.cc:493] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.712460  8421 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.717828  8421 raft_consensus.cc:515] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:40.719743  8421 leader_election.cc:290] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:40.719668  8417 raft_consensus.cc:515] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:40.720893  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:40.721504  7700 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.721866  8417 leader_election.cc:290] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:40.725134  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:40.725890  7772 raft_consensus.cc:3060] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.726519  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdcc56ca75e484fabc00af5a9d10bab" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:40.727233  7631 raft_consensus.cc:3055] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:40.727541  7631 raft_consensus.cc:740] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:40.728320  7631 consensus_queue.cc:260] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:40.729292  7631 raft_consensus.cc:3060] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.730406  7700 raft_consensus.cc:2468] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:40.732419  8367 leader_election.cc:304] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:40.733444  8580 raft_consensus.cc:2804] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:40.734128  8580 raft_consensus.cc:697] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:40.735193  8580 consensus_queue.cc:237] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } }
I20260709 13:01:40.737347  7772 raft_consensus.cc:2468] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:40.738178  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adb63e12f441f799b0ba5829b6291b" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:40.738865  7624 raft_consensus.cc:3055] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.738786  8365 leader_election.cc:304] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:40.739699  7624 raft_consensus.cc:740] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:40.741106  7624 consensus_queue.cc:260] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:40.742779  7624 raft_consensus.cc:3060] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.744311  7631 raft_consensus.cc:2468] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:40.745389  8585 raft_consensus.cc:2804] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.746004  8585 raft_consensus.cc:697] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:40.747113  8585 consensus_queue.cc:237] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:40.762746  7624 raft_consensus.cc:2468] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:40.769881  7453 catalog_manager.cc:5697] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 2 to 3, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 3 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.782524  8571 raft_consensus.cc:993] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower 07d5308b5f834161a9f46b9565fa95e6 to start an election
I20260709 13:01:40.783021  8642 raft_consensus.cc:1081] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Signalling peer 07d5308b5f834161a9f46b9565fa95e6 to start an election
I20260709 13:01:40.784686  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
 from {username='slave'} at 127.0.0.1:40092
I20260709 13:01:40.785305  7772 raft_consensus.cc:493] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.785679  7772 raft_consensus.cc:3060] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.787182  7453 catalog_manager.cc:5697] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.791914  7772 raft_consensus.cc:515] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:40.794319  7772 leader_election.cc:290] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267)
I20260709 13:01:40.795347  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:40.796041  7700 raft_consensus.cc:3060] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.800350  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afadb00ef5e4da3b2bd303cfd85dc7f" candidate_uuid: "07d5308b5f834161a9f46b9565fa95e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:40.800999  7624 raft_consensus.cc:3055] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.801283  7624 raft_consensus.cc:740] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:40.801410  8571 raft_consensus.cc:993] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: : Instructing follower ebe6c341a95a4deda3fd323405e42608 to start an election
I20260709 13:01:40.801957  8568 raft_consensus.cc:1081] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Signalling peer ebe6c341a95a4deda3fd323405e42608 to start an election
I20260709 13:01:40.803452  7698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4"
dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
 from {username='slave'} at 127.0.0.1:50332
I20260709 13:01:40.803171  7624 consensus_queue.cc:260] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:40.803977  7698 raft_consensus.cc:493] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.804363  7698 raft_consensus.cc:3060] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.804939  7624 raft_consensus.cc:3060] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.811038  7698 raft_consensus.cc:515] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:40.815135  7700 raft_consensus.cc:2468] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:40.816293  7746 leader_election.cc:304] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:40.817150  8641 raft_consensus.cc:2804] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.817617  8641 raft_consensus.cc:697] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Leader. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:40.818195  7624 raft_consensus.cc:2468] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d5308b5f834161a9f46b9565fa95e6 in term 2.
I20260709 13:01:40.818462  8641 consensus_queue.cc:237] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:40.821677  7698 leader_election.cc:290] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Requested vote from peers 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:40.822335  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:40.823171  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d1fdbfd5514309bf3e4e212f275ec4" candidate_uuid: "ebe6c341a95a4deda3fd323405e42608" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:40.823501  7624 raft_consensus.cc:3055] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.823801  7772 raft_consensus.cc:3060] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.824033  7624 raft_consensus.cc:740] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53979e9879e74487a8a95daacdefdbcd, State: Running, Role: LEADER
I20260709 13:01:40.825431  7624 consensus_queue.cc:260] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:40.827270  7624 raft_consensus.cc:3060] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.830682  7772 raft_consensus.cc:2468] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 2.
I20260709 13:01:40.832159  7670 leader_election.cc:304] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, ebe6c341a95a4deda3fd323405e42608; no voters: 
I20260709 13:01:40.833098  8594 raft_consensus.cc:2804] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.835695  7624 raft_consensus.cc:2468] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe6c341a95a4deda3fd323405e42608 in term 2.
I20260709 13:01:40.842141  7453 catalog_manager.cc:5697] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 reported cstate change: term changed from 1 to 2, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "07d5308b5f834161a9f46b9565fa95e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.856899  8594 raft_consensus.cc:697] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 2 LEADER]: Becoming Leader. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:40.858403  8594 consensus_queue.cc:237] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } }
I20260709 13:01:40.870138  7453 catalog_manager.cc:5697] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 reported cstate change: term changed from 1 to 2, leader changed from 53979e9879e74487a8a95daacdefdbcd (127.0.107.194) to ebe6c341a95a4deda3fd323405e42608 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ebe6c341a95a4deda3fd323405e42608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.962661  7772 raft_consensus.cc:1275] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.963912  8645 consensus_queue.cc:1048] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.989033  7698 raft_consensus.cc:1275] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.991320  8585 consensus_queue.cc:1048] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.187904  7776 raft_consensus.cc:1275] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.189138  8645 consensus_queue.cc:1048] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.200928  7631 raft_consensus.cc:1275] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.205936  8645 consensus_queue.cc:1048] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:41.229280  7631 raft_consensus.cc:1275] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:41.231647  8580 consensus_queue.cc:1048] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:41.246061  7698 raft_consensus.cc:1275] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:41.247675  8580 consensus_queue.cc:1048] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:41.276108  7624 raft_consensus.cc:1275] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.277443  8566 consensus_queue.cc:1048] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.291792  7700 raft_consensus.cc:1275] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 07d5308b5f834161a9f46b9565fa95e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.293201  8566 consensus_queue.cc:1048] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.326967  7776 raft_consensus.cc:1275] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer ebe6c341a95a4deda3fd323405e42608: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.339772  8649 consensus_queue.cc:1048] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.354880  7624 raft_consensus.cc:1275] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Refusing update from remote peer ebe6c341a95a4deda3fd323405e42608: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.356805  8649 consensus_queue.cc:1048] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.501132   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:41.540130   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:41.575839  7776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67"
dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:01:41.576423  7776 raft_consensus.cc:606] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:41.589205  7700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996"
dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
mode: GRACEFUL
new_leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:44526
I20260709 13:01:41.589682  7700 raft_consensus.cc:606] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Received request to transfer leadership to TS 8f0ca605b31c4386b93d83ddb820c36e
I20260709 13:01:41.590704   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:41.591835   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:41.684419  8641 raft_consensus.cc:993] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:41.685055  8663 raft_consensus.cc:1081] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:41.686282  8421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51264
I20260709 13:01:41.686741  8421 raft_consensus.cc:493] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:41.687036  8421 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.692402  8421 raft_consensus.cc:515] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:41.693773  8421 leader_election.cc:290] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Requested vote from peers 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107), 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939)
I20260709 13:01:41.694623  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:41.694738  7631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524dfa0cdc7644fbad395fedf8b39c67" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53979e9879e74487a8a95daacdefdbcd"
I20260709 13:01:41.695354  7773 raft_consensus.cc:3055] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:41.695425  7631 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.695770  7773 raft_consensus.cc:740] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07d5308b5f834161a9f46b9565fa95e6, State: Running, Role: LEADER
I20260709 13:01:41.696789  7773 consensus_queue.cc:260] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:41.697937  7773 raft_consensus.cc:3060] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.701745  7631 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:41.703042  8366 leader_election.cc:304] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53979e9879e74487a8a95daacdefdbcd, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:41.703734  8585 raft_consensus.cc:2804] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:41.704245  8585 raft_consensus.cc:697] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:41.705304  7773 raft_consensus.cc:2468] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 3.
I20260709 13:01:41.705113  8585 consensus_queue.cc:237] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } }
I20260709 13:01:41.715508  7453 catalog_manager.cc:5697] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 2 to 3, leader changed from 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 3 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.004611  8649 raft_consensus.cc:993] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: : Instructing follower 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:42.005185  8648 raft_consensus.cc:1081] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Signalling peer 8f0ca605b31c4386b93d83ddb820c36e to start an election
I20260709 13:01:42.006736  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996"
dest_uuid: "8f0ca605b31c4386b93d83ddb820c36e"
 from {username='slave'} at 127.0.0.1:51274
I20260709 13:01:42.007342  8418 raft_consensus.cc:493] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:42.007639  8418 raft_consensus.cc:3060] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.012810  8418 raft_consensus.cc:515] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:42.014415  8418 leader_election.cc:290] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Requested vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 07d5308b5f834161a9f46b9565fa95e6 (127.0.107.196:42107)
I20260709 13:01:42.015144  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe6c341a95a4deda3fd323405e42608"
I20260709 13:01:42.015381  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaa67cb7a5c4a679797896362fe5996" candidate_uuid: "8f0ca605b31c4386b93d83ddb820c36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07d5308b5f834161a9f46b9565fa95e6"
I20260709 13:01:42.015837  7700 raft_consensus.cc:3055] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.015914  7773 raft_consensus.cc:3060] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.016268  7700 raft_consensus.cc:740] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ebe6c341a95a4deda3fd323405e42608, State: Running, Role: LEADER
I20260709 13:01:42.017069  7700 consensus_queue.cc:260] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:42.018308  7700 raft_consensus.cc:3060] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.023429  7773 raft_consensus.cc:2468] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:42.024986  7700 raft_consensus.cc:2468] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0ca605b31c4386b93d83ddb820c36e in term 2.
I20260709 13:01:42.025648  8365 leader_election.cc:304] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6, 8f0ca605b31c4386b93d83ddb820c36e; no voters: 
I20260709 13:01:42.026672  8580 raft_consensus.cc:2804] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:42.027153  8580 raft_consensus.cc:697] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Becoming Leader. State: Replica: 8f0ca605b31c4386b93d83ddb820c36e, State: Running, Role: LEADER
I20260709 13:01:42.027987  8580 consensus_queue.cc:237] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:42.037812  7453 catalog_manager.cc:5697] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e reported cstate change: term changed from 1 to 2, leader changed from ebe6c341a95a4deda3fd323405e42608 (127.0.107.195) to 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8f0ca605b31c4386b93d83ddb820c36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.172282  7631 raft_consensus.cc:1275] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:42.173696  8585 consensus_queue.cc:1048] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53979e9879e74487a8a95daacdefdbcd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:42.189280  7773 raft_consensus.cc:1275] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:42.190618  8585 consensus_queue.cc:1048] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:42.522687  7699 raft_consensus.cc:1275] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.524219  8580 consensus_queue.cc:1048] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:42.534345  7776 raft_consensus.cc:1275] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Refusing update from remote peer 8f0ca605b31c4386b93d83ddb820c36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.541496  8585 consensus_queue.cc:1048] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:42.594028   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:42.653977   431 tablet_server.cc:179] TabletServer@127.0.107.193:42081 shutting down...
W20260709 13:01:42.691259  7745 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 75 similar messages]
W20260709 13:01:42.699795  7745 consensus_peers.cc:597] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.710986   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:42.712356   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.713682   431 raft_consensus.cc:2243] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.714354   431 raft_consensus.cc:2272] T 3f3cae1107da44f5af6f20b55687be66 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.719982   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.721134   431 raft_consensus.cc:2243] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.721902   431 raft_consensus.cc:2272] T 2299a78017b149c09890c26668ba6fd4 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.727501   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.729003   431 raft_consensus.cc:2243] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.729719   431 raft_consensus.cc:2272] T 744ab78ecf16420aa63391410de204e2 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.733613   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.734860   431 raft_consensus.cc:2243] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.735428   431 raft_consensus.cc:2272] T 868bb0c5915543b7bd6a7644aa0fc361 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.738884   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:01:42.739580  7597 consensus_peers.cc:597] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.739936   431 raft_consensus.cc:2243] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.741391   431 raft_consensus.cc:2272] T a3f93e1711174847b286ab0ede1a21c8 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.744735   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.745652   431 raft_consensus.cc:2243] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.746973   431 raft_consensus.cc:2272] T 33adb63e12f441f799b0ba5829b6291b P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.751552   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:01:42.752308  7745 consensus_peers.cc:597] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.752651   431 raft_consensus.cc:2243] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.753645   431 raft_consensus.cc:2272] T c729997968264c78bbdf7e19a94ba7bf P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.756942  7745 consensus_peers.cc:597] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.757861   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.758890   431 raft_consensus.cc:2243] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.760135   431 raft_consensus.cc:2272] T 524dfa0cdc7644fbad395fedf8b39c67 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.763986   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.764777   431 raft_consensus.cc:2243] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.765352   431 raft_consensus.cc:2272] T 2cc971cb81cf49afa0b8d663a0b267a2 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.768510   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.769327   431 raft_consensus.cc:2243] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.769913   431 raft_consensus.cc:2272] T b2fb2def96cb455bbc7a536643f246c7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.773752   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.774649   431 raft_consensus.cc:2243] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.775913   431 raft_consensus.cc:2272] T e8124d5cf96b48d688ce6481f676f0e7 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.779279   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.780105   431 raft_consensus.cc:2243] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.780719   431 raft_consensus.cc:2272] T a74589dcef6c479c90e97df23e516a12 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.784118   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.784897   431 raft_consensus.cc:2243] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.786159   431 raft_consensus.cc:2272] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.789228  7671 consensus_peers.cc:597] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.789865   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.790755   431 raft_consensus.cc:2243] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.791110   431 raft_consensus.cc:2272] T 8821c72ad05541a680bf7e51256d96c5 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.791530  7671 consensus_peers.cc:597] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.793619   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.794337   431 raft_consensus.cc:2243] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.795444   431 raft_consensus.cc:2272] T 2fdcc56ca75e484fabc00af5a9d10bab P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.798341   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.798990   431 raft_consensus.cc:2243] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.799520   431 raft_consensus.cc:2272] T 294ddc69dc9b4dcf862a83483747739f P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.802047   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.802554   431 raft_consensus.cc:2243] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.802896   431 raft_consensus.cc:2272] T 5d3022e4bfdc4b6db39017acd5786020 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.805063   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.805588   431 raft_consensus.cc:2243] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.805905   431 raft_consensus.cc:2272] T 151ef9b1313942e19ca2a8e43a49ed8c P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.807886   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.808451   431 raft_consensus.cc:2243] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.808792   431 raft_consensus.cc:2272] T 0c0b66f27b97469aa22ddc9191bad56d P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.810968   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.811506   431 raft_consensus.cc:2243] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.811858   431 raft_consensus.cc:2272] T 0320ea4b71844851b35b9d1a05a5d2c6 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.813952   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.814446   431 raft_consensus.cc:2243] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.815304   431 raft_consensus.cc:2272] T 99c1d3edcbd24605885f5aece16869f1 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.817508   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.818233   431 raft_consensus.cc:2243] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.818778   431 raft_consensus.cc:2272] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.821702   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.822528   431 raft_consensus.cc:2243] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.823086   431 raft_consensus.cc:2272] T d666861897c64b54b998b0df834afc31 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.825749   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.826468   431 raft_consensus.cc:2243] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.827049   431 raft_consensus.cc:2272] T 557c070427344f13b3df4674a7f5f307 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.829471  7671 consensus_peers.cc:597] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.830385   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.831084   431 raft_consensus.cc:2243] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.831569   431 raft_consensus.cc:2272] T 40e1b18450fa44dabc35d7960e67a0bc P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.834260   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.835032   431 raft_consensus.cc:2243] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.835444   431 raft_consensus.cc:2272] T d322269bb5424add8d6df46595372704 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.837958   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.838640   431 raft_consensus.cc:2243] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.839766   431 raft_consensus.cc:2272] T 4e06caf0de81404985683e0fa4c93453 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.840148  7597 consensus_peers.cc:597] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.841887   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.842543   431 raft_consensus.cc:2243] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.842957   431 raft_consensus.cc:2272] T 61892e5f699c46bbb647be64c3a48f96 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.845055   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.845587   431 raft_consensus.cc:2243] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.845970   431 raft_consensus.cc:2272] T bc981b77d6b8419aaab6827bd0a25275 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.848054   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.848659   431 raft_consensus.cc:2243] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.849467   431 raft_consensus.cc:2272] T 7c8e41c6979b4cb5a279abaf4c65007c P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.851676   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.852264   431 raft_consensus.cc:2243] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.853056   431 raft_consensus.cc:2272] T 1981e10fe1f543fcb29a57e7cd592155 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.855371   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.856146   431 raft_consensus.cc:2243] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.856647   431 raft_consensus.cc:2272] T 6567006f2659467e8fa74d383dddd8c0 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.859629   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.860363   431 raft_consensus.cc:2243] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.860909   431 raft_consensus.cc:2272] T e1633ca6bd2346cbbca54b2fd74b21a3 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.861974  7745 consensus_peers.cc:597] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.863348   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.864065   431 raft_consensus.cc:2243] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.864648   431 raft_consensus.cc:2272] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.867422   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:01:42.867867  7597 consensus_peers.cc:597] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.868201   431 raft_consensus.cc:2243] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.868701   431 raft_consensus.cc:2272] T 4ed0433b495a4adab9c75e40ec020b60 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.870669   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.871172   431 raft_consensus.cc:2243] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.871551   431 raft_consensus.cc:2272] T f472af11ec9e424ea42c848b20e97c35 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.873541   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.874142   431 raft_consensus.cc:2243] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.874611   431 raft_consensus.cc:2272] T 37832dc21511480f8c27bcc81ccafae7 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.876776   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.877274   431 raft_consensus.cc:2243] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.877732   431 raft_consensus.cc:2272] T 2d70fce73a46409dbc64e66b30cf76fb P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.879820   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.880481   431 raft_consensus.cc:2243] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.880991   431 raft_consensus.cc:2272] T 30af4a33a3c84877bee300138641109b P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.884099   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.884825   431 raft_consensus.cc:2243] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:42.885114  7745 consensus_peers.cc:597] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.885847   431 raft_consensus.cc:2272] T feaa67cb7a5c4a679797896362fe5996 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.889544   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.890305   431 raft_consensus.cc:2243] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.890775   431 raft_consensus.cc:2272] T c539aa1a1c68405e955915052a212104 P 8f0ca605b31c4386b93d83ddb820c36e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.892194  7671 consensus_peers.cc:597] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.893707   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.894325   431 raft_consensus.cc:2243] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.895124   431 raft_consensus.cc:2272] T e140450c826d47e194aad76501966c61 P 8f0ca605b31c4386b93d83ddb820c36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.897740   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.898399   431 raft_consensus.cc:2243] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.899385   431 raft_consensus.cc:2272] T daf282a249724a72ab2d1ad22cdc3ebb P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.901484   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.901963   431 raft_consensus.cc:2243] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:42.902393   431 raft_consensus.cc:2272] T 40fce8895f7140c1bb5c58216f2018ca P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:42.904724   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:42.905184   431 raft_consensus.cc:2243] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:42.905963   431 raft_consensus.cc:2272] T 94b58c7b55d3458f90d62cb7cd4491f3 P 8f0ca605b31c4386b93d83ddb820c36e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:42.914975  7597 consensus_peers.cc:597] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:42.915732  7597 consensus_peers.cc:597] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:42.936980  7745 consensus_peers.cc:597] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:42.946048  7671 consensus_peers.cc:597] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:42.957418  7671 consensus_peers.cc:597] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:42.989859  7671 consensus_peers.cc:597] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:42.995376  7745 consensus_peers.cc:597] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.997871   431 tablet_server.cc:196] TabletServer@127.0.107.193:42081 shutdown complete.
W20260709 13:01:42.998953  7745 consensus_peers.cc:597] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.005077  7671 consensus_peers.cc:597] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.008423  7597 consensus_peers.cc:597] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.009069  7597 consensus_peers.cc:597] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.054989  7597 consensus_peers.cc:597] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.081436  7597 consensus_peers.cc:597] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.091135  7671 consensus_peers.cc:597] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.098054  7671 consensus_peers.cc:597] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.098857   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:43.105787  7671 consensus_peers.cc:597] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.124780  7745 consensus_peers.cc:597] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.136344  7597 consensus_peers.cc:597] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.136878  7597 consensus_peers.cc:597] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd -> Peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Couldn't send request to peer 8f0ca605b31c4386b93d83ddb820c36e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.144124   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:43.148567   431 tablet_replica.cc:333] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.149711   431 raft_consensus.cc:2243] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.151265   431 raft_consensus.cc:2272] T 61892e5f699c46bbb647be64c3a48f96 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.154224   431 tablet_replica.cc:333] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.155107   431 raft_consensus.cc:2243] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.155905   431 raft_consensus.cc:2272] T 2299a78017b149c09890c26668ba6fd4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.157929   431 tablet_replica.cc:333] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.158542   431 raft_consensus.cc:2243] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.158993   431 raft_consensus.cc:2272] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.161060   431 tablet_replica.cc:333] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.161705   431 raft_consensus.cc:2243] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.162158   431 raft_consensus.cc:2272] T 37832dc21511480f8c27bcc81ccafae7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.164542   431 tablet_replica.cc:333] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.165318   431 raft_consensus.cc:2243] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.165792   431 raft_consensus.cc:2272] T 78cabd51630341128537276b69e1d771 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.168815   431 tablet_replica.cc:333] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.169601   431 raft_consensus.cc:2243] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.170257   431 raft_consensus.cc:2272] T 7d5e9a92801e4073b7efd1cf6ec0b299 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.173177   431 tablet_replica.cc:333] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.173914   431 raft_consensus.cc:2243] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.174402   431 raft_consensus.cc:2272] T e8124d5cf96b48d688ce6481f676f0e7 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.175750  7745 consensus_peers.cc:597] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.176941   431 tablet_replica.cc:333] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.177552   431 raft_consensus.cc:2243] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.177959   431 raft_consensus.cc:2272] T c539aa1a1c68405e955915052a212104 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.180605   431 tablet_replica.cc:333] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.181183   431 raft_consensus.cc:2243] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.181752   431 raft_consensus.cc:2272] T 77d1fdbfd5514309bf3e4e212f275ec4 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.183907   431 tablet_replica.cc:333] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.184671   431 raft_consensus.cc:2243] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.185065   431 raft_consensus.cc:2272] T 443a208ce4b24ce880e010a7916485d4 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.187335   431 tablet_replica.cc:333] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.188091   431 raft_consensus.cc:2243] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.188675   431 raft_consensus.cc:2272] T a3f93e1711174847b286ab0ede1a21c8 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.191401   431 tablet_replica.cc:333] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.192162   431 raft_consensus.cc:2243] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.193168   431 raft_consensus.cc:2272] T f6e898bc5032410ca78cbdab796104c0 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.194290  7671 consensus_peers.cc:597] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.195966   431 tablet_replica.cc:333] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.196916   431 raft_consensus.cc:2243] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.197321   431 raft_consensus.cc:2272] T cfc999ec44e646bab1cfdf860801548c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.199167   431 tablet_replica.cc:333] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.199741   431 raft_consensus.cc:2243] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.200119   431 raft_consensus.cc:2272] T 4ed0433b495a4adab9c75e40ec020b60 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.202059   431 tablet_replica.cc:333] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.202530   431 raft_consensus.cc:2243] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.203312   431 raft_consensus.cc:2272] T f472af11ec9e424ea42c848b20e97c35 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.206030   431 tablet_replica.cc:333] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.206763   431 raft_consensus.cc:2243] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.207312   431 raft_consensus.cc:2272] T 33adb63e12f441f799b0ba5829b6291b P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.210388   431 tablet_replica.cc:333] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.211347   431 raft_consensus.cc:2243] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.211989   431 raft_consensus.cc:2272] T 2d70fce73a46409dbc64e66b30cf76fb P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.214921   431 tablet_replica.cc:333] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.215595   431 raft_consensus.cc:2243] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.216722   431 raft_consensus.cc:2272] T 30af4a33a3c84877bee300138641109b P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.219007   431 tablet_replica.cc:333] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.219483   431 raft_consensus.cc:2243] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.220641   431 raft_consensus.cc:2272] T 868bb0c5915543b7bd6a7644aa0fc361 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.222500   431 tablet_replica.cc:333] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.222998   431 raft_consensus.cc:2243] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.223729   431 raft_consensus.cc:2272] T b2fb2def96cb455bbc7a536643f246c7 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.225648   431 tablet_replica.cc:333] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.226136   431 raft_consensus.cc:2243] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.226990   431 raft_consensus.cc:2272] T 5d3022e4bfdc4b6db39017acd5786020 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.228904   431 tablet_replica.cc:333] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.229636   431 raft_consensus.cc:2243] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.230060   431 raft_consensus.cc:2272] T 294ddc69dc9b4dcf862a83483747739f P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.233302   431 tablet_replica.cc:333] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.233848   431 raft_consensus.cc:2243] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.234275   431 raft_consensus.cc:2272] T 6f242eb526cd4973918a7293d825cbbe P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.236744   431 tablet_replica.cc:333] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.237586   431 raft_consensus.cc:2243] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.238154   431 raft_consensus.cc:2272] T 0c0b66f27b97469aa22ddc9191bad56d P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.240093   431 tablet_replica.cc:333] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.240696   431 raft_consensus.cc:2243] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.241487   431 raft_consensus.cc:2272] T 151ef9b1313942e19ca2a8e43a49ed8c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.243350   431 tablet_replica.cc:333] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.243856   431 raft_consensus.cc:2243] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.244671   431 raft_consensus.cc:2272] T 2fa66f85089b48afada6adb174712a9a P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.246527   431 tablet_replica.cc:333] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.247045   431 raft_consensus.cc:2243] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.247473   431 raft_consensus.cc:2272] T 2fdcc56ca75e484fabc00af5a9d10bab P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.249514   431 tablet_replica.cc:333] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.250108   431 raft_consensus.cc:2243] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.250573   431 raft_consensus.cc:2272] T f653b5173b0b42bb869623267b61bfca P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.252671   431 tablet_replica.cc:333] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.253232   431 raft_consensus.cc:2243] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.254048   431 raft_consensus.cc:2272] T bc981b77d6b8419aaab6827bd0a25275 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.256430   431 tablet_replica.cc:333] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.256970   431 raft_consensus.cc:2243] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.257401   431 raft_consensus.cc:2272] T 7c8e41c6979b4cb5a279abaf4c65007c P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.259300   431 tablet_replica.cc:333] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.259832   431 raft_consensus.cc:2243] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.260339   431 raft_consensus.cc:2272] T 707d80b971064b8fbb0d0a9b353a53ae P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.262415   431 tablet_replica.cc:333] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.262945   431 raft_consensus.cc:2243] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.263762   431 raft_consensus.cc:2272] T f7ba54050b634067a6e55c28cfa270ba P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.265636   431 tablet_replica.cc:333] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.266173   431 raft_consensus.cc:2243] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.266587   431 raft_consensus.cc:2272] T e140450c826d47e194aad76501966c61 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.268564   431 tablet_replica.cc:333] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.269078   431 raft_consensus.cc:2243] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.269876   431 raft_consensus.cc:2272] T 40fce8895f7140c1bb5c58216f2018ca P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.271855   431 tablet_replica.cc:333] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.272514   431 raft_consensus.cc:2243] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.273260   431 raft_consensus.cc:2272] T 557c070427344f13b3df4674a7f5f307 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.275300   431 tablet_replica.cc:333] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.275895   431 raft_consensus.cc:2243] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.276475   431 raft_consensus.cc:2272] T 524dfa0cdc7644fbad395fedf8b39c67 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.278541  7745 consensus_peers.cc:597] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.279374   431 tablet_replica.cc:333] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.280274   431 raft_consensus.cc:2243] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:43.280779  7671 consensus_peers.cc:597] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.281220   431 raft_consensus.cc:2272] T c729997968264c78bbdf7e19a94ba7bf P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.283396   431 tablet_replica.cc:333] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.284154   431 raft_consensus.cc:2243] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.284855   431 raft_consensus.cc:2272] T a74589dcef6c479c90e97df23e516a12 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.287753   431 tablet_replica.cc:333] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.288448   431 raft_consensus.cc:2243] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.288967   431 raft_consensus.cc:2272] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.291745   431 tablet_replica.cc:333] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.292465   431 raft_consensus.cc:2243] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:43.292798  7671 consensus_peers.cc:597] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.293083   431 raft_consensus.cc:2272] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 53979e9879e74487a8a95daacdefdbcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.295396   431 tablet_replica.cc:333] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.295925   431 raft_consensus.cc:2243] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.296422   431 raft_consensus.cc:2272] T d322269bb5424add8d6df46595372704 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.298659   431 tablet_replica.cc:333] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.299131   431 raft_consensus.cc:2243] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.299633   431 raft_consensus.cc:2272] T 41f635c63a7d4a5c9eab84b42ebe8786 P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.302311   431 tablet_replica.cc:333] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.302784   431 raft_consensus.cc:2243] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.303277   431 raft_consensus.cc:2272] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 53979e9879e74487a8a95daacdefdbcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.305636   431 tablet_replica.cc:333] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd: stopping tablet replica
I20260709 13:01:43.306247   431 raft_consensus.cc:2243] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.306799   431 raft_consensus.cc:2272] T 5e1c347c14744ddebeb34bf12cec639c P 53979e9879e74487a8a95daacdefdbcd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.309293  7745 consensus_peers.cc:597] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.372566  7671 consensus_peers.cc:597] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.389837   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:43.394018  7745 consensus_peers.cc:597] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.403836  7671 consensus_peers.cc:597] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.418314  7745 consensus_peers.cc:597] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.478490   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:43.497625  7671 consensus_peers.cc:597] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.501801  7745 consensus_peers.cc:597] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.513967  7745 consensus_peers.cc:597] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.514516  7745 consensus_peers.cc:597] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.521281  7745 consensus_peers.cc:597] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.532672  7746 consensus_peers.cc:597] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.534070  7671 consensus_peers.cc:597] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.538256   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:43.539096   431 tablet_replica.cc:333] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.539822   431 raft_consensus.cc:2243] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.540395   431 raft_consensus.cc:2272] T 61892e5f699c46bbb647be64c3a48f96 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.542680   431 tablet_replica.cc:333] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.543304   431 raft_consensus.cc:2243] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.544117   431 raft_consensus.cc:2272] T 37832dc21511480f8c27bcc81ccafae7 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.546171   431 tablet_replica.cc:333] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.546886   431 raft_consensus.cc:2243] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.547920   431 raft_consensus.cc:2272] T 77d1fdbfd5514309bf3e4e212f275ec4 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.550303   431 tablet_replica.cc:333] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.550953   431 raft_consensus.cc:2243] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.551395   431 raft_consensus.cc:2272] T feaa67cb7a5c4a679797896362fe5996 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.554060   431 tablet_replica.cc:333] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.554840   431 raft_consensus.cc:2243] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.555647   431 raft_consensus.cc:2272] T c539aa1a1c68405e955915052a212104 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.557783   431 tablet_replica.cc:333] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.558377   431 raft_consensus.cc:2243] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.559233   431 raft_consensus.cc:2272] T 443a208ce4b24ce880e010a7916485d4 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.561340   431 tablet_replica.cc:333] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.561949   431 raft_consensus.cc:2243] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.562465   431 raft_consensus.cc:2272] T f6e898bc5032410ca78cbdab796104c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.565284   431 tablet_replica.cc:333] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.566120   431 raft_consensus.cc:2243] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.566767   431 raft_consensus.cc:2272] T cfc999ec44e646bab1cfdf860801548c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.569844   431 tablet_replica.cc:333] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.570688   431 raft_consensus.cc:2243] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.571832   431 raft_consensus.cc:2272] T 6567006f2659467e8fa74d383dddd8c0 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.572659  7746 consensus_peers.cc:597] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.573477  7746 consensus_peers.cc:597] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.575029   431 tablet_replica.cc:333] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.575858   431 raft_consensus.cc:2243] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.576411   431 raft_consensus.cc:2272] T 1981e10fe1f543fcb29a57e7cd592155 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.579319   431 tablet_replica.cc:333] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.580147   431 raft_consensus.cc:2243] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.581212   431 raft_consensus.cc:2272] T 4ed0433b495a4adab9c75e40ec020b60 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.583369   431 tablet_replica.cc:333] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.583933   431 raft_consensus.cc:2243] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.584375   431 raft_consensus.cc:2272] T f472af11ec9e424ea42c848b20e97c35 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.586413   431 tablet_replica.cc:333] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.586935   431 raft_consensus.cc:2243] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.587785   431 raft_consensus.cc:2272] T d666861897c64b54b998b0df834afc31 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.590273   431 tablet_replica.cc:333] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.590777   431 raft_consensus.cc:2243] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.591140   431 raft_consensus.cc:2272] T f7ba54050b634067a6e55c28cfa270ba P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.593093   431 tablet_replica.cc:333] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.593597   431 raft_consensus.cc:2243] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.593953   431 raft_consensus.cc:2272] T 707d80b971064b8fbb0d0a9b353a53ae P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.595762   431 tablet_replica.cc:333] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.596367   431 raft_consensus.cc:2243] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.597349   431 raft_consensus.cc:2272] T 78cabd51630341128537276b69e1d771 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.599428   431 tablet_replica.cc:333] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.600178   431 raft_consensus.cc:2243] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.601119   431 raft_consensus.cc:2272] T 7d5e9a92801e4073b7efd1cf6ec0b299 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.603091   431 tablet_replica.cc:333] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.603636   431 raft_consensus.cc:2243] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.604080   431 raft_consensus.cc:2272] T 0320ea4b71844851b35b9d1a05a5d2c6 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.606153   431 tablet_replica.cc:333] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.606678   431 raft_consensus.cc:2243] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.607095   431 raft_consensus.cc:2272] T 99c1d3edcbd24605885f5aece16869f1 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.609225   431 tablet_replica.cc:333] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.609807   431 raft_consensus.cc:2243] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.610229   431 raft_consensus.cc:2272] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.612007   431 tablet_replica.cc:333] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.612596   431 raft_consensus.cc:2243] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.613008   431 raft_consensus.cc:2272] T 8821c72ad05541a680bf7e51256d96c5 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.614743   431 tablet_replica.cc:333] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.615418   431 raft_consensus.cc:2243] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.615825   431 raft_consensus.cc:2272] T 6f242eb526cd4973918a7293d825cbbe P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.617763   431 tablet_replica.cc:333] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.618253   431 raft_consensus.cc:2243] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.618660   431 raft_consensus.cc:2272] T 744ab78ecf16420aa63391410de204e2 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.620404   431 tablet_replica.cc:333] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.620898   431 raft_consensus.cc:2243] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.621320   431 raft_consensus.cc:2272] T 868bb0c5915543b7bd6a7644aa0fc361 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.622964   431 tablet_replica.cc:333] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.623481   431 raft_consensus.cc:2243] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.624267   431 raft_consensus.cc:2272] T 3f3cae1107da44f5af6f20b55687be66 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.626031   431 tablet_replica.cc:333] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.626644   431 raft_consensus.cc:2243] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.627511   431 raft_consensus.cc:2272] T 40e1b18450fa44dabc35d7960e67a0bc P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.630214   431 tablet_replica.cc:333] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
W20260709 13:01:43.630468  7746 consensus_peers.cc:597] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.630952   431 raft_consensus.cc:2243] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.631549   431 raft_consensus.cc:2272] T 557c070427344f13b3df4674a7f5f307 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.633450   431 tablet_replica.cc:333] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.634032   431 raft_consensus.cc:2243] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.634757   431 raft_consensus.cc:2272] T e1633ca6bd2346cbbca54b2fd74b21a3 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.636731   431 tablet_replica.cc:333] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.637267   431 raft_consensus.cc:2243] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.637682   431 raft_consensus.cc:2272] T c729997968264c78bbdf7e19a94ba7bf P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.639585   431 tablet_replica.cc:333] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.640108   431 raft_consensus.cc:2243] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.640898   431 raft_consensus.cc:2272] T a74589dcef6c479c90e97df23e516a12 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.642750   431 tablet_replica.cc:333] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.643309   431 raft_consensus.cc:2243] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.643723   431 raft_consensus.cc:2272] T bc981b77d6b8419aaab6827bd0a25275 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.645967   431 tablet_replica.cc:333] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.646509   431 raft_consensus.cc:2243] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.647256   431 raft_consensus.cc:2272] T 5e1c347c14744ddebeb34bf12cec639c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.649235   431 tablet_replica.cc:333] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.649755   431 raft_consensus.cc:2243] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.650163   431 raft_consensus.cc:2272] T 3afadb00ef5e4da3b2bd303cfd85dc7f P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.652364   431 tablet_replica.cc:333] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.653017   431 raft_consensus.cc:2243] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.653463   431 raft_consensus.cc:2272] T 2cc971cb81cf49afa0b8d663a0b267a2 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.655813   431 tablet_replica.cc:333] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
W20260709 13:01:43.655761  7745 consensus_peers.cc:597] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 -> Peer 53979e9879e74487a8a95daacdefdbcd (127.0.107.194:36939): Couldn't send request to peer 53979e9879e74487a8a95daacdefdbcd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.656718   431 raft_consensus.cc:2243] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.657119   431 raft_consensus.cc:2272] T daf282a249724a72ab2d1ad22cdc3ebb P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.658897   431 tablet_replica.cc:333] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.659365   431 raft_consensus.cc:2243] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.659790   431 raft_consensus.cc:2272] T 40fce8895f7140c1bb5c58216f2018ca P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.661695   431 tablet_replica.cc:333] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.662410   431 raft_consensus.cc:2243] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.662828   431 raft_consensus.cc:2272] T 4e06caf0de81404985683e0fa4c93453 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.664796   431 tablet_replica.cc:333] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.665288   431 raft_consensus.cc:2243] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.665699   431 raft_consensus.cc:2272] T 94b58c7b55d3458f90d62cb7cd4491f3 P ebe6c341a95a4deda3fd323405e42608 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.667574   431 tablet_replica.cc:333] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.668081   431 raft_consensus.cc:2243] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.668555   431 raft_consensus.cc:2272] T 41f635c63a7d4a5c9eab84b42ebe8786 P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.670321   431 tablet_replica.cc:333] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.670783   431 raft_consensus.cc:2243] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.671532   431 raft_consensus.cc:2272] T 0c0b66f27b97469aa22ddc9191bad56d P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.673528   431 tablet_replica.cc:333] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.673997   431 raft_consensus.cc:2243] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.674389   431 raft_consensus.cc:2272] T 151ef9b1313942e19ca2a8e43a49ed8c P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.676319   431 tablet_replica.cc:333] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.676786   431 raft_consensus.cc:2243] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.677182   431 raft_consensus.cc:2272] T 2fa66f85089b48afada6adb174712a9a P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.679044   431 tablet_replica.cc:333] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.679505   431 raft_consensus.cc:2243] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.680006   431 raft_consensus.cc:2272] T 2fdcc56ca75e484fabc00af5a9d10bab P ebe6c341a95a4deda3fd323405e42608 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.681829   431 tablet_replica.cc:333] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608: stopping tablet replica
I20260709 13:01:43.682226   431 raft_consensus.cc:2243] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.682564   431 raft_consensus.cc:2272] T f653b5173b0b42bb869623267b61bfca P ebe6c341a95a4deda3fd323405e42608 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.689785  7746 consensus_peers.cc:597] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.716423  7746 consensus_peers.cc:597] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.751358   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:43.753407  7746 consensus_peers.cc:597] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.816416  7746 consensus_peers.cc:597] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.848695  8702 raft_consensus.cc:493] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:43.849421  8702 raft_consensus.cc:515] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:43.851899  8702 leader_election.cc:290] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:43.852614   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:01:43.856431  7745 leader_election.cc:336] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111)
W20260709 13:01:43.857208  7746 leader_election.cc:336] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111)
I20260709 13:01:43.857554  7746 leader_election.cc:304] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:43.858148  8702 raft_consensus.cc:2749] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:43.877764  7746 consensus_peers.cc:597] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.917088   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:43.918154   431 tablet_replica.cc:333] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.918903   431 raft_consensus.cc:2243] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.919430   431 raft_consensus.cc:2272] T 524dfa0cdc7644fbad395fedf8b39c67 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.921759   431 tablet_replica.cc:333] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.922360   431 raft_consensus.cc:2243] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.922803   431 raft_consensus.cc:2272] T 2299a78017b149c09890c26668ba6fd4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.924782   431 tablet_replica.cc:333] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.925331   431 raft_consensus.cc:2243] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.925753   431 raft_consensus.cc:2272] T 40e1b18450fa44dabc35d7960e67a0bc P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.927745   431 tablet_replica.cc:333] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.928391   431 raft_consensus.cc:2243] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.928962   431 raft_consensus.cc:2272] T feaa67cb7a5c4a679797896362fe5996 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.930267  8698 raft_consensus.cc:493] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:43.930840  8698 raft_consensus.cc:515] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:43.931641   431 tablet_replica.cc:333] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.932610   431 raft_consensus.cc:2243] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.932981  8698 leader_election.cc:290] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:43.933593   431 raft_consensus.cc:2272] T 744ab78ecf16420aa63391410de204e2 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.936252   431 tablet_replica.cc:333] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.937126   431 raft_consensus.cc:2243] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.937700   431 raft_consensus.cc:2272] T a3f93e1711174847b286ab0ede1a21c8 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.937973  7746 leader_election.cc:336] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111)
W20260709 13:01:43.940021  7745 leader_election.cc:336] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111)
I20260709 13:01:43.940454   431 tablet_replica.cc:333] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.940467  7745 leader_election.cc:304] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:43.941170   431 raft_consensus.cc:2243] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.941304  8698 raft_consensus.cc:2749] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.941649   431 raft_consensus.cc:2272] T 77d1fdbfd5514309bf3e4e212f275ec4 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.943811   431 tablet_replica.cc:333] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.944471   431 raft_consensus.cc:2243] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.944918   431 raft_consensus.cc:2272] T 443a208ce4b24ce880e010a7916485d4 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.946877   431 tablet_replica.cc:333] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.947499   431 raft_consensus.cc:2243] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.947945   431 raft_consensus.cc:2272] T e8124d5cf96b48d688ce6481f676f0e7 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.949839   431 tablet_replica.cc:333] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.950572   431 raft_consensus.cc:2243] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.951155   431 raft_consensus.cc:2272] T f6e898bc5032410ca78cbdab796104c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.953828   431 tablet_replica.cc:333] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.954413   431 raft_consensus.cc:2243] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.954959  8698 raft_consensus.cc:493] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8f0ca605b31c4386b93d83ddb820c36e)
I20260709 13:01:43.955392   431 raft_consensus.cc:2272] T cfc999ec44e646bab1cfdf860801548c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.955448  8698 raft_consensus.cc:515] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebe6c341a95a4deda3fd323405e42608" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38267 } } peers { permanent_uuid: "07d5308b5f834161a9f46b9565fa95e6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42107 } } peers { permanent_uuid: "8f0ca605b31c4386b93d83ddb820c36e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42081 } }
I20260709 13:01:43.957396  8698 leader_election.cc:290] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267), 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081)
I20260709 13:01:43.957778   431 tablet_replica.cc:333] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.958705   431 raft_consensus.cc:2243] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.959261   431 raft_consensus.cc:2272] T 33adb63e12f441f799b0ba5829b6291b P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:43.961511  7746 leader_election.cc:336] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111)
I20260709 13:01:43.962196   431 tablet_replica.cc:333] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
W20260709 13:01:43.962282  7745 leader_election.cc:336] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8f0ca605b31c4386b93d83ddb820c36e (127.0.107.193:42081): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42081: connect: Connection refused (error 111)
I20260709 13:01:43.962750  7745 leader_election.cc:304] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07d5308b5f834161a9f46b9565fa95e6; no voters: 8f0ca605b31c4386b93d83ddb820c36e, ebe6c341a95a4deda3fd323405e42608
I20260709 13:01:43.962980   431 raft_consensus.cc:2243] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.963361  8698 raft_consensus.cc:2749] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.963553   431 raft_consensus.cc:2272] T 6567006f2659467e8fa74d383dddd8c0 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.965987   431 tablet_replica.cc:333] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.966747   431 raft_consensus.cc:2243] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.967291   431 raft_consensus.cc:2272] T 1981e10fe1f543fcb29a57e7cd592155 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.969736   431 tablet_replica.cc:333] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.970286   431 raft_consensus.cc:2243] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.970734   431 raft_consensus.cc:2272] T b2fb2def96cb455bbc7a536643f246c7 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.972949   431 tablet_replica.cc:333] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
W20260709 13:01:43.973014  7746 consensus_peers.cc:597] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 -> Peer ebe6c341a95a4deda3fd323405e42608 (127.0.107.195:38267): Couldn't send request to peer ebe6c341a95a4deda3fd323405e42608. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.973557   431 raft_consensus.cc:2243] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.974352   431 raft_consensus.cc:2272] T 2d70fce73a46409dbc64e66b30cf76fb P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.976430   431 tablet_replica.cc:333] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.976975   431 raft_consensus.cc:2243] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.977412   431 raft_consensus.cc:2272] T 30af4a33a3c84877bee300138641109b P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.979378   431 tablet_replica.cc:333] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.979923   431 raft_consensus.cc:2243] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.980417   431 raft_consensus.cc:2272] T 78cabd51630341128537276b69e1d771 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.982283   431 tablet_replica.cc:333] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.982831   431 raft_consensus.cc:2243] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.983654   431 raft_consensus.cc:2272] T 0320ea4b71844851b35b9d1a05a5d2c6 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.985563   431 tablet_replica.cc:333] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.986233   431 raft_consensus.cc:2243] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.986644   431 raft_consensus.cc:2272] T 99c1d3edcbd24605885f5aece16869f1 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.988715   431 tablet_replica.cc:333] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.989226   431 raft_consensus.cc:2243] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.990041   431 raft_consensus.cc:2272] T 7f8c8390fe4c4f5f869c4f9bd12d1f72 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.991848   431 tablet_replica.cc:333] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.992439   431 raft_consensus.cc:2243] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.992883   431 raft_consensus.cc:2272] T 80f8a79b4a1f4ba1b853e27bb9a44736 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.994710   431 tablet_replica.cc:333] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.995229   431 raft_consensus.cc:2243] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:43.995978   431 raft_consensus.cc:2272] T 8821c72ad05541a680bf7e51256d96c5 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:43.997987   431 tablet_replica.cc:333] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:43.998524   431 raft_consensus.cc:2243] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:43.998946   431 raft_consensus.cc:2272] T d666861897c64b54b998b0df834afc31 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.001009   431 tablet_replica.cc:333] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.001547   431 raft_consensus.cc:2243] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.002307   431 raft_consensus.cc:2272] T 707d80b971064b8fbb0d0a9b353a53ae P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.004101   431 tablet_replica.cc:333] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.004662   431 raft_consensus.cc:2243] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.005072   431 raft_consensus.cc:2272] T f7ba54050b634067a6e55c28cfa270ba P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.006870   431 tablet_replica.cc:333] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.007388   431 raft_consensus.cc:2243] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.007786   431 raft_consensus.cc:2272] T 5d3022e4bfdc4b6db39017acd5786020 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.009690   431 tablet_replica.cc:333] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.010210   431 raft_consensus.cc:2243] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.010929   431 raft_consensus.cc:2272] T 294ddc69dc9b4dcf862a83483747739f P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.013312   431 tablet_replica.cc:333] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.013859   431 raft_consensus.cc:2243] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.014628   431 raft_consensus.cc:2272] T 6f242eb526cd4973918a7293d825cbbe P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.016592   431 tablet_replica.cc:333] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.017134   431 raft_consensus.cc:2243] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.017645   431 raft_consensus.cc:2272] T daf282a249724a72ab2d1ad22cdc3ebb P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.019583   431 tablet_replica.cc:333] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.020078   431 raft_consensus.cc:2243] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.020514   431 raft_consensus.cc:2272] T e140450c826d47e194aad76501966c61 P 07d5308b5f834161a9f46b9565fa95e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.022285   431 tablet_replica.cc:333] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.022785   431 raft_consensus.cc:2243] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.023490   431 raft_consensus.cc:2272] T fcbc5ef8c78a4759a2bb8fe7a52b49d3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.025322   431 tablet_replica.cc:333] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.025830   431 raft_consensus.cc:2243] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.026286   431 raft_consensus.cc:2272] T e1633ca6bd2346cbbca54b2fd74b21a3 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.028162   431 tablet_replica.cc:333] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.028690   431 raft_consensus.cc:2243] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.029086   431 raft_consensus.cc:2272] T 2fa66f85089b48afada6adb174712a9a P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.030923   431 tablet_replica.cc:333] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.031494   431 raft_consensus.cc:2243] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.032271   431 raft_consensus.cc:2272] T f653b5173b0b42bb869623267b61bfca P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.034013   431 tablet_replica.cc:333] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.034497   431 raft_consensus.cc:2243] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.034942   431 raft_consensus.cc:2272] T 7c8e41c6979b4cb5a279abaf4c65007c P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.036739   431 tablet_replica.cc:333] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.037235   431 raft_consensus.cc:2243] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.037627   431 raft_consensus.cc:2272] T 3f3cae1107da44f5af6f20b55687be66 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.039434   431 tablet_replica.cc:333] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.039924   431 raft_consensus.cc:2243] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.040385   431 raft_consensus.cc:2272] T 4e06caf0de81404985683e0fa4c93453 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.042135   431 tablet_replica.cc:333] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.042603   431 raft_consensus.cc:2243] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.043311   431 raft_consensus.cc:2272] T d322269bb5424add8d6df46595372704 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.045161   431 tablet_replica.cc:333] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.045625   431 raft_consensus.cc:2243] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.046013   431 raft_consensus.cc:2272] T 94b58c7b55d3458f90d62cb7cd4491f3 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.047857   431 tablet_replica.cc:333] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.048352   431 raft_consensus.cc:2243] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.049073   431 raft_consensus.cc:2272] T 41f635c63a7d4a5c9eab84b42ebe8786 P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.050840   431 tablet_replica.cc:333] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.051331   431 raft_consensus.cc:2243] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:44.051759   431 raft_consensus.cc:2272] T 5e1c347c14744ddebeb34bf12cec639c P 07d5308b5f834161a9f46b9565fa95e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.053650   431 tablet_replica.cc:333] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.054183   431 raft_consensus.cc:2243] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.055246   431 raft_consensus.cc:2272] T 3afadb00ef5e4da3b2bd303cfd85dc7f P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.057077   431 tablet_replica.cc:333] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6: stopping tablet replica
I20260709 13:01:44.057458   431 raft_consensus.cc:2243] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.058089   431 raft_consensus.cc:2272] T 2cc971cb81cf49afa0b8d663a0b267a2 P 07d5308b5f834161a9f46b9565fa95e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.124745   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:44.185442   431 master.cc:562] Master@127.0.107.254:44269 shutting down...
I20260709 13:01:44.210527   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:44.211180   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:44.211540   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9198f12b4abf43fb82c87bc083a6d5c9: stopping tablet replica
I20260709 13:01:44.233850   431 master.cc:584] Master@127.0.107.254:44269 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30373 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:01:44.326289   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37117
I20260709 13:01:44.327600   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:44.334015  8706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.334393  8709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.334631  8707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:44.336202   431 server_base.cc:1061] running on GCE node
I20260709 13:01:44.341327   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:44.341542   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:44.341655   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602104341643 us; error 0 us; skew 500 ppm
I20260709 13:01:44.342126   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:44.347954   431 webserver.cc:533] Webserver started at http://127.0.107.254:45589/ using document root <none> and password file <none>
I20260709 13:01:44.348520   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:44.348688   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:44.348901   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:44.350026   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "8d29a126bafe44a5ae8957fc4c139c2b"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.354528   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:44.357846  8714 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.358739   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:44.359058   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "8d29a126bafe44a5ae8957fc4c139c2b"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.359359   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:44.376783   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:44.377985   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:44.415767   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37117
I20260709 13:01:44.415871  8765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37117 every 8 connection(s)
I20260709 13:01:44.419709  8766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.430295  8766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b: Bootstrap starting.
I20260709 13:01:44.435281  8766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.439550  8766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b: No bootstrap required, opened a new log
I20260709 13:01:44.441749  8766 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" member_type: VOTER }
I20260709 13:01:44.442140  8766 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.442317  8766 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d29a126bafe44a5ae8957fc4c139c2b, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.442919  8766 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" member_type: VOTER }
I20260709 13:01:44.443367  8766 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:44.443564  8766 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:44.443766  8766 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.448657  8766 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" member_type: VOTER }
I20260709 13:01:44.449150  8766 leader_election.cc:304] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d29a126bafe44a5ae8957fc4c139c2b; no voters: 
I20260709 13:01:44.450289  8766 leader_election.cc:290] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:44.450659  8769 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.452065  8769 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 1 LEADER]: Becoming Leader. State: Replica: 8d29a126bafe44a5ae8957fc4c139c2b, State: Running, Role: LEADER
I20260709 13:01:44.452862  8769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" member_type: VOTER }
I20260709 13:01:44.453475  8766 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:44.457908  8771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d29a126bafe44a5ae8957fc4c139c2b. Latest consensus state: current_term: 1 leader_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" member_type: VOTER } }
I20260709 13:01:44.458606  8771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:44.459662  8770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d29a126bafe44a5ae8957fc4c139c2b" member_type: VOTER } }
I20260709 13:01:44.460326  8770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:44.466197  8777 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:44.471217  8777 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:44.474594   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:44.480641  8777 catalog_manager.cc:1383] Generated new cluster ID: 7ec19f85f8c14c59b000cf739dd6551d
I20260709 13:01:44.480965  8777 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:44.508378  8777 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:44.509708  8777 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:44.527889  8777 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b: Generated new TSK 0
I20260709 13:01:44.528548  8777 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:44.541952   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:44.548379  8787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.548961  8788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.550580  8790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:44.551271   431 server_base.cc:1061] running on GCE node
I20260709 13:01:44.552165   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:44.552417   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:44.552562   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602104552550 us; error 0 us; skew 500 ppm
I20260709 13:01:44.553138   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:44.555339   431 webserver.cc:533] Webserver started at http://127.0.107.193:37735/ using document root <none> and password file <none>
I20260709 13:01:44.555845   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:44.556002   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:44.556277   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:44.557325   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "5bc088022ef345edaf52dab445137eb1"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.561849   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:44.565229  8795 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.566000   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:44.566334   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "5bc088022ef345edaf52dab445137eb1"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.566644   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:44.581858   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:44.583374   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:44.585343   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:44.587952   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:44.588183   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.588529   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:44.588725   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.628566   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35557
I20260709 13:01:44.628664  8857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35557 every 8 connection(s)
I20260709 13:01:44.633876   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:44.641443  8862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.644737  8863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.645033  8865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:44.647874   431 server_base.cc:1061] running on GCE node
I20260709 13:01:44.648818  8858 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37117
I20260709 13:01:44.649281  8858 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:44.649416   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:44.649710   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:44.649904   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602104649885 us; error 0 us; skew 500 ppm
I20260709 13:01:44.650211  8858 heartbeater.cc:507] Master 127.0.107.254:37117 requested a full tablet report, sending...
I20260709 13:01:44.650710   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:44.652757  8731 ts_manager.cc:194] Registered new tserver with Master: 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557)
I20260709 13:01:44.653709   431 webserver.cc:533] Webserver started at http://127.0.107.194:33915/ using document root <none> and password file <none>
I20260709 13:01:44.654419   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:44.654661   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:44.654958   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:44.655344  8731 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44390
I20260709 13:01:44.656586   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "837a11cf78ec455ca7738792bab5df0c"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.661801   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:01:44.665053  8870 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.665835   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:44.666251   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "837a11cf78ec455ca7738792bab5df0c"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.666553   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:44.690490   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:44.692333   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:44.694428   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:44.697640   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:44.697950   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.698259   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:44.698498   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.751971   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37847
I20260709 13:01:44.752074  8932 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37847 every 8 connection(s)
I20260709 13:01:44.756860   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:44.764590  8936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.767223  8937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:44.768738  8939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:44.769207   431 server_base.cc:1061] running on GCE node
I20260709 13:01:44.770236   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:44.770506   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:44.770735   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602104770715 us; error 0 us; skew 500 ppm
I20260709 13:01:44.771467   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:44.771477  8933 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37117
I20260709 13:01:44.772011  8933 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:44.772955  8933 heartbeater.cc:507] Master 127.0.107.254:37117 requested a full tablet report, sending...
I20260709 13:01:44.774158   431 webserver.cc:533] Webserver started at http://127.0.107.195:42337/ using document root <none> and password file <none>
I20260709 13:01:44.774780   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:44.775022   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:44.775206  8731 ts_manager.cc:194] Registered new tserver with Master: 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:44.775318   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:44.776684   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.776714  8731 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44394
I20260709 13:01:44.781299   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:01:44.784763  8944 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.785696   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:01:44.785966   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:44.786219   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:44.799749   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:44.800997   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:44.802433   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:44.804738   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:44.804945   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.805207   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:44.805346   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:44.845139   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39119
I20260709 13:01:44.845252  9006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39119 every 8 connection(s)
I20260709 13:01:44.859011  9007 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37117
I20260709 13:01:44.859472  9007 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:44.860176  9007 heartbeater.cc:507] Master 127.0.107.254:37117 requested a full tablet report, sending...
I20260709 13:01:44.862170  8731 ts_manager.cc:194] Registered new tserver with Master: bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:44.863233   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014830822s
I20260709 13:01:44.863626  8731 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44404
I20260709 13:01:44.888548  8731 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44416:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:44.891453  8731 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:44.973066  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 89fe05a0abfa4fe790a9cf3b03d585ef (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:44.974709  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fe05a0abfa4fe790a9cf3b03d585ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.974565  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 97dea55ce4d64673ab3c444893512df8 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:44.976965  8822 tablet_service.cc:1511] Processing CreateTablet for tablet fe30e616ad234d7c81761f5ba6dbff77 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:44.979104  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dea55ce4d64673ab3c444893512df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.980366  8820 tablet_service.cc:1511] Processing CreateTablet for tablet 94a1342d8af24db9b874db1fa29de8cc (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:44.981837  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a1342d8af24db9b874db1fa29de8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.982200  8897 tablet_service.cc:1511] Processing CreateTablet for tablet fe30e616ad234d7c81761f5ba6dbff77 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:44.983558  8897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe30e616ad234d7c81761f5ba6dbff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.986953  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe30e616ad234d7c81761f5ba6dbff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.980417  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 97dea55ce4d64673ab3c444893512df8 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:44.989771  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dea55ce4d64673ab3c444893512df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.998411  8896 tablet_service.cc:1511] Processing CreateTablet for tablet 89fe05a0abfa4fe790a9cf3b03d585ef (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:44.998994  9022 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.000046  8896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fe05a0abfa4fe790a9cf3b03d585ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.004575  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 94a1342d8af24db9b874db1fa29de8cc (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:45.006572  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a1342d8af24db9b874db1fa29de8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.013350  8971 tablet_service.cc:1511] Processing CreateTablet for tablet fe30e616ad234d7c81761f5ba6dbff77 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:45.014858  8971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe30e616ad234d7c81761f5ba6dbff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.017443  8970 tablet_service.cc:1511] Processing CreateTablet for tablet 89fe05a0abfa4fe790a9cf3b03d585ef (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:45.018931  8970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fe05a0abfa4fe790a9cf3b03d585ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.021489  8969 tablet_service.cc:1511] Processing CreateTablet for tablet 94a1342d8af24db9b874db1fa29de8cc (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:45.022921  8969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a1342d8af24db9b874db1fa29de8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.025441  8972 tablet_service.cc:1511] Processing CreateTablet for tablet 97dea55ce4d64673ab3c444893512df8 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:45.026825  8972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dea55ce4d64673ab3c444893512df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.029074  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb178909bc34607ba17336054e7ea4e (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:45.029937  8894 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb178909bc34607ba17336054e7ea4e (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:45.030953  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb178909bc34607ba17336054e7ea4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.031730  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb178909bc34607ba17336054e7ea4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.046119  8968 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb178909bc34607ba17336054e7ea4e (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:45.051664  8893 tablet_service.cc:1511] Processing CreateTablet for tablet 861b3369a2574b41ae6e1ea94403dbad (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:45.053298  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 861b3369a2574b41ae6e1ea94403dbad (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:45.054632  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861b3369a2574b41ae6e1ea94403dbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.056607  8967 tablet_service.cc:1511] Processing CreateTablet for tablet 861b3369a2574b41ae6e1ea94403dbad (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:45.048137  8968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb178909bc34607ba17336054e7ea4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.060933  8967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861b3369a2574b41ae6e1ea94403dbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.061368  9022 tablet_bootstrap.cc:654] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.059064  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861b3369a2574b41ae6e1ea94403dbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.083472  8822 tablet_service.cc:1511] Processing CreateTablet for tablet c3e3eee6c492457187e240cc57dce6e8 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:45.084950  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e3eee6c492457187e240cc57dce6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.085175  8892 tablet_service.cc:1511] Processing CreateTablet for tablet c3e3eee6c492457187e240cc57dce6e8 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:45.086552  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e3eee6c492457187e240cc57dce6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.107093  9025 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.116755  9025 tablet_bootstrap.cc:654] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.132789  9023 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.132596  8970 tablet_service.cc:1511] Processing CreateTablet for tablet c3e3eee6c492457187e240cc57dce6e8 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:45.134114  8970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e3eee6c492457187e240cc57dce6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.137451  9025 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.141491  9025 ts_tablet_manager.cc:1403] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.016s
I20260709 13:01:45.144412  9022 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.144989  9022 ts_tablet_manager.cc:1403] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.028s
I20260709 13:01:45.139305  9023 tablet_bootstrap.cc:654] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.139420  8822 tablet_service.cc:1511] Processing CreateTablet for tablet ee77506a8bc845f3829c1549e2b7c984 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:45.140565  8898 tablet_service.cc:1511] Processing CreateTablet for tablet ee77506a8bc845f3829c1549e2b7c984 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:45.150929  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee77506a8bc845f3829c1549e2b7c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.151551  9025 raft_consensus.cc:359] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.152345  9025 raft_consensus.cc:385] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.152657  9025 raft_consensus.cc:740] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.154798  9025 consensus_queue.cc:260] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.155795  9022 raft_consensus.cc:359] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.156934  9022 raft_consensus.cc:385] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.157225  9022 raft_consensus.cc:740] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.157984  9022 consensus_queue.cc:260] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.158123  8971 tablet_service.cc:1511] Processing CreateTablet for tablet ee77506a8bc845f3829c1549e2b7c984 (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:45.159646  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee77506a8bc845f3829c1549e2b7c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.160907  8971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee77506a8bc845f3829c1549e2b7c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.171438  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 3c723c20b89740e6a1ec29679c07dd8e (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:45.174104  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c723c20b89740e6a1ec29679c07dd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.173921  8893 tablet_service.cc:1511] Processing CreateTablet for tablet 3c723c20b89740e6a1ec29679c07dd8e (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:45.174889  8970 tablet_service.cc:1511] Processing CreateTablet for tablet 3c723c20b89740e6a1ec29679c07dd8e (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:45.175303  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c723c20b89740e6a1ec29679c07dd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.176187  8970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c723c20b89740e6a1ec29679c07dd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.177515  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0655615cfb4b4b84692490158191dc (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:45.178786  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0655615cfb4b4b84692490158191dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.183701  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0655615cfb4b4b84692490158191dc (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:45.185078  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0655615cfb4b4b84692490158191dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.192492  9023 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.193102  9023 ts_tablet_manager.cc:1403] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.000s
I20260709 13:01:45.199718  8967 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0655615cfb4b4b84692490158191dc (DEFAULT_TABLE table=test-workload [id=76ef0226fe9642639c568c672b278238]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:45.196123  9023 raft_consensus.cc:359] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.201014  9023 raft_consensus.cc:385] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.201236  8967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0655615cfb4b4b84692490158191dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.201320  9023 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.202234  9023 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.216272  9023 ts_tablet_manager.cc:1434] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:01:45.216177  9022 ts_tablet_manager.cc:1434] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.015s
I20260709 13:01:45.218847  8858 heartbeater.cc:499] Master 127.0.107.254:37117 was elected leader, sending a full tablet report...
I20260709 13:01:45.217963  8933 heartbeater.cc:499] Master 127.0.107.254:37117 was elected leader, sending a full tablet report...
I20260709 13:01:45.220768  9022 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.225108  9007 heartbeater.cc:499] Master 127.0.107.254:37117 was elected leader, sending a full tablet report...
I20260709 13:01:45.227473  9022 tablet_bootstrap.cc:654] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.231848  9025 ts_tablet_manager.cc:1434] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.090s	user 0.014s	sys 0.013s
I20260709 13:01:45.233048  9025 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.239718  9025 tablet_bootstrap.cc:654] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.233410  9023 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.252724  9023 tablet_bootstrap.cc:654] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:45.256457  8934 tablet.cc:2406] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:45.257040  9029 raft_consensus.cc:493] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.257651  9029 raft_consensus.cc:515] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.263790  9029 leader_election.cc:290] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.266480  9025 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.267063  9025 ts_tablet_manager.cc:1403] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.003s
I20260709 13:01:45.270174  9025 raft_consensus.cc:359] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.270752  9025 raft_consensus.cc:385] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.270810  9022 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.271015  9025 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.271515  9022 ts_tablet_manager.cc:1403] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.004s
I20260709 13:01:45.271965  9025 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.274717  9022 raft_consensus.cc:359] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.275382  9025 ts_tablet_manager.cc:1434] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:45.275540  9022 raft_consensus.cc:385] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.276090  9022 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.276971  9025 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.277486  9022 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.285061  9025 tablet_bootstrap.cc:654] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.286751  9022 ts_tablet_manager.cc:1434] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:01:45.289044  9022 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.290413  9023 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.291039  9023 ts_tablet_manager.cc:1403] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.014s
I20260709 13:01:45.292550  9028 raft_consensus.cc:493] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.293138  9028 raft_consensus.cc:515] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.295621  9022 tablet_bootstrap.cc:654] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.298277  9028 leader_election.cc:290] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.306835  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.307957  8982 raft_consensus.cc:2468] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.309635  8796 leader_election.cc:304] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.311041  9029 raft_consensus.cc:2804] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.311425  9029 raft_consensus.cc:493] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.311757  9029 raft_consensus.cc:3060] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.312877  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.320534  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.321336  8833 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
W20260709 13:01:45.322057  8796 leader_election.cc:343] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.323028  9023 raft_consensus.cc:359] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.323849  9023 raft_consensus.cc:385] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.323808  8947 leader_election.cc:304] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.324433  9023 raft_consensus.cc:740] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.325039  9028 raft_consensus.cc:2804] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.325428  9028 raft_consensus.cc:493] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.326081  9028 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.325829  9029 raft_consensus.cc:515] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.325325  9023 consensus_queue.cc:260] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.330263  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:45.330421  9023 ts_tablet_manager.cc:1434] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.008s
I20260709 13:01:45.330894  8982 raft_consensus.cc:3060] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.331871  9023 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.335813  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.338944  8982 raft_consensus.cc:2468] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:45.340209  8796 leader_election.cc:304] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.341738  9029 leader_election.cc:290] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.343820  9029 raft_consensus.cc:2804] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.345026  9029 raft_consensus.cc:697] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Running, Role: LEADER
I20260709 13:01:45.346128  9029 consensus_queue.cc:237] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.347690  9028 raft_consensus.cc:515] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.344559  9023 tablet_bootstrap.cc:654] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.350658  9025 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.350924  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:45.351447  9025 ts_tablet_manager.cc:1403] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.015s
I20260709 13:01:45.351677  8833 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.356042  9025 raft_consensus.cc:359] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.357976  9025 raft_consensus.cc:385] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.358563  9025 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.359447  9028 leader_election.cc:290] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.359337  9025 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
W20260709 13:01:45.362165  8796 leader_election.cc:343] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.362547  9025 ts_tablet_manager.cc:1434] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.006s
I20260709 13:01:45.363696  9025 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.365470  8833 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.366199  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.366920  8907 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.366835  8947 leader_election.cc:304] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.365310  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.375955  9022 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.376588  9022 ts_tablet_manager.cc:1403] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.026s
I20260709 13:01:45.379768  9022 raft_consensus.cc:359] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.380523  9022 raft_consensus.cc:385] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.381429  9022 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.385743  9023 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.386351  9023 ts_tablet_manager.cc:1403] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.007s
I20260709 13:01:45.387122  8907 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.381899  9028 raft_consensus.cc:2804] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.388170  9028 raft_consensus.cc:697] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:45.389446  9023 raft_consensus.cc:359] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.390100  9023 raft_consensus.cc:385] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.390370  9023 raft_consensus.cc:740] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.391059  9023 consensus_queue.cc:260] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.389334  9028 consensus_queue.cc:237] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.391891  9022 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.396049  9025 tablet_bootstrap.cc:654] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.397660  9022 ts_tablet_manager.cc:1434] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:01:45.398885  9022 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.400039  9023 ts_tablet_manager.cc:1434] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:01:45.401332  9023 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.408138  9023 tablet_bootstrap.cc:654] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.408186  8728 catalog_manager.cc:5697] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc088022ef345edaf52dab445137eb1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5bc088022ef345edaf52dab445137eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.422840  9022 tablet_bootstrap.cc:654] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.440788  9025 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.441561  9025 ts_tablet_manager.cc:1403] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.004s
I20260709 13:01:45.445765  9025 raft_consensus.cc:359] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.446842  9025 raft_consensus.cc:385] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.447228  9025 raft_consensus.cc:740] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.451360  9023 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.451968  9023 ts_tablet_manager.cc:1403] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.022s
I20260709 13:01:45.453204  9025 consensus_queue.cc:260] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.454958  9023 raft_consensus.cc:359] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.455610  9023 raft_consensus.cc:385] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.455885  9023 raft_consensus.cc:740] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.456058  9025 ts_tablet_manager.cc:1434] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:01:45.455134  8730 catalog_manager.cc:5697] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 0 to 1, leader changed from <none> to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.456698  9023 consensus_queue.cc:260] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.457283  9025 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.458235  9022 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.458813  9022 ts_tablet_manager.cc:1403] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.011s
I20260709 13:01:45.459414  9023 ts_tablet_manager.cc:1434] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:45.460494  9023 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.462244  9022 raft_consensus.cc:359] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.463086  9022 raft_consensus.cc:385] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.463435  9022 raft_consensus.cc:740] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.464305  9022 consensus_queue.cc:260] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.465073  9025 tablet_bootstrap.cc:654] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.466748  9022 ts_tablet_manager.cc:1434] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:45.467483  9023 tablet_bootstrap.cc:654] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.467891  9022 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
W20260709 13:01:45.469686  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:45.477787  9022 tablet_bootstrap.cc:654] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.486063  9023 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.486547  9023 ts_tablet_manager.cc:1403] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 13:01:45.487888  9028 raft_consensus.cc:493] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.488502  9028 raft_consensus.cc:515] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.489266  9023 raft_consensus.cc:359] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.490064  9023 raft_consensus.cc:385] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.490388  9022 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.490387  9023 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.491030  9028 leader_election.cc:290] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557)
I20260709 13:01:45.491212  9022 ts_tablet_manager.cc:1403] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.002s
I20260709 13:01:45.491411  9023 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.492296  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.492635  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.492976  8907 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
I20260709 13:01:45.493321  8833 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
I20260709 13:01:45.494616  9023 ts_tablet_manager.cc:1434] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:45.494717  8947 leader_election.cc:304] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.495729  9028 raft_consensus.cc:2804] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.495800  9023 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.496327  9028 raft_consensus.cc:493] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.496769  9028 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.501590  9025 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.502177  9025 ts_tablet_manager.cc:1403] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.001s
I20260709 13:01:45.503103  9023 tablet_bootstrap.cc:654] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.505157  9025 raft_consensus.cc:359] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.505914  9025 raft_consensus.cc:385] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.506218  9025 raft_consensus.cc:740] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.508116  9028 raft_consensus.cc:515] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.507174  9025 consensus_queue.cc:260] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.512307  9025 ts_tablet_manager.cc:1434] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:01:45.513319  9025 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.513409  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.514276  8907 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.510301  9022 raft_consensus.cc:359] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.516945  9022 raft_consensus.cc:385] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.517262  9022 raft_consensus.cc:740] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.518004  9022 consensus_queue.cc:260] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.520295  9022 ts_tablet_manager.cc:1434] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:01:45.522500  9022 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.524717  9025 tablet_bootstrap.cc:654] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.526970  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:45.527634  8833 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.529006  9022 tablet_bootstrap.cc:654] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.533965  9023 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.534479  9023 ts_tablet_manager.cc:1403] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.016s
I20260709 13:01:45.536479  8833 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.537628  9023 raft_consensus.cc:359] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.538456  9023 raft_consensus.cc:385] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.538795  9023 raft_consensus.cc:740] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.539089  8947 leader_election.cc:304] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.539537  9023 consensus_queue.cc:260] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.540359  9042 raft_consensus.cc:2804] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.542312  9023 ts_tablet_manager.cc:1434] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:45.542522  9025 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.542958  9025 ts_tablet_manager.cc:1403] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.013s
I20260709 13:01:45.543471  9023 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.545825  9025 raft_consensus.cc:359] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.546545  9025 raft_consensus.cc:385] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.546855  9025 raft_consensus.cc:740] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.547530  9025 consensus_queue.cc:260] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.554245  9029 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.555003  9029 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.559288  9029 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.560262  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.561184  9023 tablet_bootstrap.cc:654] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.561165  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.562325  8908 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.561329  8982 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.564615  8796 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:45.566442  9029 raft_consensus.cc:2804] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.566948  9029 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.567373  9029 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.538480  9028 leader_election.cc:290] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557)
I20260709 13:01:45.572311  9028 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.572981  9028 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.537529  8907 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.577879  9029 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.581881  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.582723  8907 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.583449  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:45.584338  8982 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.585733  9042 raft_consensus.cc:697] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:45.587515  9029 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.592139  8982 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:45.593986  8796 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.594229  9028 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.595135  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.595777  9029 raft_consensus.cc:2804] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.597360  9029 raft_consensus.cc:697] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Running, Role: LEADER
I20260709 13:01:45.598302  9029 consensus_queue.cc:237] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.586875  9042 consensus_queue.cc:237] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.604965  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.609053  9028 raft_consensus.cc:493] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.609772  9028 raft_consensus.cc:515] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.613137  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
W20260709 13:01:45.614702  8947 leader_election.cc:343] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.616830  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
W20260709 13:01:45.618402  8945 leader_election.cc:343] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.618825  8945 leader_election.cc:304] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:45.619714  9055 raft_consensus.cc:2749] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.621997  8907 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:45.628539  9022 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.629207  9022 ts_tablet_manager.cc:1403] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.107s	user 0.032s	sys 0.017s
I20260709 13:01:45.632651  8947 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:45.634450  9022 raft_consensus.cc:359] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.635373  9022 raft_consensus.cc:385] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.635753  9022 raft_consensus.cc:740] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.636659  9022 consensus_queue.cc:260] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.629873  8728 catalog_manager.cc:5697] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc088022ef345edaf52dab445137eb1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5bc088022ef345edaf52dab445137eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.638969  9022 ts_tablet_manager.cc:1434] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:01:45.640022  9022 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.646510  9022 tablet_bootstrap.cc:654] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.635006  8729 catalog_manager.cc:5697] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 0 to 1, leader changed from <none> to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.621068  9028 leader_election.cc:290] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.675715  9028 raft_consensus.cc:2749] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.677676  9022 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.678308  9022 ts_tablet_manager.cc:1403] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.010s
I20260709 13:01:45.678442  9025 ts_tablet_manager.cc:1434] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.135s	user 0.051s	sys 0.081s
I20260709 13:01:45.679669  9025 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.681941  9023 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.681849  9022 raft_consensus.cc:359] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.682587  9023 ts_tablet_manager.cc:1403] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.139s	user 0.026s	sys 0.060s
I20260709 13:01:45.682906  9022 raft_consensus.cc:385] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.683408  9022 raft_consensus.cc:740] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.684438  9022 consensus_queue.cc:260] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.685881  9023 raft_consensus.cc:359] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.686650  9023 raft_consensus.cc:385] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.686901  9025 tablet_bootstrap.cc:654] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.687261  9022 ts_tablet_manager.cc:1434] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:01:45.686962  9023 raft_consensus.cc:740] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.689134  9023 consensus_queue.cc:260] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.689939  9022 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.691995  9023 ts_tablet_manager.cc:1434] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.002s
I20260709 13:01:45.693434  9023 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.697453  9022 tablet_bootstrap.cc:654] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.698441  9025 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.698998  9025 ts_tablet_manager.cc:1403] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:01:45.700253  9023 tablet_bootstrap.cc:654] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.703289  9025 raft_consensus.cc:359] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.704355  9025 raft_consensus.cc:385] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.704748  9025 raft_consensus.cc:740] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.706033  9025 consensus_queue.cc:260] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.709124  9025 ts_tablet_manager.cc:1434] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:01:45.709687  9022 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.710273  9022 ts_tablet_manager.cc:1403] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:01:45.710450  9025 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.713320  9022 raft_consensus.cc:359] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.714174  9022 raft_consensus.cc:385] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.714517  9022 raft_consensus.cc:740] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.714912  9030 raft_consensus.cc:493] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.715430  9022 consensus_queue.cc:260] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.715535  9030 raft_consensus.cc:515] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.718068  9025 tablet_bootstrap.cc:654] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.719988  9022 ts_tablet_manager.cc:1434] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:45.721081  9022 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.726785  9022 tablet_bootstrap.cc:654] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.729676  9030 leader_election.cc:290] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.714910  9023 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.738232  9023 ts_tablet_manager.cc:1403] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.008s
I20260709 13:01:45.744096  9025 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.744849  9025 ts_tablet_manager.cc:1403] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.016s
I20260709 13:01:45.746341  9022 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.746884  9022 ts_tablet_manager.cc:1403] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:01:45.747615  9025 raft_consensus.cc:359] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.748353  9025 raft_consensus.cc:385] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.748638  9025 raft_consensus.cc:740] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.749368  9025 consensus_queue.cc:260] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.751093  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.749859  9022 raft_consensus.cc:359] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.751871  8982 raft_consensus.cc:2393] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 837a11cf78ec455ca7738792bab5df0c in current term 1: Already voted for candidate 5bc088022ef345edaf52dab445137eb1 in this term.
I20260709 13:01:45.751720  9025 ts_tablet_manager.cc:1434] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:01:45.753100  9025 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.753474  9023 raft_consensus.cc:359] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.752092  9022 raft_consensus.cc:385] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.754174  9023 raft_consensus.cc:385] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.754302  9022 raft_consensus.cc:740] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.754535  9023 raft_consensus.cc:740] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.755461  9022 consensus_queue.cc:260] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.756345  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.758062  8873 leader_election.cc:304] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c; no voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:45.759290  9023 consensus_queue.cc:260] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.760910  9025 tablet_bootstrap.cc:654] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.765959  9022 ts_tablet_manager.cc:1434] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:01:45.769480  9023 ts_tablet_manager.cc:1434] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.006s
I20260709 13:01:45.770526  9023 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.774623  9022 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:45.775429  9030 raft_consensus.cc:493] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.767760  9068 raft_consensus.cc:3060] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.776021  9030 raft_consensus.cc:515] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.776190  9023 tablet_bootstrap.cc:654] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.779029  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.785015  8833 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 0.
I20260709 13:01:45.785279  9022 tablet_bootstrap.cc:654] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.786278  8873 leader_election.cc:304] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:45.779397  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.787942  8982 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 0.
I20260709 13:01:45.778302  9030 leader_election.cc:290] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.792863  9030 raft_consensus.cc:2804] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.793187  9030 raft_consensus.cc:493] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.793488  9030 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.800853  9068 raft_consensus.cc:2749] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.802975  9022 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: No bootstrap required, opened a new log
I20260709 13:01:45.803521  9022 ts_tablet_manager.cc:1403] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.003s
I20260709 13:01:45.803681  9023 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.804183  9023 ts_tablet_manager.cc:1403] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:01:45.804705  9030 raft_consensus.cc:515] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.806404  9025 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.806447  9022 raft_consensus.cc:359] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.806983  9025 ts_tablet_manager.cc:1403] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.019s
I20260709 13:01:45.807344  9022 raft_consensus.cc:385] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.806921  9023 raft_consensus.cc:359] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.807740  9022 raft_consensus.cc:740] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.807933  9023 raft_consensus.cc:385] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.808149  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:45.808413  9023 raft_consensus.cc:740] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.808859  8982 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.808679  9022 consensus_queue.cc:260] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.809193  9023 consensus_queue.cc:260] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.810825  9022 ts_tablet_manager.cc:1434] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:45.810531  9025 raft_consensus.cc:359] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.811358  9025 raft_consensus.cc:385] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.811719  9025 raft_consensus.cc:740] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.812667  9025 consensus_queue.cc:260] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.816254  9023 ts_tablet_manager.cc:1434] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:45.817314  9023 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: Bootstrap starting.
I20260709 13:01:45.818070  8982 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 1.
I20260709 13:01:45.819548  8871 leader_election.cc:304] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.820089  9025 ts_tablet_manager.cc:1434] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:45.821010  9068 raft_consensus.cc:2804] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.821296  9025 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d: Bootstrap starting.
I20260709 13:01:45.821584  9068 raft_consensus.cc:697] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:45.823006  9023 tablet_bootstrap.cc:654] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.822603  9068 consensus_queue.cc:237] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.828058  9029 raft_consensus.cc:493] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.828766  9025 tablet_bootstrap.cc:654] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.828644  9029 raft_consensus.cc:515] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.830749  9029 leader_election.cc:290] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.832667  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.833355  8907 raft_consensus.cc:2468] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.834491  9070 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.834620  8796 leader_election.cc:304] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:45.835141  9023 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: No bootstrap required, opened a new log
I20260709 13:01:45.835041  9070 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.835673  9040 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.835834  9023 ts_tablet_manager.cc:1403] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 13:01:45.836252  9040 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.837795  9070 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.838449  9040 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.839016  9030 leader_election.cc:290] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.839910  9028 raft_consensus.cc:493] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.839583  9023 raft_consensus.cc:359] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.839020  9040 raft_consensus.cc:2804] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.840425  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.840425  9028 raft_consensus.cc:515] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.841285  8907 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.842099  8981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.842547  8796 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:45.842792  8981 raft_consensus.cc:2468] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.843451  9029 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.843834  9029 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.844028  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.842574  9028 leader_election.cc:290] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.840484  9023 raft_consensus.cc:385] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.844769  8980 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.845079  9023 raft_consensus.cc:740] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.845541  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.846221  8907 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
I20260709 13:01:45.846488  9040 raft_consensus.cc:493] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.844168  9029 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.846912  9040 raft_consensus.cc:3060] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.848387  9028 raft_consensus.cc:493] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.848675  8945 leader_election.cc:304] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.848948  9028 raft_consensus.cc:515] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.849691  9056 raft_consensus.cc:2804] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.850093  9056 raft_consensus.cc:493] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.850425  9056 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.851897  8728 catalog_manager.cc:5697] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.853158  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:45.853158  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.853950  8833 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.854072  8830 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
I20260709 13:01:45.855451  8947 leader_election.cc:304] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.856307  9042 raft_consensus.cc:2804] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.856639  9042 raft_consensus.cc:493] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.856956  9042 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.857474  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.858167  8982 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 0.
I20260709 13:01:45.858574  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.859277  8831 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
I20260709 13:01:45.860472  9023 consensus_queue.cc:260] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.860846  9040 raft_consensus.cc:515] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.856890  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1" is_pre_election: true
I20260709 13:01:45.861572  8871 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.862721  9068 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.862836  9023 ts_tablet_manager.cc:1434] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:01:45.863164  9068 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.863554  9068 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.864920  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.867583  8907 raft_consensus.cc:3060] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.872362  9042 raft_consensus.cc:515] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.873414  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.878921  8908 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 0.
I20260709 13:01:45.871982  8833 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 1.
I20260709 13:01:45.881487  9029 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.882432  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:45.882798  8832 raft_consensus.cc:2393] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 837a11cf78ec455ca7738792bab5df0c in current term 1: Already voted for candidate 5bc088022ef345edaf52dab445137eb1 in this term.
I20260709 13:01:45.882824  9042 leader_election.cc:290] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.883076  8833 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.884591  9029 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.885833  9025 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d: No bootstrap required, opened a new log
I20260709 13:01:45.876770  9040 leader_election.cc:290] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.886291  9025 ts_tablet_manager.cc:1403] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 13:01:45.886375  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:45.886780  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.886988  8980 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.887440  8906 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.889240  9025 raft_consensus.cc:359] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.889936  9025 raft_consensus.cc:385] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.890187  9025 raft_consensus.cc:740] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.890892  9025 consensus_queue.cc:260] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.891192  8833 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.893472  9025 ts_tablet_manager.cc:1434] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:45.895382  8947 leader_election.cc:304] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.878075  9056 raft_consensus.cc:515] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.896440  9055 raft_consensus.cc:2804] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.896948  9055 raft_consensus.cc:697] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:45.877342  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:45.874878  8907 raft_consensus.cc:2468] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:45.885603  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.898159  8982 raft_consensus.cc:3060] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.898959  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:45.877810  9028 leader_election.cc:290] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.899260  8796 leader_election.cc:304] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:45.899621  8832 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.899794  8980 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:45.901074  8796 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.901897  9040 raft_consensus.cc:2804] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.902721  9029 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.897760  9055 consensus_queue.cc:237] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.906237  9056 leader_election.cc:290] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:45.907280  8982 raft_consensus.cc:2468] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:45.908247  9056 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.909302  9040 raft_consensus.cc:697] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Running, Role: LEADER
I20260709 13:01:45.910351  9040 consensus_queue.cc:237] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.914688  8832 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.916323  8947 leader_election.cc:304] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:45.876365  9068 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.917992  8908 raft_consensus.cc:2393] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc088022ef345edaf52dab445137eb1 in current term 1: Already voted for candidate 837a11cf78ec455ca7738792bab5df0c in this term.
I20260709 13:01:45.922302  9068 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.923184  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:45.924394  8982 raft_consensus.cc:2393] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 837a11cf78ec455ca7738792bab5df0c in current term 1: Already voted for candidate 5bc088022ef345edaf52dab445137eb1 in this term.
I20260709 13:01:45.924489  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:45.926353  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:45.927086  8908 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.932497  9056 raft_consensus.cc:2804] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.933534  9056 raft_consensus.cc:697] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:45.934623  9056 consensus_queue.cc:237] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.895455  8906 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.938391  9076 consensus_queue.cc:1048] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.948333  9029 raft_consensus.cc:697] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Running, Role: LEADER
I20260709 13:01:45.950323  9029 consensus_queue.cc:237] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.954912  9076 consensus_queue.cc:1048] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.956564  8729 catalog_manager.cc:5697] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 0 to 1, leader changed from <none> to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.959625  8908 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
I20260709 13:01:45.964883  9077 raft_consensus.cc:493] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.965577  9077 raft_consensus.cc:515] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:45.983395  8730 catalog_manager.cc:5697] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc088022ef345edaf52dab445137eb1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5bc088022ef345edaf52dab445137eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.984965  8873 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c; no voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:45.985879  9068 raft_consensus.cc:2749] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.988590  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0655615cfb4b4b84692490158191dc" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:45.990255  8908 raft_consensus.cc:2468] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.987370  9077 leader_election.cc:290] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:45.992995  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0655615cfb4b4b84692490158191dc" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:45.993749  8982 raft_consensus.cc:2468] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 0.
I20260709 13:01:45.992298  9055 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:46.012395  9042 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.015223  8796 leader_election.cc:304] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:46.023226  8729 catalog_manager.cc:5697] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 0 to 1, leader changed from <none> to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.030228  9077 raft_consensus.cc:2804] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.039042  9077 raft_consensus.cc:493] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.039417  9077 raft_consensus.cc:3060] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.045018  8730 catalog_manager.cc:5697] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc088022ef345edaf52dab445137eb1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5bc088022ef345edaf52dab445137eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.050493  9056 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.052517  9085 consensus_queue.cc:1048] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.061259  9077 raft_consensus.cc:515] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:46.062474  9029 consensus_queue.cc:1048] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.063619  9077 leader_election.cc:290] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:46.065320  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0655615cfb4b4b84692490158191dc" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:46.065584  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0655615cfb4b4b84692490158191dc" candidate_uuid: "5bc088022ef345edaf52dab445137eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:46.066264  8982 raft_consensus.cc:3060] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.072470  8907 raft_consensus.cc:3060] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.078686  8982 raft_consensus.cc:2468] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:46.079985  8796 leader_election.cc:304] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:46.083526  8907 raft_consensus.cc:2468] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc088022ef345edaf52dab445137eb1 in term 1.
I20260709 13:01:46.084409  9077 raft_consensus.cc:2804] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.087342  9077 raft_consensus.cc:697] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Running, Role: LEADER
I20260709 13:01:46.088136  9077 consensus_queue.cc:237] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:46.101706  8728 catalog_manager.cc:5697] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc088022ef345edaf52dab445137eb1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5bc088022ef345edaf52dab445137eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.291608  9077 consensus_queue.cc:1048] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.303098  9085 consensus_queue.cc:1048] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.304042  9068 consensus_queue.cc:1048] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.313323  9068 consensus_queue.cc:1048] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.353634   431 ts_manager.cc:295] Set tserver state for 5bc088022ef345edaf52dab445137eb1 to MAINTENANCE_MODE
I20260709 13:01:46.355014   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:01:46.377260  9054 consensus_queue.cc:1048] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.379273  9085 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:46.383530  8947 consensus_peers.cc:597] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.402560  8947 consensus_peers.cc:597] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.403472  9076 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.405682   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:46.408412   431 tablet_replica.cc:333] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.408254  9054 consensus_queue.cc:1048] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.416260   431 raft_consensus.cc:2243] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.416972   431 raft_consensus.cc:2272] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:46.419214  8947 consensus_peers.cc:597] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.420871   431 tablet_replica.cc:333] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.422168   431 raft_consensus.cc:2243] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.423283   431 raft_consensus.cc:2272] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.426208   431 tablet_replica.cc:333] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.427085   431 raft_consensus.cc:2243] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.427629   431 raft_consensus.cc:2272] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.430521   431 tablet_replica.cc:333] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.431149   431 raft_consensus.cc:2243] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.431682   431 raft_consensus.cc:2272] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.434846   431 tablet_replica.cc:333] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.435459   431 raft_consensus.cc:2243] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.436199   431 pending_rounds.cc:70] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Trying to abort 1 pending ops.
I20260709 13:01:46.436468   431 pending_rounds.cc:77] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634226545799168 op_type: NO_OP noop_request { }
I20260709 13:01:46.436915   431 raft_consensus.cc:2889] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:46.437260   431 raft_consensus.cc:2272] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.439874   431 tablet_replica.cc:333] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.440443   431 raft_consensus.cc:2243] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.440775   431 raft_consensus.cc:2272] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.442358   431 tablet_replica.cc:333] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.442808   431 raft_consensus.cc:2243] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:46.443150   431 raft_consensus.cc:2272] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.445294   431 tablet_replica.cc:333] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.445768   431 raft_consensus.cc:2243] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.446496   431 raft_consensus.cc:2272] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.448551   431 tablet_replica.cc:333] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.449009   431 raft_consensus.cc:2243] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.449702   431 raft_consensus.cc:2272] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:46.451859   431 tablet_replica.cc:333] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: stopping tablet replica
I20260709 13:01:46.452554   431 raft_consensus.cc:2243] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:46.453390   431 raft_consensus.cc:2272] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:46.471239  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:46.484958   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:46.495266  8947 consensus_peers.cc:597] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:46.938499  8873 consensus_peers.cc:597] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:47.472383  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:47.495373  9028 raft_consensus.cc:493] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.496003  9028 raft_consensus.cc:515] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.498131  9028 leader_election.cc:290] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:47.499289  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
W20260709 13:01:47.502054  8947 leader_election.cc:336] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.502391  8947 leader_election.cc:304] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:47.502941  9028 raft_consensus.cc:2749] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.515033  9111 raft_consensus.cc:493] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.515547  9111 raft_consensus.cc:515] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.517329  9111 leader_election.cc:290] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.518486  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:47.519224  8980 raft_consensus.cc:2468] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 1.
I20260709 13:01:47.520452  8871 leader_election.cc:304] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
W20260709 13:01:47.521123  8873 leader_election.cc:336] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.521277  9111 raft_consensus.cc:2804] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:47.521700  9111 raft_consensus.cc:493] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.522116  9111 raft_consensus.cc:3060] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.528245  9111 raft_consensus.cc:515] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.529955  9111 leader_election.cc:290] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.531101  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fe05a0abfa4fe790a9cf3b03d585ef" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:47.531764  8980 raft_consensus.cc:3060] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:47.533676  8873 leader_election.cc:336] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.537580  8980 raft_consensus.cc:2468] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:47.538678  8871 leader_election.cc:304] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1
I20260709 13:01:47.539379  9111 raft_consensus.cc:2804] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.539738  9111 raft_consensus.cc:697] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:47.540571  9111 consensus_queue.cc:237] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.547755  8729 catalog_manager.cc:5697] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from 5bc088022ef345edaf52dab445137eb1 (127.0.107.193) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.577257  9028 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.577776  9028 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.579557  9028 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:47.580720  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
W20260709 13:01:47.583019  8947 leader_election.cc:336] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.583423  8947 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:47.584062  9028 raft_consensus.cc:2749] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.603363  9111 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.603945  9111 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.605948  9111 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.607231  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:47.607967  8980 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 1.
I20260709 13:01:47.609091  8871 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
W20260709 13:01:47.609710  8873 leader_election.cc:336] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.609764  9111 raft_consensus.cc:2804] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:47.610234  9111 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.610507  9111 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.615506  9111 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.617380  9111 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.618497  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:47.619174  8980 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:47.621362  8873 leader_election.cc:336] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.624955  8980 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:47.626037  8871 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1
I20260709 13:01:47.626660  9111 raft_consensus.cc:2804] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.627113  9111 raft_consensus.cc:697] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:47.627914  9111 consensus_queue.cc:237] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.635562  8729 catalog_manager.cc:5697] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from 5bc088022ef345edaf52dab445137eb1 (127.0.107.193) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.653494  9111 raft_consensus.cc:493] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.654095  9111 raft_consensus.cc:515] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.655921  9111 leader_election.cc:290] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.657088  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0655615cfb4b4b84692490158191dc" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:47.657837  8980 raft_consensus.cc:2468] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 1.
I20260709 13:01:47.658915  8871 leader_election.cc:304] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:47.659727  9111 raft_consensus.cc:2804] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:47.660104  9111 raft_consensus.cc:493] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:47.660171  8873 leader_election.cc:336] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.660492  9111 raft_consensus.cc:3060] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.665582  9111 raft_consensus.cc:515] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.667678  9111 leader_election.cc:290] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.668979  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0655615cfb4b4b84692490158191dc" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:47.669656  8980 raft_consensus.cc:3060] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:47.671842  8873 leader_election.cc:336] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.675338  8980 raft_consensus.cc:2468] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:47.676594  8871 leader_election.cc:304] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1
I20260709 13:01:47.677292  9111 raft_consensus.cc:2804] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.677764  9111 raft_consensus.cc:697] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:47.678543  9111 consensus_queue.cc:237] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.686578  8729 catalog_manager.cc:5697] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from 5bc088022ef345edaf52dab445137eb1 (127.0.107.193) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.801172  9111 raft_consensus.cc:493] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.801687  9111 raft_consensus.cc:515] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.803493  9111 leader_election.cc:290] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.804620  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
W20260709 13:01:47.804853  8873 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111) [suppressed 119 similar messages]
W20260709 13:01:47.807490  8873 leader_election.cc:336] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.807657  9028 raft_consensus.cc:493] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.807905  8873 leader_election.cc:304] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c; no voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:47.808269  9028 raft_consensus.cc:515] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.808667  9111 raft_consensus.cc:2749] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.810405  9028 leader_election.cc:290] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:47.812192  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
I20260709 13:01:47.812891  8908 raft_consensus.cc:2468] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 1.
W20260709 13:01:47.813901  8947 leader_election.cc:336] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.814505  8945 leader_election.cc:304] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1
I20260709 13:01:47.815305  9028 raft_consensus.cc:2804] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:47.815578  9028 raft_consensus.cc:493] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.815832  9028 raft_consensus.cc:3060] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.821089  9028 raft_consensus.cc:515] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.823010  9028 leader_election.cc:290] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:47.824316  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb178909bc34607ba17336054e7ea4e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:47.824877  8908 raft_consensus.cc:3060] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:47.826701  8947 leader_election.cc:336] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.830458  8908 raft_consensus.cc:2468] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 2.
I20260709 13:01:47.831811  8945 leader_election.cc:304] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1
I20260709 13:01:47.832521  9028 raft_consensus.cc:2804] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.832986  9028 raft_consensus.cc:697] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:47.833714  9028 consensus_queue.cc:237] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.840641  8729 catalog_manager.cc:5697] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 1 to 2, leader changed from 5bc088022ef345edaf52dab445137eb1 (127.0.107.193) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.893644  9028 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.894261  9028 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.896109  9028 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:47.897277  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837a11cf78ec455ca7738792bab5df0c" is_pre_election: true
W20260709 13:01:47.900039  8947 leader_election.cc:336] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.900516  8947 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:47.901139  9028 raft_consensus.cc:2749] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.908013  9111 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.908634  9111 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.910401  9111 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.911578  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" is_pre_election: true
I20260709 13:01:47.912334  8980 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 1.
I20260709 13:01:47.913421  8871 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:47.914211  9111 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:47.914314  8873 leader_election.cc:336] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.914544  9111 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc088022ef345edaf52dab445137eb1)
I20260709 13:01:47.914961  9111 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.920214  9111 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.921968  9111 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:47.923239  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:47.923916  8980 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:47.925706  8873 leader_election.cc:336] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111)
I20260709 13:01:47.929751  8980 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:47.930830  8871 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837a11cf78ec455ca7738792bab5df0c, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 5bc088022ef345edaf52dab445137eb1
I20260709 13:01:47.931684  9110 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.932164  9110 raft_consensus.cc:697] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:47.933000  9110 consensus_queue.cc:237] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:47.940189  8729 catalog_manager.cc:5697] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from 5bc088022ef345edaf52dab445137eb1 (127.0.107.193) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.954283  8980 raft_consensus.cc:1275] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:47.955524  9110 consensus_queue.cc:1048] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:47.970014  8873 consensus_peers.cc:597] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.028816  8980 raft_consensus.cc:1275] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.030129  9110 consensus_queue.cc:1048] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:48.042793  8873 consensus_peers.cc:597] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.159227  8873 consensus_peers.cc:597] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.231814  8980 raft_consensus.cc:1275] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:48.233196  9127 consensus_queue.cc:1048] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:48.340840  8873 consensus_peers.cc:597] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.349870  8908 raft_consensus.cc:1275] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.351135  9028 consensus_queue.cc:1048] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:48.366894  8947 consensus_peers.cc:597] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.376014  8980 raft_consensus.cc:1275] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.377715  9127 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:48.473340  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:48.879011  8947 consensus_peers.cc:597] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:48.914897  8947 consensus_peers.cc:597] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.013096  8947 consensus_peers.cc:597] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.116984  8947 consensus_peers.cc:597] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.448016  8873 consensus_peers.cc:597] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:49.474308  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:50.318321  8873 consensus_peers.cc:597] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:50.475425  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:01:50.542397  8873 consensus_peers.cc:597] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:50.652068  8873 consensus_peers.cc:597] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:50.763859  8873 consensus_peers.cc:597] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.014717  8947 consensus_peers.cc:597] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.328626  8947 consensus_peers.cc:597] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.404996  8947 consensus_peers.cc:597] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:51.476393  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:51.506706   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:51.512916  9137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:51.513808  9138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:51.514909  9140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:51.517256   431 server_base.cc:1061] running on GCE node
I20260709 13:01:51.518172   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:51.518428   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:51.518620   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602111518598 us; error 0 us; skew 500 ppm
I20260709 13:01:51.519164   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:51.521751   431 webserver.cc:533] Webserver started at http://127.0.107.193:37735/ using document root <none> and password file <none>
I20260709 13:01:51.522233   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:51.522392   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:01:51.526129   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:01:51.530141  9145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:51.530967   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:51.531289   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "5bc088022ef345edaf52dab445137eb1"
format_stamp: "Formatted at 2026-07-09 13:01:44 on dist-test-slave-vcr9"
I20260709 13:01:51.531594   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:51.541684   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:51.542920   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:51.544772   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:51.548637  9152 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:01:51.599506   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:01:51.599864   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.000s	sys 0.002s
I20260709 13:01:51.600108   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:01:51.605100  9152 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.619897  9152 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.620949  9152 tablet_bootstrap.cc:492] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.621558  9152 ts_tablet_manager.cc:1403] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:01:51.623659  9152 raft_consensus.cc:359] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.624274  9152 raft_consensus.cc:740] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.624897  9152 consensus_queue.cc:260] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.627056  9152 ts_tablet_manager.cc:1434] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:51.627807  9152 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.640990  9152 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.641943  9152 tablet_bootstrap.cc:492] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.642597  9152 ts_tablet_manager.cc:1403] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:01:51.644443   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:01:51.644785   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.045s	user 0.037s	sys 0.008s
I20260709 13:01:51.645000  9152 raft_consensus.cc:359] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.645646  9152 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.646370  9152 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.647897  9152 ts_tablet_manager.cc:1434] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:51.648664  9152 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.662674  9152 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.663582  9152 tablet_bootstrap.cc:492] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.664317  9152 ts_tablet_manager.cc:1403] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.011s
I20260709 13:01:51.667222  9152 raft_consensus.cc:359] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.668082  9152 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.668953  9152 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.670747  9152 ts_tablet_manager.cc:1434] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:01:51.671392  9152 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.683151  9152 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.684165  9152 tablet_bootstrap.cc:492] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.684860  9152 ts_tablet_manager.cc:1403] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:01:51.686672  9152 raft_consensus.cc:359] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.687187  9152 raft_consensus.cc:740] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.687920  9152 consensus_queue.cc:260] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.689654  9152 ts_tablet_manager.cc:1434] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:01:51.690315  9152 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.700881  9152 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:01:51.701645  9152 tablet_bootstrap.cc:492] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.702277  9152 ts_tablet_manager.cc:1403] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:01:51.704665  9152 raft_consensus.cc:359] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.705598  9152 raft_consensus.cc:740] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.706444  9152 consensus_queue.cc:260] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.708176  9152 ts_tablet_manager.cc:1434] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:51.709131  9152 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.712512   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35557
I20260709 13:01:51.712631  9214 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35557 every 8 connection(s)
I20260709 13:01:51.717190   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.735960  9152 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.737497  9152 tablet_bootstrap.cc:492] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.738240  9152 ts_tablet_manager.cc:1403] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 13:01:51.741263  9152 raft_consensus.cc:359] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.742224  9152 raft_consensus.cc:740] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.743125  9152 consensus_queue.cc:260] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.745050  9152 ts_tablet_manager.cc:1434] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:51.745757  9152 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.749706  8980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:51.750490  8980 raft_consensus.cc:606] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:51.752312  9215 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37117
I20260709 13:01:51.752701  9215 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:51.753607  9215 heartbeater.cc:507] Master 127.0.107.254:37117 requested a full tablet report, sending...
I20260709 13:01:51.753767  8980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:51.754379  8980 raft_consensus.cc:606] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:51.760985  8729 ts_manager.cc:194] Re-registered known tserver with Master: 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557)
I20260709 13:01:51.764474  9152 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.765843  9152 tablet_bootstrap.cc:492] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.766746  9152 ts_tablet_manager.cc:1403] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:01:51.769858  8729 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47618
I20260709 13:01:51.770126  9152 raft_consensus.cc:359] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.771170  9152 raft_consensus.cc:740] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.771924  9152 consensus_queue.cc:260] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.773751  9215 heartbeater.cc:499] Master 127.0.107.254:37117 was elected leader, sending a full tablet report...
I20260709 13:01:51.773994  9152 ts_tablet_manager.cc:1434] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:51.774773  9152 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.783419  8908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:51.784065  8908 raft_consensus.cc:606] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:51.785586   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:51.786111   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:51.786729  9152 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.786724   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.787595  9152 tablet_bootstrap.cc:492] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.788302  9152 ts_tablet_manager.cc:1403] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:01:51.790519  9152 raft_consensus.cc:359] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.791179  9152 raft_consensus.cc:740] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
W20260709 13:01:51.791355  8947 consensus_peers.cc:597] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:51.791899  9152 consensus_queue.cc:260] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.793780  9152 ts_tablet_manager.cc:1434] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:51.794447  9152 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.806008  9152 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.806802  9152 tablet_bootstrap.cc:492] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.807389  9152 ts_tablet_manager.cc:1403] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:01:51.809255  9152 raft_consensus.cc:359] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.809770  9152 raft_consensus.cc:740] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.810297  9152 consensus_queue.cc:260] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.811821  9152 ts_tablet_manager.cc:1434] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:51.812674  9152 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Bootstrap starting.
I20260709 13:01:51.824182  9152 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.824999  9152 tablet_bootstrap.cc:492] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Bootstrap complete.
I20260709 13:01:51.825546  9152 ts_tablet_manager.cc:1403] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:01:51.827315  9152 raft_consensus.cc:359] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.827816  9152 raft_consensus.cc:740] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc088022ef345edaf52dab445137eb1, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.828420  9152 consensus_queue.cc:260] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.830174  9152 ts_tablet_manager.cc:1434] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:51.876039  9189 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.910743  9135 raft_consensus.cc:993] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:51.911257  9231 raft_consensus.cc:1081] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:51.912811  8908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:51.913297  8908 raft_consensus.cc:493] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.913547  8908 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.918501  8908 raft_consensus.cc:515] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.920150  8908 leader_election.cc:290] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:51.921074  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:51.921255  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:51.921650  9189 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.921895  8980 raft_consensus.cc:3055] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.922246  8980 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:51.922988  8980 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.923962  8980 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.926870  9189 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:51.928089  8873 leader_election.cc:304] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:51.928871  9127 raft_consensus.cc:2804] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:51.929354  8980 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:51.930055  9127 raft_consensus.cc:697] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:51.930918  9127 consensus_queue.cc:237] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:51.938782  8729 catalog_manager.cc:5697] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.038980  9188 raft_consensus.cc:3060] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.072642  9135 raft_consensus.cc:993] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:52.073215  9231 raft_consensus.cc:1081] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:52.074720  8908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:52.075255  8908 raft_consensus.cc:493] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.075573  8908 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.080507  8908 raft_consensus.cc:515] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.082306  8908 leader_election.cc:290] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:52.083086  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:52.083364  8980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:52.083849  9188 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.083985  8980 raft_consensus.cc:3055] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.084456  8980 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:52.085233  8980 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.086225  8980 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.089263  9188 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:52.090420  8873 leader_election.cc:304] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:52.091212  9232 raft_consensus.cc:2804] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.091650  9232 raft_consensus.cc:697] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:52.091738  8980 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:52.092555  9232 consensus_queue.cc:237] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.100374  8729 catalog_manager.cc:5697] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.140590  9188 raft_consensus.cc:3060] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.196310  9188 raft_consensus.cc:3060] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.201802  9188 pending_rounds.cc:85] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Aborting all ops after (but not including) 0
I20260709 13:01:52.202024  9188 pending_rounds.cc:107] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:01:52.202294  9188 raft_consensus.cc:2889] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.264886  9188 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.406942  9242 raft_consensus.cc:993] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:52.408214  9127 raft_consensus.cc:1081] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:52.411290  8980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:52.412352  8980 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.412871  8980 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.424451  8980 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.427275  8980 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:52.428320  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:52.428848  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:52.429406  9188 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.429739  8908 raft_consensus.cc:3055] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.430222  8908 raft_consensus.cc:740] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:52.431610  8908 consensus_queue.cc:260] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.434422  8908 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.438966  9188 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:52.441267  8947 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:52.442611  9231 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:52.443182  9231 raft_consensus.cc:697] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:52.444288  8908 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:52.444761  9231 consensus_queue.cc:237] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.456516  9188 raft_consensus.cc:1275] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.458066  9127 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.462514  8729 catalog_manager.cc:5697] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 2 to 3, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:52.478530  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:52.486456  8980 raft_consensus.cc:1275] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.488431  9242 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.575532  8982 raft_consensus.cc:1275] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.577422  9242 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.593010  9188 raft_consensus.cc:1275] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.594542  9242 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.797638   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.805908  8982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:52.806543  8982 raft_consensus.cc:606] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:52.809528  8908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:52.810063  8908 raft_consensus.cc:606] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:52.812734  8908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:52.813256  8908 raft_consensus.cc:606] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:52.814512   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:52.815033   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:52.815755   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.827759  8908 raft_consensus.cc:1275] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.829221  9246 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.838733  9188 raft_consensus.cc:1275] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.840711  9247 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.894654  9135 raft_consensus.cc:993] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:52.895156  9247 raft_consensus.cc:1081] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:52.896710  8908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:52.897153  8908 raft_consensus.cc:493] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.897472  8908 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.904788  8908 raft_consensus.cc:515] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.907253  8908 leader_election.cc:290] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:52.908063  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:52.907660  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:52.908879  8982 raft_consensus.cc:3055] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.908955  9188 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.909194  8982 raft_consensus.cc:740] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:52.910089  8982 consensus_queue.cc:260] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.911175  8982 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.914886  9188 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:52.916116  8873 leader_election.cc:304] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:52.917054  9232 raft_consensus.cc:2804] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.917547  9232 raft_consensus.cc:697] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:52.918879  8982 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:52.918716  9232 consensus_queue.cc:237] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.926765  8729 catalog_manager.cc:5697] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.967605  9242 raft_consensus.cc:993] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:52.968175  9242 raft_consensus.cc:1081] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:52.969856  8982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:52.970382  8982 raft_consensus.cc:493] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.970709  8982 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.975963  8982 raft_consensus.cc:515] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.977854  8982 leader_election.cc:290] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:52.978582  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:52.979171  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:52.979347  9188 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.979866  8908 raft_consensus.cc:3055] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.980186  8908 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:52.980967  8908 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.981894  8908 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.984978  9188 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:52.986306  8947 leader_election.cc:304] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:52.987021  9247 raft_consensus.cc:2804] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:52.987217  8908 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:52.987538  9247 raft_consensus.cc:697] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:52.988721  9247 consensus_queue.cc:237] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:52.994977  8729 catalog_manager.cc:5697] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 2 to 3, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.041777  9232 raft_consensus.cc:993] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:53.042301  9242 raft_consensus.cc:1081] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:53.043990  8982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:53.044579  8982 raft_consensus.cc:493] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:53.044931  8982 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.051402  8982 raft_consensus.cc:515] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:53.053620  8982 leader_election.cc:290] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Requested vote from peers 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847), 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557)
I20260709 13:01:53.053954  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:53.054306  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:53.054684  8908 raft_consensus.cc:3055] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:53.055083  8908 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:53.055116  9188 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.056105  8908 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:53.057153  8908 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.060896  9188 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:53.061931  8908 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:53.062050  8947 leader_election.cc:304] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:53.062956  9247 raft_consensus.cc:2804] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.063462  9247 raft_consensus.cc:697] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:53.064482  9247 consensus_queue.cc:237] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:53.070824  8729 catalog_manager.cc:5697] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 2 to 3, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.368717  9188 raft_consensus.cc:1275] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.370008  9247 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.376813  8982 raft_consensus.cc:1275] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.381392  9242 consensus_queue.cc:1048] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:53.383373  8908 raft_consensus.cc:1275] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.384989  9231 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.403759  9188 raft_consensus.cc:1275] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.405196  9242 consensus_queue.cc:1048] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:53.479988  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:53.514212  8908 raft_consensus.cc:1275] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.515570  9135 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.524470  9188 raft_consensus.cc:1275] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.525893  9135 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.821971   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:53.828984  8908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:53.829531  8908 raft_consensus.cc:606] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:53.832036  8982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:53.832600  8982 raft_consensus.cc:606] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:53.835047  8982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:53.835534  8982 raft_consensus.cc:606] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:53.836539   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:53.837033   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:53.837766   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:53.894513  9242 raft_consensus.cc:993] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:53.895059  9232 raft_consensus.cc:1081] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:53.896755  8982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:53.897246  8982 raft_consensus.cc:493] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:53.897600  8982 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.903502  8982 raft_consensus.cc:515] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:53.905189  8982 leader_election.cc:290] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:53.906139  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:53.906462  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c723c20b89740e6a1ec29679c07dd8e" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:53.906951  9188 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.907084  8908 raft_consensus.cc:3055] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:53.907508  8908 raft_consensus.cc:740] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:53.908362  8908 consensus_queue.cc:260] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:53.909703  8908 raft_consensus.cc:3060] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.915167  9188 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:53.916847  8947 leader_election.cc:304] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:53.917603  8908 raft_consensus.cc:2468] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:53.917726  9135 raft_consensus.cc:2804] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.918322  9135 raft_consensus.cc:697] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:53.919431  9135 consensus_queue.cc:237] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:53.925896  8731 catalog_manager.cc:5697] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 2 to 3, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.022464  9231 raft_consensus.cc:993] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:54.023032  9135 raft_consensus.cc:1081] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:54.025038  8908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:54.025612  8908 raft_consensus.cc:493] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.025914  8908 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.031538  8908 raft_consensus.cc:515] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:54.033264  8908 leader_election.cc:290] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:54.034209  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:54.034502  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:54.034937  9188 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.035104  8982 raft_consensus.cc:3055] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.035532  8982 raft_consensus.cc:740] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:54.036350  8982 consensus_queue.cc:260] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:54.037401  8982 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.040647  9188 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:54.041913  8873 leader_election.cc:304] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:54.042670  9232 raft_consensus.cc:2804] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.042853  8982 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 2.
I20260709 13:01:54.043203  9232 raft_consensus.cc:697] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:54.044207  9232 consensus_queue.cc:237] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:54.051482  8731 catalog_manager.cc:5697] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 1 to 2, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.163622  9135 raft_consensus.cc:993] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:54.164147  9247 raft_consensus.cc:1081] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:54.165733  8907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:54.166245  8907 raft_consensus.cc:493] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.166553  8907 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.172812  8907 raft_consensus.cc:515] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:54.174515  8907 leader_election.cc:290] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 4 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:54.175532  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:54.175400  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1342d8af24db9b874db1fa29de8cc" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:54.176213  8982 raft_consensus.cc:3055] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.176288  9188 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.176779  8982 raft_consensus.cc:740] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:54.177623  8982 consensus_queue.cc:260] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:54.178874  8982 raft_consensus.cc:3060] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.183506  9188 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 4.
I20260709 13:01:54.184679  8873 leader_election.cc:304] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:54.185392  9232 raft_consensus.cc:2804] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.185523  8982 raft_consensus.cc:2468] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 4.
I20260709 13:01:54.185823  9232 raft_consensus.cc:697] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 4 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:54.186772  9232 consensus_queue.cc:237] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:54.193131  8731 catalog_manager.cc:5697] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 3 to 4, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 4 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.349778  8907 raft_consensus.cc:1275] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:54.351171  9247 consensus_queue.cc:1048] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:54.360791  9188 raft_consensus.cc:1275] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:54.362620  9247 consensus_queue.cc:1048] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:54.429178  8982 raft_consensus.cc:1275] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.430343  9232 consensus_queue.cc:1048] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.438647  9188 raft_consensus.cc:1275] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.440335  9276 consensus_queue.cc:1048] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:54.480926  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:54.593894  9188 raft_consensus.cc:1275] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:54.595289  9242 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:54.606328  8982 raft_consensus.cc:1275] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:54.608074  9232 consensus_queue.cc:1048] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:54.845227   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:54.852478  8907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:54.853098  8907 raft_consensus.cc:606] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:54.855669  8982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:54.856140  8982 raft_consensus.cc:606] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:54.858429  8907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:54.858929  8907 raft_consensus.cc:606] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:54.859941   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:54.860471   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:54.861085   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:55.071290  9242 raft_consensus.cc:993] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:55.071843  9232 raft_consensus.cc:1081] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:55.073356  8982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:55.073807  8982 raft_consensus.cc:493] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.074086  8982 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.078838  8982 raft_consensus.cc:515] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.080338  8982 leader_election.cc:290] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:55.081350  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:55.081350  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe30e616ad234d7c81761f5ba6dbff77" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:55.082257  9188 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.082269  8907 raft_consensus.cc:3055] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.082746  8907 raft_consensus.cc:740] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:55.083570  8907 consensus_queue.cc:260] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.084934  8907 raft_consensus.cc:3060] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.089497  9188 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:55.090874  8947 leader_election.cc:304] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:55.091687  9247 raft_consensus.cc:2804] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:55.092178  9247 raft_consensus.cc:697] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:55.092355  8907 raft_consensus.cc:2468] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:55.093214  9247 consensus_queue.cc:237] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.102278  8731 catalog_manager.cc:5697] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 2 to 3, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.157369  9247 raft_consensus.cc:993] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:55.157871  9135 raft_consensus.cc:1081] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:55.159338  8907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:55.159883  8907 raft_consensus.cc:493] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.160207  8907 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.165783  8907 raft_consensus.cc:515] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.167536  8907 leader_election.cc:290] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 4 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:55.168445  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:55.168825  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3eee6c492457187e240cc57dce6e8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:55.169109  9188 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.169389  8982 raft_consensus.cc:3055] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.169704  8982 raft_consensus.cc:740] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:55.170413  8982 consensus_queue.cc:260] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.171564  8982 raft_consensus.cc:3060] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.175730  9188 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 4.
I20260709 13:01:55.177196  8873 leader_election.cc:304] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:55.177994  9232 raft_consensus.cc:2804] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.178002  8982 raft_consensus.cc:2468] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 4.
I20260709 13:01:55.178664  9232 raft_consensus.cc:697] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 4 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:55.179591  9232 consensus_queue.cc:237] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.186574  8731 catalog_manager.cc:5697] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 3 to 4, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 4 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.269510  9242 raft_consensus.cc:993] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:55.270041  9232 raft_consensus.cc:1081] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:55.271608  8982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:55.272049  8982 raft_consensus.cc:493] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.272312  8982 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.276969  8982 raft_consensus.cc:515] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.278527  8982 leader_election.cc:290] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:55.279543  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:55.279678  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:55.280213  9188 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.280356  8907 raft_consensus.cc:3055] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:55.280793  8907 raft_consensus.cc:740] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:55.281574  8907 consensus_queue.cc:260] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.282959  8907 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.285605  9188 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 2.
I20260709 13:01:55.286738  8947 leader_election.cc:304] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:55.287427  9135 raft_consensus.cc:2804] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:55.287968  9135 raft_consensus.cc:697] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:55.289109  8907 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 2.
I20260709 13:01:55.288972  9135 consensus_queue.cc:237] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:55.296828  8731 catalog_manager.cc:5697] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 1 to 2, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:55.481886  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:55.550621  8907 raft_consensus.cc:1275] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:55.552032  9135 consensus_queue.cc:1048] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:55.556846  9188 raft_consensus.cc:1275] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:55.558243  9135 consensus_queue.cc:1048] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:55.570770  9189 raft_consensus.cc:1275] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:55.572512  9232 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:55.581755  8982 raft_consensus.cc:1275] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:55.583292  9242 consensus_queue.cc:1048] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:55.690006  8907 raft_consensus.cc:1275] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.691267  9287 consensus_queue.cc:1048] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.700279  9188 raft_consensus.cc:1275] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.701699  9287 consensus_queue.cc:1048] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.867434   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:55.874938  8982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:55.875587  8982 raft_consensus.cc:606] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:55.878037  8982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
mode: GRACEFUL
new_leader_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:50870
I20260709 13:01:55.878539  8982 raft_consensus.cc:606] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Received request to transfer leadership to TS 837a11cf78ec455ca7738792bab5df0c
I20260709 13:01:55.880796  8907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
mode: GRACEFUL
new_leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:01:55.881330  8907 raft_consensus.cc:606] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Received request to transfer leadership to TS bf00103e9c4a4a53b8b3040a2e9e635d
I20260709 13:01:55.882493   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:55.882999   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:55.883577   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.137887  9242 raft_consensus.cc:993] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: : Instructing follower bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:56.138461  9276 raft_consensus.cc:1081] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Signalling peer bf00103e9c4a4a53b8b3040a2e9e635d to start an election
I20260709 13:01:56.140048  8982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984"
dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
 from {username='slave'} at 127.0.0.1:35920
I20260709 13:01:56.140686  8982 raft_consensus.cc:493] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.141076  8982 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.148831  8982 raft_consensus.cc:515] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.151796  8982 leader_election.cc:290] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847)
I20260709 13:01:56.151927  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
I20260709 13:01:56.152616  8907 raft_consensus.cc:3055] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.152643  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77506a8bc845f3829c1549e2b7c984" candidate_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:56.153048  8907 raft_consensus.cc:740] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:56.153455  9188 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.154059  8907 consensus_queue.cc:260] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.155635  8907 raft_consensus.cc:3060] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.159652  9188 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:56.160998  8947 leader_election.cc:304] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, bf00103e9c4a4a53b8b3040a2e9e635d; no voters: 
I20260709 13:01:56.161813  9296 raft_consensus.cc:2804] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.162271  9296 raft_consensus.cc:697] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Leader. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:56.163054  9296 consensus_queue.cc:237] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.163501  8907 raft_consensus.cc:2468] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf00103e9c4a4a53b8b3040a2e9e635d in term 3.
I20260709 13:01:56.170746  8729 catalog_manager.cc:5697] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d reported cstate change: term changed from 2 to 3, leader changed from 837a11cf78ec455ca7738792bab5df0c (127.0.107.194) to bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.182477  9287 raft_consensus.cc:993] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:56.183048  9247 raft_consensus.cc:1081] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:56.184613  8907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:56.185061  8907 raft_consensus.cc:493] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.185350  8907 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.190538  8907 raft_consensus.cc:515] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.192059  8907 leader_election.cc:290] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 4 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:56.192888  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:56.193199  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dea55ce4d64673ab3c444893512df8" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:56.193495  9188 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.193627  8982 raft_consensus.cc:3055] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.194047  8982 raft_consensus.cc:740] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:56.194818  8982 consensus_queue.cc:260] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.196007  8982 raft_consensus.cc:3060] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.198592  9188 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 4.
I20260709 13:01:56.199908  8873 leader_election.cc:304] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:56.200667  9276 raft_consensus.cc:2804] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:56.201167  9276 raft_consensus.cc:697] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 4 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:56.201862  8982 raft_consensus.cc:2468] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 4.
I20260709 13:01:56.201974  9276 consensus_queue.cc:237] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.209692  8729 catalog_manager.cc:5697] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 3 to 4, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 4 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.298203  9296 raft_consensus.cc:993] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: : Instructing follower 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:56.298712  9247 raft_consensus.cc:1081] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Signalling peer 837a11cf78ec455ca7738792bab5df0c to start an election
I20260709 13:01:56.300177  8907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad"
dest_uuid: "837a11cf78ec455ca7738792bab5df0c"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:01:56.300673  8907 raft_consensus.cc:493] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.300972  8907 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.305540  8907 raft_consensus.cc:515] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.307044  8907 leader_election.cc:290] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 3 election: Requested vote from peers 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557), bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195:39119)
I20260709 13:01:56.307974  9188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc088022ef345edaf52dab445137eb1"
I20260709 13:01:56.308099  8982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861b3369a2574b41ae6e1ea94403dbad" candidate_uuid: "837a11cf78ec455ca7738792bab5df0c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d"
I20260709 13:01:56.308555  9188 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.308713  8982 raft_consensus.cc:3055] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.309069  8982 raft_consensus.cc:740] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf00103e9c4a4a53b8b3040a2e9e635d, State: Running, Role: LEADER
I20260709 13:01:56.309762  8982 consensus_queue.cc:260] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.310642  8982 raft_consensus.cc:3060] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.313155  9188 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 3.
I20260709 13:01:56.314159  8873 leader_election.cc:304] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc088022ef345edaf52dab445137eb1, 837a11cf78ec455ca7738792bab5df0c; no voters: 
I20260709 13:01:56.314833  9276 raft_consensus.cc:2804] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.315327  9276 raft_consensus.cc:697] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 3 LEADER]: Becoming Leader. State: Replica: 837a11cf78ec455ca7738792bab5df0c, State: Running, Role: LEADER
I20260709 13:01:56.315896  8982 raft_consensus.cc:2468] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837a11cf78ec455ca7738792bab5df0c in term 3.
I20260709 13:01:56.316125  9276 consensus_queue.cc:237] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } }
I20260709 13:01:56.322656  8729 catalog_manager.cc:5697] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c reported cstate change: term changed from 2 to 3, leader changed from bf00103e9c4a4a53b8b3040a2e9e635d (127.0.107.195) to 837a11cf78ec455ca7738792bab5df0c (127.0.107.194). New cstate: current_term: 3 leader_uuid: "837a11cf78ec455ca7738792bab5df0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:56.482856  8779 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:01:56.615598  8907 raft_consensus.cc:1275] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.616921  9247 consensus_queue.cc:1048] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "837a11cf78ec455ca7738792bab5df0c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.625590  9188 raft_consensus.cc:1275] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer bf00103e9c4a4a53b8b3040a2e9e635d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.627200  9247 consensus_queue.cc:1048] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.693457  9188 raft_consensus.cc:1275] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:56.695042  9276 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:56.704300  8982 raft_consensus.cc:1275] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:56.705862  9276 consensus_queue.cc:1048] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:56.765676  8982 raft_consensus.cc:1275] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.767076  9276 consensus_queue.cc:1048] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf00103e9c4a4a53b8b3040a2e9e635d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.775712  9188 raft_consensus.cc:1275] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Refusing update from remote peer 837a11cf78ec455ca7738792bab5df0c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.776959  9242 consensus_queue.cc:1048] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc088022ef345edaf52dab445137eb1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.889744   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.920010   431 tablet_server.cc:179] TabletServer@127.0.107.193:35557 shutting down...
W20260709 13:01:56.938905  8873 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 82 similar messages]
W20260709 13:01:56.943686  8873 consensus_peers.cc:597] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:56.953505   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:56.954370   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.955193   431 raft_consensus.cc:2243] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.955773   431 raft_consensus.cc:2272] T ee77506a8bc845f3829c1549e2b7c984 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.959410   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.960035   431 raft_consensus.cc:2243] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.960568   431 raft_consensus.cc:2272] T 7eb178909bc34607ba17336054e7ea4e P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.962905   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.963480   431 raft_consensus.cc:2243] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.963955   431 raft_consensus.cc:2272] T 861b3369a2574b41ae6e1ea94403dbad P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.966691   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.967355   431 raft_consensus.cc:2243] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.967866   431 raft_consensus.cc:2272] T 97dea55ce4d64673ab3c444893512df8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.971060   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.971710   431 raft_consensus.cc:2243] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.972294   431 raft_consensus.cc:2272] T 3c723c20b89740e6a1ec29679c07dd8e P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.974639   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.975221   431 raft_consensus.cc:2243] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.975698   431 raft_consensus.cc:2272] T 94a1342d8af24db9b874db1fa29de8cc P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.978075   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.978623   431 raft_consensus.cc:2243] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.979106   431 raft_consensus.cc:2272] T 9d0655615cfb4b4b84692490158191dc P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.981410   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.981973   431 raft_consensus.cc:2243] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.982409   431 raft_consensus.cc:2272] T fe30e616ad234d7c81761f5ba6dbff77 P 5bc088022ef345edaf52dab445137eb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.984805   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.985314   431 raft_consensus.cc:2243] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.985811   431 raft_consensus.cc:2272] T c3e3eee6c492457187e240cc57dce6e8 P 5bc088022ef345edaf52dab445137eb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.988216   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:01:56.988754   431 raft_consensus.cc:2243] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.989204   431 raft_consensus.cc:2272] T 89fe05a0abfa4fe790a9cf3b03d585ef P 5bc088022ef345edaf52dab445137eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.020879   431 tablet_server.cc:196] TabletServer@127.0.107.193:35557 shutdown complete.
I20260709 13:01:57.046952   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:57.068069  8945 consensus_peers.cc:597] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847): Couldn't send request to peer 837a11cf78ec455ca7738792bab5df0c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:57.068540  8947 consensus_peers.cc:597] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 5bc088022ef345edaf52dab445137eb1 (127.0.107.193:35557): Couldn't send request to peer 5bc088022ef345edaf52dab445137eb1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:57.077436   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:57.078253   431 tablet_replica.cc:333] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.078970   431 raft_consensus.cc:2243] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.079499   431 raft_consensus.cc:2272] T ee77506a8bc845f3829c1549e2b7c984 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.083117   431 tablet_replica.cc:333] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.083717   431 raft_consensus.cc:2243] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.084617   431 raft_consensus.cc:2272] T 861b3369a2574b41ae6e1ea94403dbad P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.087255   431 tablet_replica.cc:333] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.087845   431 raft_consensus.cc:2243] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.088749   431 raft_consensus.cc:2272] T 97dea55ce4d64673ab3c444893512df8 P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.091058   431 tablet_replica.cc:333] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.091704   431 raft_consensus.cc:2243] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.092263   431 raft_consensus.cc:2272] T 7eb178909bc34607ba17336054e7ea4e P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.094331   431 tablet_replica.cc:333] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.095008   431 raft_consensus.cc:2243] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.095820   431 raft_consensus.cc:2272] T 89fe05a0abfa4fe790a9cf3b03d585ef P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.098009   431 tablet_replica.cc:333] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.098592   431 raft_consensus.cc:2243] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.099385   431 raft_consensus.cc:2272] T c3e3eee6c492457187e240cc57dce6e8 P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.101620   431 tablet_replica.cc:333] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.102173   431 raft_consensus.cc:2243] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.102619   431 raft_consensus.cc:2272] T fe30e616ad234d7c81761f5ba6dbff77 P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.104764   431 tablet_replica.cc:333] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.105306   431 raft_consensus.cc:2243] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.105760   431 raft_consensus.cc:2272] T 3c723c20b89740e6a1ec29679c07dd8e P 837a11cf78ec455ca7738792bab5df0c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.107800   431 tablet_replica.cc:333] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.108331   431 raft_consensus.cc:2243] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.109167   431 raft_consensus.cc:2272] T 9d0655615cfb4b4b84692490158191dc P 837a11cf78ec455ca7738792bab5df0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.111340   431 tablet_replica.cc:333] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c: stopping tablet replica
I20260709 13:01:57.111840   431 raft_consensus.cc:2243] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.112645   431 raft_consensus.cc:2272] T 94a1342d8af24db9b874db1fa29de8cc P 837a11cf78ec455ca7738792bab5df0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.144759   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:57.171882   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:57.172854  8945 consensus_peers.cc:597] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847): Couldn't send request to peer 837a11cf78ec455ca7738792bab5df0c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:57.199472   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:57.200518   431 tablet_replica.cc:333] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.201849   431 raft_consensus.cc:2243] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:01:57.202104  8945 consensus_peers.cc:597] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d -> Peer 837a11cf78ec455ca7738792bab5df0c (127.0.107.194:37847): Couldn't send request to peer 837a11cf78ec455ca7738792bab5df0c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:57.203192   431 raft_consensus.cc:2272] T ee77506a8bc845f3829c1549e2b7c984 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.205852   431 tablet_replica.cc:333] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.206527   431 raft_consensus.cc:2243] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.207386   431 raft_consensus.cc:2272] T 7eb178909bc34607ba17336054e7ea4e P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.209626   431 tablet_replica.cc:333] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.210559   431 raft_consensus.cc:2243] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.211225   431 raft_consensus.cc:2272] T 861b3369a2574b41ae6e1ea94403dbad P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.215097   431 tablet_replica.cc:333] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.216092   431 raft_consensus.cc:2243] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.216738   431 raft_consensus.cc:2272] T 97dea55ce4d64673ab3c444893512df8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.219609   431 tablet_replica.cc:333] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.220207   431 raft_consensus.cc:2243] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.220793   431 raft_consensus.cc:2272] T 9d0655615cfb4b4b84692490158191dc P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.222945   431 tablet_replica.cc:333] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.223506   431 raft_consensus.cc:2243] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.224352   431 raft_consensus.cc:2272] T 3c723c20b89740e6a1ec29679c07dd8e P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.226468   431 tablet_replica.cc:333] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.227135   431 raft_consensus.cc:2243] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.227499   431 raft_consensus.cc:2272] T 94a1342d8af24db9b874db1fa29de8cc P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.229458   431 tablet_replica.cc:333] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.229885   431 raft_consensus.cc:2243] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.230232   431 raft_consensus.cc:2272] T c3e3eee6c492457187e240cc57dce6e8 P bf00103e9c4a4a53b8b3040a2e9e635d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.232034   431 tablet_replica.cc:333] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.232522   431 raft_consensus.cc:2243] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.233230   431 raft_consensus.cc:2272] T fe30e616ad234d7c81761f5ba6dbff77 P bf00103e9c4a4a53b8b3040a2e9e635d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.235199   431 tablet_replica.cc:333] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d: stopping tablet replica
I20260709 13:01:57.235720   431 raft_consensus.cc:2243] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.236187   431 raft_consensus.cc:2272] T 89fe05a0abfa4fe790a9cf3b03d585ef P bf00103e9c4a4a53b8b3040a2e9e635d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.270358   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:57.295681   431 master.cc:562] Master@127.0.107.254:37117 shutting down...
I20260709 13:01:57.318457   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.318976   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.319259   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8d29a126bafe44a5ae8957fc4c139c2b: stopping tablet replica
I20260709 13:01:57.340502   431 master.cc:584] Master@127.0.107.254:37117 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13061 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:01:57.387585   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:42159
I20260709 13:01:57.388980   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:57.394968  9319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.395030  9320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.395495  9322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:57.397269   431 server_base.cc:1061] running on GCE node
I20260709 13:01:57.398085   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:57.398258   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:57.398375   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602117398357 us; error 0 us; skew 500 ppm
I20260709 13:01:57.398833   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:57.401285   431 webserver.cc:533] Webserver started at http://127.0.107.254:44487/ using document root <none> and password file <none>
I20260709 13:01:57.401773   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:57.401937   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:57.402158   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:57.403307   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "fa12161c86914a05bcc989d4f12c5bc8"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.408028   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:01:57.411366  9327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.412117   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:57.412423   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "fa12161c86914a05bcc989d4f12c5bc8"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.412688   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:57.445956   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:57.447124   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:57.485081   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:42159
I20260709 13:01:57.485193  9378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:42159 every 8 connection(s)
I20260709 13:01:57.488854  9379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.500627  9379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8: Bootstrap starting.
I20260709 13:01:57.505595  9379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.509964  9379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8: No bootstrap required, opened a new log
I20260709 13:01:57.512182  9379 raft_consensus.cc:359] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa12161c86914a05bcc989d4f12c5bc8" member_type: VOTER }
I20260709 13:01:57.512624  9379 raft_consensus.cc:385] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.512849  9379 raft_consensus.cc:740] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa12161c86914a05bcc989d4f12c5bc8, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.513513  9379 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa12161c86914a05bcc989d4f12c5bc8" member_type: VOTER }
I20260709 13:01:57.513998  9379 raft_consensus.cc:399] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:57.514218  9379 raft_consensus.cc:493] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:57.514506  9379 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.519322  9379 raft_consensus.cc:515] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa12161c86914a05bcc989d4f12c5bc8" member_type: VOTER }
I20260709 13:01:57.519851  9379 leader_election.cc:304] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa12161c86914a05bcc989d4f12c5bc8; no voters: 
I20260709 13:01:57.521006  9379 leader_election.cc:290] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:57.521358  9382 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:57.522728  9382 raft_consensus.cc:697] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 1 LEADER]: Becoming Leader. State: Replica: fa12161c86914a05bcc989d4f12c5bc8, State: Running, Role: LEADER
I20260709 13:01:57.523427  9382 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa12161c86914a05bcc989d4f12c5bc8" member_type: VOTER }
I20260709 13:01:57.524080  9379 sys_catalog.cc:565] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:57.528805  9384 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa12161c86914a05bcc989d4f12c5bc8. Latest consensus state: current_term: 1 leader_uuid: "fa12161c86914a05bcc989d4f12c5bc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa12161c86914a05bcc989d4f12c5bc8" member_type: VOTER } }
I20260709 13:01:57.529680  9384 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:57.530318  9383 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa12161c86914a05bcc989d4f12c5bc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa12161c86914a05bcc989d4f12c5bc8" member_type: VOTER } }
I20260709 13:01:57.530892  9383 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:57.532022  9390 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:57.538359  9390 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:57.539467   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:57.547248  9390 catalog_manager.cc:1383] Generated new cluster ID: 26a69911758744d191f966eaa91db0ce
I20260709 13:01:57.547566  9390 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:57.567428  9390 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:57.568813  9390 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:57.588800  9390 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8: Generated new TSK 0
I20260709 13:01:57.589476  9390 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:57.606310   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:57.612478  9400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.613637  9401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:57.616253   431 server_base.cc:1061] running on GCE node
W20260709 13:01:57.616560  9403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:57.617581   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:57.617779   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:57.617918   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602117617906 us; error 0 us; skew 500 ppm
I20260709 13:01:57.618404   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:57.620651   431 webserver.cc:533] Webserver started at http://127.0.107.193:39815/ using document root <none> and password file <none>
I20260709 13:01:57.621086   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:57.621243   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:57.621448   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:57.622584   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.627161   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:01:57.630656  9408 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.631422   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:57.631736   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.632041   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:57.660897   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:57.662125   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:57.663594   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:57.665889   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:57.666108   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.666358   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:57.666543   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.706758   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33957
I20260709 13:01:57.706871  9470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33957 every 8 connection(s)
I20260709 13:01:57.711865   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:57.719362  9475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.720136  9476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.724270  9478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:57.724886   431 server_base.cc:1061] running on GCE node
I20260709 13:01:57.725104  9471 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42159
I20260709 13:01:57.725518  9471 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:57.726378   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:57.726485  9471 heartbeater.cc:507] Master 127.0.107.254:42159 requested a full tablet report, sending...
W20260709 13:01:57.726827   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:57.727061   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602117727043 us; error 0 us; skew 500 ppm
I20260709 13:01:57.727789   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:57.728935  9344 ts_manager.cc:194] Registered new tserver with Master: 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957)
I20260709 13:01:57.730427   431 webserver.cc:533] Webserver started at http://127.0.107.194:44439/ using document root <none> and password file <none>
I20260709 13:01:57.730979   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:57.731061  9344 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53958
I20260709 13:01:57.731189   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:57.731597   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:57.732930   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "262c3bc3f3d2455288c7d9b29405e878"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.737555   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:57.740649  9483 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.741406   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:57.741712   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "262c3bc3f3d2455288c7d9b29405e878"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.742008   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:57.759907   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:57.761152   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:57.762580   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:57.764832   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:57.765056   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.765301   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:57.765482   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.805730   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43497
I20260709 13:01:57.805824  9545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43497 every 8 connection(s)
I20260709 13:01:57.810832   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:57.818079  9549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.819868  9550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:57.821545  9552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:57.822615   431 server_base.cc:1061] running on GCE node
I20260709 13:01:57.823467  9546 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42159
I20260709 13:01:57.823669   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:57.823944  9546 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:57.824014   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:57.824487   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602117824455 us; error 0 us; skew 500 ppm
I20260709 13:01:57.824988  9546 heartbeater.cc:507] Master 127.0.107.254:42159 requested a full tablet report, sending...
I20260709 13:01:57.825101   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:57.827340  9344 ts_manager.cc:194] Registered new tserver with Master: 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497)
I20260709 13:01:57.827972   431 webserver.cc:533] Webserver started at http://127.0.107.195:46741/ using document root <none> and password file <none>
I20260709 13:01:57.828685   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:57.828923   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:57.829219   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:57.829278  9344 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53972
I20260709 13:01:57.830750   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.835566   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:01:57.838722  9557 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.839486   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:57.839777   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
format_stamp: "Formatted at 2026-07-09 13:01:57 on dist-test-slave-vcr9"
I20260709 13:01:57.840058   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:57.868870   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:57.870082   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:57.871548   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:57.873747   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:57.873977   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.874220   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:57.874395   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:57.913054   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45791
I20260709 13:01:57.913167  9619 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45791 every 8 connection(s)
I20260709 13:01:57.926728  9620 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42159
I20260709 13:01:57.927173  9620 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:57.927901  9620 heartbeater.cc:507] Master 127.0.107.254:42159 requested a full tablet report, sending...
I20260709 13:01:57.929826  9344 ts_manager.cc:194] Registered new tserver with Master: b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791)
I20260709 13:01:57.930481   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014209027s
I20260709 13:01:57.931187  9344 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53984
I20260709 13:01:57.955003  9344 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54000:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:57.957238  9344 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:58.005285  9585 tablet_service.cc:1511] Processing CreateTablet for tablet 4b46c24539774a2d97fec48e67459dc9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d67771466310447b800e0dafb59de343]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:58.006148  9584 tablet_service.cc:1511] Processing CreateTablet for tablet 65f6c806279640fa95fdaaf958737310 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d67771466310447b800e0dafb59de343]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:58.006865  9585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b46c24539774a2d97fec48e67459dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.007586  9584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f6c806279640fa95fdaaf958737310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.016624  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 4b46c24539774a2d97fec48e67459dc9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d67771466310447b800e0dafb59de343]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:58.017300  9435 tablet_service.cc:1511] Processing CreateTablet for tablet 65f6c806279640fa95fdaaf958737310 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d67771466310447b800e0dafb59de343]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:58.018088  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b46c24539774a2d97fec48e67459dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.018821  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f6c806279640fa95fdaaf958737310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.031030  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 4b46c24539774a2d97fec48e67459dc9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d67771466310447b800e0dafb59de343]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:58.031512  9510 tablet_service.cc:1511] Processing CreateTablet for tablet 65f6c806279640fa95fdaaf958737310 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d67771466310447b800e0dafb59de343]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:58.033344  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b46c24539774a2d97fec48e67459dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.033989  9635 tablet_bootstrap.cc:492] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1: Bootstrap starting.
I20260709 13:01:58.034166  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f6c806279640fa95fdaaf958737310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.040380  9636 tablet_bootstrap.cc:492] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb: Bootstrap starting.
I20260709 13:01:58.046662  9635 tablet_bootstrap.cc:654] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.047319  9636 tablet_bootstrap.cc:654] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.067955  9635 tablet_bootstrap.cc:492] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1: No bootstrap required, opened a new log
I20260709 13:01:58.068459  9635 ts_tablet_manager.cc:1403] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.018s
I20260709 13:01:58.069232  9636 tablet_bootstrap.cc:492] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb: No bootstrap required, opened a new log
I20260709 13:01:58.070211  9636 ts_tablet_manager.cc:1403] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
I20260709 13:01:58.071410  9635 raft_consensus.cc:359] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.072052  9635 raft_consensus.cc:385] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.072309  9635 raft_consensus.cc:740] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.072816  9639 tablet_bootstrap.cc:492] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878: Bootstrap starting.
I20260709 13:01:58.073026  9635 consensus_queue.cc:260] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.073091  9636 raft_consensus.cc:359] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.074095  9636 raft_consensus.cc:385] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.074411  9636 raft_consensus.cc:740] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.075346  9636 consensus_queue.cc:260] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.075767  9620 heartbeater.cc:499] Master 127.0.107.254:42159 was elected leader, sending a full tablet report...
I20260709 13:01:58.076327  9635 ts_tablet_manager.cc:1434] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:01:58.077152  9635 tablet_bootstrap.cc:492] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: Bootstrap starting.
I20260709 13:01:58.081506  9639 tablet_bootstrap.cc:654] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.083716  9635 tablet_bootstrap.cc:654] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.086501  9636 ts_tablet_manager.cc:1434] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:01:58.087232  9471 heartbeater.cc:499] Master 127.0.107.254:42159 was elected leader, sending a full tablet report...
I20260709 13:01:58.088210  9636 tablet_bootstrap.cc:492] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb: Bootstrap starting.
I20260709 13:01:58.096478  9635 tablet_bootstrap.cc:492] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: No bootstrap required, opened a new log
I20260709 13:01:58.097083  9635 ts_tablet_manager.cc:1403] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:01:58.097143  9636 tablet_bootstrap.cc:654] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.100509  9635 raft_consensus.cc:359] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.101369  9639 tablet_bootstrap.cc:492] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878: No bootstrap required, opened a new log
I20260709 13:01:58.101485  9635 raft_consensus.cc:385] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.101989  9639 ts_tablet_manager.cc:1403] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.005s
I20260709 13:01:58.102042  9635 raft_consensus.cc:740] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.103556  9635 consensus_queue.cc:260] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.106220  9639 raft_consensus.cc:359] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.106899  9635 ts_tablet_manager.cc:1434] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:58.107052  9639 raft_consensus.cc:385] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.107589  9639 raft_consensus.cc:740] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.109056  9639 consensus_queue.cc:260] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.111332  9636 tablet_bootstrap.cc:492] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb: No bootstrap required, opened a new log
I20260709 13:01:58.111672  9546 heartbeater.cc:499] Master 127.0.107.254:42159 was elected leader, sending a full tablet report...
I20260709 13:01:58.111912  9636 ts_tablet_manager.cc:1403] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:01:58.112213  9639 ts_tablet_manager.cc:1434] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:01:58.114320  9639 tablet_bootstrap.cc:492] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: Bootstrap starting.
I20260709 13:01:58.115120  9636 raft_consensus.cc:359] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.115728  9636 raft_consensus.cc:385] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.115969  9636 raft_consensus.cc:740] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.116650  9636 consensus_queue.cc:260] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.118376  9636 ts_tablet_manager.cc:1434] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:58.121955  9639 tablet_bootstrap.cc:654] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.129123  9639 tablet_bootstrap.cc:492] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: No bootstrap required, opened a new log
I20260709 13:01:58.129658  9639 ts_tablet_manager.cc:1403] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:01:58.131876  9639 raft_consensus.cc:359] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.132505  9639 raft_consensus.cc:385] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.132756  9639 raft_consensus.cc:740] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.133419  9639 consensus_queue.cc:260] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.135437  9639 ts_tablet_manager.cc:1434] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:58.157116  9645 raft_consensus.cc:493] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.157568  9645 raft_consensus.cc:515] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.159699  9645 leader_election.cc:290] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791), 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957)
I20260709 13:01:58.169771  9595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9" candidate_uuid: "262c3bc3f3d2455288c7d9b29405e878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" is_pre_election: true
I20260709 13:01:58.170589  9595 raft_consensus.cc:2468] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 262c3bc3f3d2455288c7d9b29405e878 in term 0.
I20260709 13:01:58.171157  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9" candidate_uuid: "262c3bc3f3d2455288c7d9b29405e878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" is_pre_election: true
I20260709 13:01:58.171757  9484 leader_election.cc:304] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 262c3bc3f3d2455288c7d9b29405e878, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:58.171772  9446 raft_consensus.cc:2468] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 262c3bc3f3d2455288c7d9b29405e878 in term 0.
I20260709 13:01:58.172603  9645 raft_consensus.cc:2804] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.172937  9645 raft_consensus.cc:493] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.173276  9645 raft_consensus.cc:3060] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.178448  9645 raft_consensus.cc:515] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.180122  9645 leader_election.cc:290] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [CANDIDATE]: Term 1 election: Requested vote from peers b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791), 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957)
I20260709 13:01:58.180963  9595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9" candidate_uuid: "262c3bc3f3d2455288c7d9b29405e878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
I20260709 13:01:58.181262  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9" candidate_uuid: "262c3bc3f3d2455288c7d9b29405e878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
I20260709 13:01:58.181651  9595 raft_consensus.cc:3060] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.181828  9446 raft_consensus.cc:3060] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.189320  9446 raft_consensus.cc:2468] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 262c3bc3f3d2455288c7d9b29405e878 in term 1.
I20260709 13:01:58.189320  9595 raft_consensus.cc:2468] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 262c3bc3f3d2455288c7d9b29405e878 in term 1.
I20260709 13:01:58.190605  9486 leader_election.cc:304] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 262c3bc3f3d2455288c7d9b29405e878, 490bdd6c3d1e4c638ec6da54266b69eb; no voters: 
I20260709 13:01:58.191352  9645 raft_consensus.cc:2804] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.192480  9645 raft_consensus.cc:697] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 LEADER]: Becoming Leader. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Running, Role: LEADER
I20260709 13:01:58.193189  9645 consensus_queue.cc:237] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:58.201094  9343 catalog_manager.cc:5697] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 reported cstate change: term changed from 0 to 1, leader changed from <none> to 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "262c3bc3f3d2455288c7d9b29405e878" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.336208  9640 raft_consensus.cc:493] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.336845  9640 raft_consensus.cc:515] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.338956  9640 leader_election.cc:290] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957), 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497)
I20260709 13:01:58.347738  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f6c806279640fa95fdaaf958737310" candidate_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" is_pre_election: true
I20260709 13:01:58.348573  9446 raft_consensus.cc:2468] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7a8d1747cca45b8a9d347ab77a0daa1 in term 0.
I20260709 13:01:58.349472  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f6c806279640fa95fdaaf958737310" candidate_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "262c3bc3f3d2455288c7d9b29405e878" is_pre_election: true
I20260709 13:01:58.349731  9560 leader_election.cc:304] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490bdd6c3d1e4c638ec6da54266b69eb, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:58.350139  9521 raft_consensus.cc:2468] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7a8d1747cca45b8a9d347ab77a0daa1 in term 0.
I20260709 13:01:58.350621  9640 raft_consensus.cc:2804] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.350998  9640 raft_consensus.cc:493] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.351305  9640 raft_consensus.cc:3060] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.356516  9640 raft_consensus.cc:515] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.358105  9640 leader_election.cc:290] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [CANDIDATE]: Term 1 election: Requested vote from peers 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957), 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497)
I20260709 13:01:58.359093  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f6c806279640fa95fdaaf958737310" candidate_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
I20260709 13:01:58.359093  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f6c806279640fa95fdaaf958737310" candidate_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
I20260709 13:01:58.359747  9446 raft_consensus.cc:3060] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.359833  9521 raft_consensus.cc:3060] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.364741  9446 raft_consensus.cc:2468] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a8d1747cca45b8a9d347ab77a0daa1 in term 1.
I20260709 13:01:58.364969  9521 raft_consensus.cc:2468] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a8d1747cca45b8a9d347ab77a0daa1 in term 1.
I20260709 13:01:58.365878  9560 leader_election.cc:304] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490bdd6c3d1e4c638ec6da54266b69eb, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:58.366683  9640 raft_consensus.cc:2804] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.367456  9640 raft_consensus.cc:697] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 LEADER]: Becoming Leader. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Running, Role: LEADER
I20260709 13:01:58.368127  9640 consensus_queue.cc:237] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.375511  9343 catalog_manager.cc:5697] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.423342  9343 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54006:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:58.425393  9343 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:58.448565  9435 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae9e1daa6e04eac98faa4fe83d9bf7d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a8fd1b6a67048e2bad0eac113f9a8fe]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:58.449885  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae9e1daa6e04eac98faa4fe83d9bf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.449995  9510 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae9e1daa6e04eac98faa4fe83d9bf7d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a8fd1b6a67048e2bad0eac113f9a8fe]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:58.451377  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae9e1daa6e04eac98faa4fe83d9bf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.451258  9584 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae9e1daa6e04eac98faa4fe83d9bf7d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a8fd1b6a67048e2bad0eac113f9a8fe]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:01:58.452716  9584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae9e1daa6e04eac98faa4fe83d9bf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.453471  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 23675a7f255f48709cc059cfa6e20913 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a8fd1b6a67048e2bad0eac113f9a8fe]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:58.454730  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23675a7f255f48709cc059cfa6e20913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.457221  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 23675a7f255f48709cc059cfa6e20913 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a8fd1b6a67048e2bad0eac113f9a8fe]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:58.458485  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23675a7f255f48709cc059cfa6e20913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.462432  9585 tablet_service.cc:1511] Processing CreateTablet for tablet 23675a7f255f48709cc059cfa6e20913 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a8fd1b6a67048e2bad0eac113f9a8fe]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:01:58.463799  9585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23675a7f255f48709cc059cfa6e20913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.467774  9639 tablet_bootstrap.cc:492] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878: Bootstrap starting.
I20260709 13:01:58.471537  9636 tablet_bootstrap.cc:492] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb: Bootstrap starting.
I20260709 13:01:58.474457  9639 tablet_bootstrap.cc:654] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.479424  9635 tablet_bootstrap.cc:492] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1: Bootstrap starting.
I20260709 13:01:58.480675  9636 tablet_bootstrap.cc:654] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.486454  9635 tablet_bootstrap.cc:654] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.488889  9636 tablet_bootstrap.cc:492] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb: No bootstrap required, opened a new log
I20260709 13:01:58.492699  9636 ts_tablet_manager.cc:1403] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:01:58.495378  9635 tablet_bootstrap.cc:492] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1: No bootstrap required, opened a new log
I20260709 13:01:58.496054  9635 ts_tablet_manager.cc:1403] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:01:58.495441  9636 raft_consensus.cc:359] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.496498  9636 raft_consensus.cc:385] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.496819  9636 raft_consensus.cc:740] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.497690  9636 consensus_queue.cc:260] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.498389  9639 tablet_bootstrap.cc:492] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878: No bootstrap required, opened a new log
I20260709 13:01:58.498921  9639 ts_tablet_manager.cc:1403] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:01:58.499977  9636 ts_tablet_manager.cc:1434] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:01:58.501142  9636 tablet_bootstrap.cc:492] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: Bootstrap starting.
I20260709 13:01:58.501359  9635 raft_consensus.cc:359] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.502177  9635 raft_consensus.cc:385] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.502696  9635 raft_consensus.cc:740] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.502080  9639 raft_consensus.cc:359] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.503330  9639 raft_consensus.cc:385] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.503720  9639 raft_consensus.cc:740] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.503679  9635 consensus_queue.cc:260] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.505051  9639 consensus_queue.cc:260] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.507460  9639 ts_tablet_manager.cc:1434] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:58.508617  9639 tablet_bootstrap.cc:492] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878: Bootstrap starting.
I20260709 13:01:58.508863  9636 tablet_bootstrap.cc:654] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.517019  9639 tablet_bootstrap.cc:654] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.522176  9635 ts_tablet_manager.cc:1434] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:01:58.523525  9635 tablet_bootstrap.cc:492] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: Bootstrap starting.
I20260709 13:01:58.530369  9635 tablet_bootstrap.cc:654] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.530501  9639 tablet_bootstrap.cc:492] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878: No bootstrap required, opened a new log
I20260709 13:01:58.531334  9639 ts_tablet_manager.cc:1403] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
W20260709 13:01:58.534636  9392 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:58.535317  9636 tablet_bootstrap.cc:492] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: No bootstrap required, opened a new log
I20260709 13:01:58.535120  9639 raft_consensus.cc:359] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.535894  9636 ts_tablet_manager.cc:1403] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.023s
I20260709 13:01:58.535913  9639 raft_consensus.cc:385] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.536422  9639 raft_consensus.cc:740] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.537393  9639 consensus_queue.cc:260] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.538836  9635 tablet_bootstrap.cc:492] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: No bootstrap required, opened a new log
I20260709 13:01:58.539376  9635 ts_tablet_manager.cc:1403] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent bootstrapping tablet: real 0.016s	user 0.000s	sys 0.011s
I20260709 13:01:58.539675  9639 ts_tablet_manager.cc:1434] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:01:58.539326  9636 raft_consensus.cc:359] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.540297  9636 raft_consensus.cc:385] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.540592  9636 raft_consensus.cc:740] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.541226  9636 consensus_queue.cc:260] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.543355  9636 ts_tablet_manager.cc:1434] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:58.542764  9635 raft_consensus.cc:359] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.543910  9635 raft_consensus.cc:385] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.544333  9635 raft_consensus.cc:740] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.545125  9635 consensus_queue.cc:260] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.547458  9635 ts_tablet_manager.cc:1434] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:01:58.613931  9645 consensus_queue.cc:1048] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:58.626266  9648 consensus_queue.cc:1048] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:58.786482  9641 raft_consensus.cc:493] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.787050  9641 raft_consensus.cc:515] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.790231  9641 leader_election.cc:290] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497), b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791)
I20260709 13:01:58.799945  9641 raft_consensus.cc:493] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.800035  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae9e1daa6e04eac98faa4fe83d9bf7d" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "262c3bc3f3d2455288c7d9b29405e878" is_pre_election: true
I20260709 13:01:58.800559  9641 raft_consensus.cc:515] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.800861  9521 raft_consensus.cc:2468] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 0.
I20260709 13:01:58.801338  9595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae9e1daa6e04eac98faa4fe83d9bf7d" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" is_pre_election: true
I20260709 13:01:58.802012  9595 raft_consensus.cc:2468] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 0.
I20260709 13:01:58.802095  9410 leader_election.cc:304] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 262c3bc3f3d2455288c7d9b29405e878, 490bdd6c3d1e4c638ec6da54266b69eb; no voters: 
I20260709 13:01:58.802645  9641 leader_election.cc:290] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497), b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791)
I20260709 13:01:58.803283  9641 raft_consensus.cc:2804] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.803611  9641 raft_consensus.cc:493] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.803962  9641 raft_consensus.cc:3060] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.803942  9595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" is_pre_election: true
I20260709 13:01:58.804819  9595 raft_consensus.cc:2468] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 0.
I20260709 13:01:58.805711  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "262c3bc3f3d2455288c7d9b29405e878" is_pre_election: true
I20260709 13:01:58.805907  9409 leader_election.cc:304] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490bdd6c3d1e4c638ec6da54266b69eb, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:58.806319  9521 raft_consensus.cc:2468] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 0.
I20260709 13:01:58.806990  9672 raft_consensus.cc:2804] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.807446  9672 raft_consensus.cc:493] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.807845  9672 raft_consensus.cc:3060] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.811503  9641 raft_consensus.cc:515] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.814330  9641 leader_election.cc:290] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 election: Requested vote from peers 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497), b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791)
I20260709 13:01:58.814445  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae9e1daa6e04eac98faa4fe83d9bf7d" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
I20260709 13:01:58.814488  9595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae9e1daa6e04eac98faa4fe83d9bf7d" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
I20260709 13:01:58.814563  9672 raft_consensus.cc:515] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.815419  9521 raft_consensus.cc:3060] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.815621  9595 raft_consensus.cc:3060] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.818288  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
I20260709 13:01:58.818717  9594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
I20260709 13:01:58.818940  9520 raft_consensus.cc:3060] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.819424  9594 raft_consensus.cc:3060] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.823190  9521 raft_consensus.cc:2468] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 1.
I20260709 13:01:58.823179  9595 raft_consensus.cc:2468] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 1.
I20260709 13:01:58.824661  9672 leader_election.cc:290] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 election: Requested vote from peers 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497), b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791)
I20260709 13:01:58.824785  9410 leader_election.cc:304] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 262c3bc3f3d2455288c7d9b29405e878, 490bdd6c3d1e4c638ec6da54266b69eb; no voters: 
I20260709 13:01:58.826095  9672 raft_consensus.cc:2804] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.826541  9672 raft_consensus.cc:697] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Becoming Leader. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Running, Role: LEADER
I20260709 13:01:58.827314  9594 raft_consensus.cc:2468] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 1.
I20260709 13:01:58.827358  9672 consensus_queue.cc:237] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.827809  9520 raft_consensus.cc:2468] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 1.
I20260709 13:01:58.828742  9409 leader_election.cc:304] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490bdd6c3d1e4c638ec6da54266b69eb, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:58.829535  9641 raft_consensus.cc:2804] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.830893  9641 raft_consensus.cc:697] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Becoming Leader. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Running, Role: LEADER
I20260709 13:01:58.831794  9641 consensus_queue.cc:237] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:58.836766  9344 catalog_manager.cc:5697] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.842011  9640 consensus_queue.cc:1048] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:58.851832  9344 catalog_manager.cc:5697] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.854863  9640 consensus_queue.cc:1048] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:58.895633  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9"
dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
mode: GRACEFUL
new_leader_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
 from {username='slave'} at 127.0.0.1:44338
I20260709 13:01:58.896215  9520 raft_consensus.cc:606] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 LEADER]: Received request to transfer leadership to TS 490bdd6c3d1e4c638ec6da54266b69eb
I20260709 13:01:58.909160  9594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65f6c806279640fa95fdaaf958737310"
dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
mode: GRACEFUL
new_leader_uuid: "262c3bc3f3d2455288c7d9b29405e878"
 from {username='slave'} at 127.0.0.1:34464
I20260709 13:01:58.909658  9594 raft_consensus.cc:606] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 LEADER]: Received request to transfer leadership to TS 262c3bc3f3d2455288c7d9b29405e878
I20260709 13:01:59.091050  9645 raft_consensus.cc:993] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: : Instructing follower 490bdd6c3d1e4c638ec6da54266b69eb to start an election
I20260709 13:01:59.091512  9681 raft_consensus.cc:1081] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 LEADER]: Signalling peer 490bdd6c3d1e4c638ec6da54266b69eb to start an election
I20260709 13:01:59.092983  9446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9"
dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
 from {username='slave'} at 127.0.0.1:53466
I20260709 13:01:59.093478  9446 raft_consensus.cc:493] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.093804  9446 raft_consensus.cc:3060] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.098824  9446 raft_consensus.cc:515] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:59.100553  9446 leader_election.cc:290] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 2 election: Requested vote from peers b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791), 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497)
I20260709 13:01:59.101478  9594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
I20260709 13:01:59.101717  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b46c24539774a2d97fec48e67459dc9" candidate_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
I20260709 13:01:59.102164  9594 raft_consensus.cc:3060] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.102311  9520 raft_consensus.cc:3055] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:59.102732  9520 raft_consensus.cc:740] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Running, Role: LEADER
I20260709 13:01:59.103569  9520 consensus_queue.cc:260] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:59.104874  9520 raft_consensus.cc:3060] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.109766  9594 raft_consensus.cc:2468] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 2.
I20260709 13:01:59.111024  9409 leader_election.cc:304] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490bdd6c3d1e4c638ec6da54266b69eb, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:59.111901  9641 raft_consensus.cc:2804] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:59.112327  9520 raft_consensus.cc:2468] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490bdd6c3d1e4c638ec6da54266b69eb in term 2.
I20260709 13:01:59.112453  9641 raft_consensus.cc:697] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 LEADER]: Becoming Leader. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Running, Role: LEADER
I20260709 13:01:59.114058  9641 consensus_queue.cc:237] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } }
I20260709 13:01:59.121119  9341 catalog_manager.cc:5697] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb reported cstate change: term changed from 1 to 2, leader changed from 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194) to 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.269310  9641 consensus_queue.cc:1048] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:59.279453  9673 consensus_queue.cc:1048] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:59.310559  9673 consensus_queue.cc:1048] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:59.321585  9673 consensus_queue.cc:1048] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:59.355762  9651 raft_consensus.cc:993] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: : Instructing follower 262c3bc3f3d2455288c7d9b29405e878 to start an election
I20260709 13:01:59.356370  9677 raft_consensus.cc:1081] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 LEADER]: Signalling peer 262c3bc3f3d2455288c7d9b29405e878 to start an election
I20260709 13:01:59.358045  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65f6c806279640fa95fdaaf958737310"
dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
 from {username='slave'} at 127.0.0.1:44314
I20260709 13:01:59.358542  9520 raft_consensus.cc:493] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.358855  9520 raft_consensus.cc:3060] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.363751  9520 raft_consensus.cc:515] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:59.365715  9520 leader_election.cc:290] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [CANDIDATE]: Term 2 election: Requested vote from peers 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957), b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195:45791)
I20260709 13:01:59.366360  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f6c806279640fa95fdaaf958737310" candidate_uuid: "262c3bc3f3d2455288c7d9b29405e878" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
I20260709 13:01:59.366681  9594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f6c806279640fa95fdaaf958737310" candidate_uuid: "262c3bc3f3d2455288c7d9b29405e878" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
I20260709 13:01:59.367015  9446 raft_consensus.cc:3060] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.367290  9594 raft_consensus.cc:3055] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:59.367637  9594 raft_consensus.cc:740] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Running, Role: LEADER
I20260709 13:01:59.368498  9594 consensus_queue.cc:260] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:59.369752  9594 raft_consensus.cc:3060] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.374396  9446 raft_consensus.cc:2468] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 262c3bc3f3d2455288c7d9b29405e878 in term 2.
I20260709 13:01:59.375839  9486 leader_election.cc:304] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 262c3bc3f3d2455288c7d9b29405e878, 490bdd6c3d1e4c638ec6da54266b69eb; no voters: 
I20260709 13:01:59.376713  9681 raft_consensus.cc:2804] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:59.376958  9594 raft_consensus.cc:2468] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 262c3bc3f3d2455288c7d9b29405e878 in term 2.
I20260709 13:01:59.377148  9681 raft_consensus.cc:697] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 LEADER]: Becoming Leader. State: Replica: 262c3bc3f3d2455288c7d9b29405e878, State: Running, Role: LEADER
I20260709 13:01:59.378077  9681 consensus_queue.cc:237] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:59.384393  9341 catalog_manager.cc:5697] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 reported cstate change: term changed from 1 to 2, leader changed from b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195) to 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "262c3bc3f3d2455288c7d9b29405e878" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.580932  9520 raft_consensus.cc:1275] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Refusing update from remote peer 490bdd6c3d1e4c638ec6da54266b69eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:59.582291  9673 consensus_queue.cc:1048] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:59.591542  9594 raft_consensus.cc:1275] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Refusing update from remote peer 490bdd6c3d1e4c638ec6da54266b69eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:59.592998  9685 consensus_queue.cc:1048] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:59.633867   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:01:59.635512   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:01:59.635862   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:01:59.648028  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913"
dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
mode: GRACEFUL
new_leader_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
 from {username='slave'} at 127.0.0.1:53486
I20260709 13:01:59.648865  9446 raft_consensus.cc:606] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Received request to transfer leadership to TS b7a8d1747cca45b8a9d347ab77a0daa1
I20260709 13:01:59.650408   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:01:59.797534  9672 raft_consensus.cc:993] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: : Instructing follower b7a8d1747cca45b8a9d347ab77a0daa1 to start an election
I20260709 13:01:59.798077  9673 raft_consensus.cc:1081] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Signalling peer b7a8d1747cca45b8a9d347ab77a0daa1 to start an election
I20260709 13:01:59.799573  9594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913"
dest_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1"
 from {username='slave'} at 127.0.0.1:34460
I20260709 13:01:59.800149  9594 raft_consensus.cc:493] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.800559  9594 raft_consensus.cc:3060] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.805856  9594 raft_consensus.cc:515] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:59.807511  9594 leader_election.cc:290] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [CANDIDATE]: Term 2 election: Requested vote from peers 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957), 262c3bc3f3d2455288c7d9b29405e878 (127.0.107.194:43497)
I20260709 13:01:59.808509  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913" candidate_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "490bdd6c3d1e4c638ec6da54266b69eb"
I20260709 13:01:59.808624  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23675a7f255f48709cc059cfa6e20913" candidate_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "262c3bc3f3d2455288c7d9b29405e878"
I20260709 13:01:59.809407  9520 raft_consensus.cc:3060] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.809397  9446 raft_consensus.cc:3055] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:59.809911  9446 raft_consensus.cc:740] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 490bdd6c3d1e4c638ec6da54266b69eb, State: Running, Role: LEADER
I20260709 13:01:59.810726  9446 consensus_queue.cc:260] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:59.812004  9446 raft_consensus.cc:3060] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.816884  9520 raft_consensus.cc:2468] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a8d1747cca45b8a9d347ab77a0daa1 in term 2.
I20260709 13:01:59.818372  9559 leader_election.cc:304] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 262c3bc3f3d2455288c7d9b29405e878, b7a8d1747cca45b8a9d347ab77a0daa1; no voters: 
I20260709 13:01:59.819087  9446 raft_consensus.cc:2468] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a8d1747cca45b8a9d347ab77a0daa1 in term 2.
I20260709 13:01:59.819208  9677 raft_consensus.cc:2804] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:59.820087  9677 raft_consensus.cc:697] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 LEADER]: Becoming Leader. State: Replica: b7a8d1747cca45b8a9d347ab77a0daa1, State: Running, Role: LEADER
I20260709 13:01:59.821376  9677 consensus_queue.cc:237] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } }
I20260709 13:01:59.827996  9341 catalog_manager.cc:5697] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 reported cstate change: term changed from 1 to 2, leader changed from 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193) to b7a8d1747cca45b8a9d347ab77a0daa1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490bdd6c3d1e4c638ec6da54266b69eb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "262c3bc3f3d2455288c7d9b29405e878" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.860927   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:01:59.864977  9594 raft_consensus.cc:1275] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Refusing update from remote peer 262c3bc3f3d2455288c7d9b29405e878: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:59.866365  9681 consensus_queue.cc:1048] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7a8d1747cca45b8a9d347ab77a0daa1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:59.889547  9486 consensus_peers.cc:597] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 -> Peer 490bdd6c3d1e4c638ec6da54266b69eb (127.0.107.193:33957): Couldn't send request to peer 490bdd6c3d1e4c638ec6da54266b69eb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:59.895298   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:59.895965   431 tablet_replica.cc:333] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb: stopping tablet replica
I20260709 13:01:59.896574   431 raft_consensus.cc:2243] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:59.897272   431 raft_consensus.cc:2272] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 490bdd6c3d1e4c638ec6da54266b69eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.899286   431 tablet_replica.cc:333] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb: stopping tablet replica
I20260709 13:01:59.899775   431 raft_consensus.cc:2243] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:59.900100   431 raft_consensus.cc:2272] T 23675a7f255f48709cc059cfa6e20913 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.902534   431 tablet_replica.cc:333] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb: stopping tablet replica
I20260709 13:01:59.903054   431 raft_consensus.cc:2243] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:59.903429   431 raft_consensus.cc:2272] T 65f6c806279640fa95fdaaf958737310 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.905228   431 tablet_replica.cc:333] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb: stopping tablet replica
I20260709 13:01:59.905653   431 raft_consensus.cc:2243] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:59.906388   431 raft_consensus.cc:2272] T 4b46c24539774a2d97fec48e67459dc9 P 490bdd6c3d1e4c638ec6da54266b69eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.929980   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:59.942129   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:01:59.959650   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:59.960397   431 tablet_replica.cc:333] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878: stopping tablet replica
I20260709 13:01:59.960959   431 raft_consensus.cc:2243] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:59.961421   431 raft_consensus.cc:2272] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P 262c3bc3f3d2455288c7d9b29405e878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.964198   431 tablet_replica.cc:333] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878: stopping tablet replica
I20260709 13:01:59.964843   431 raft_consensus.cc:2243] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:59.965281   431 raft_consensus.cc:2272] T 4b46c24539774a2d97fec48e67459dc9 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.967373   431 tablet_replica.cc:333] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878: stopping tablet replica
I20260709 13:01:59.967906   431 raft_consensus.cc:2243] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:59.968391   431 raft_consensus.cc:2272] T 23675a7f255f48709cc059cfa6e20913 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.970605   431 tablet_replica.cc:333] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878: stopping tablet replica
I20260709 13:01:59.971112   431 raft_consensus.cc:2243] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:59.971937   431 raft_consensus.cc:2272] T 65f6c806279640fa95fdaaf958737310 P 262c3bc3f3d2455288c7d9b29405e878 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.995350   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:00.007869   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:00.027428   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:00.028127   431 tablet_replica.cc:333] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1: stopping tablet replica
I20260709 13:02:00.028752   431 raft_consensus.cc:2243] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.029237   431 raft_consensus.cc:2272] T 1ae9e1daa6e04eac98faa4fe83d9bf7d P b7a8d1747cca45b8a9d347ab77a0daa1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.031915   431 tablet_replica.cc:333] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: stopping tablet replica
I20260709 13:02:00.032502   431 raft_consensus.cc:2243] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.033109   431 pending_rounds.cc:70] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: Trying to abort 1 pending ops.
I20260709 13:02:00.033313   431 pending_rounds.cc:77] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634282798538752 op_type: NO_OP noop_request { }
I20260709 13:02:00.033608   431 raft_consensus.cc:2889] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:00.033902   431 raft_consensus.cc:2272] T 23675a7f255f48709cc059cfa6e20913 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.036352   431 tablet_replica.cc:333] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1: stopping tablet replica
I20260709 13:02:00.036892   431 raft_consensus.cc:2243] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.037328   431 raft_consensus.cc:2272] T 65f6c806279640fa95fdaaf958737310 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.039717   431 tablet_replica.cc:333] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1: stopping tablet replica
I20260709 13:02:00.040208   431 raft_consensus.cc:2243] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.040674   431 raft_consensus.cc:2272] T 4b46c24539774a2d97fec48e67459dc9 P b7a8d1747cca45b8a9d347ab77a0daa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.063787   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:00.076213   431 master.cc:562] Master@127.0.107.254:42159 shutting down...
I20260709 13:02:00.091389   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.091977   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.092336   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P fa12161c86914a05bcc989d4f12c5bc8: stopping tablet replica
I20260709 13:02:00.110675   431 master.cc:584] Master@127.0.107.254:42159 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2753 ms)
[----------] 6 tests from LeaderRebalancerTest (255706 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:02:00.140944   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34449
I20260709 13:02:00.142098   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:00.147446  9693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.148149  9692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.149355   431 server_base.cc:1061] running on GCE node
W20260709 13:02:00.149238  9695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.150405   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:00.150640   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:00.150794   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602120150778 us; error 0 us; skew 500 ppm
I20260709 13:02:00.151355   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:00.153805   431 webserver.cc:533] Webserver started at http://127.0.107.254:36453/ using document root <none> and password file <none>
I20260709 13:02:00.154294   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:00.154517   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:00.154793   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:00.155866   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "572d7ac327b74327a29108eb270e7349"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.160825   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:02:00.164781  9700 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.165688   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:02:00.166007   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "572d7ac327b74327a29108eb270e7349"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.166277   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:00.191954   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:00.193163   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:00.228765   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34449
I20260709 13:02:00.228853  9751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34449 every 8 connection(s)
I20260709 13:02:00.232633  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.243307  9752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349: Bootstrap starting.
I20260709 13:02:00.247854  9752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.251910  9752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349: No bootstrap required, opened a new log
I20260709 13:02:00.254120  9752 raft_consensus.cc:359] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572d7ac327b74327a29108eb270e7349" member_type: VOTER }
I20260709 13:02:00.254509  9752 raft_consensus.cc:385] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.254788  9752 raft_consensus.cc:740] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572d7ac327b74327a29108eb270e7349, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.255445  9752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572d7ac327b74327a29108eb270e7349" member_type: VOTER }
I20260709 13:02:00.255934  9752 raft_consensus.cc:399] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:00.256143  9752 raft_consensus.cc:493] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:00.256493  9752 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.261308  9752 raft_consensus.cc:515] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572d7ac327b74327a29108eb270e7349" member_type: VOTER }
I20260709 13:02:00.261878  9752 leader_election.cc:304] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 572d7ac327b74327a29108eb270e7349; no voters: 
I20260709 13:02:00.263044  9752 leader_election.cc:290] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:00.263527  9755 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.265055  9755 raft_consensus.cc:697] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 1 LEADER]: Becoming Leader. State: Replica: 572d7ac327b74327a29108eb270e7349, State: Running, Role: LEADER
I20260709 13:02:00.265771  9755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572d7ac327b74327a29108eb270e7349" member_type: VOTER }
I20260709 13:02:00.266047  9752 sys_catalog.cc:565] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:00.269140  9757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 572d7ac327b74327a29108eb270e7349. Latest consensus state: current_term: 1 leader_uuid: "572d7ac327b74327a29108eb270e7349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572d7ac327b74327a29108eb270e7349" member_type: VOTER } }
I20260709 13:02:00.269094  9756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "572d7ac327b74327a29108eb270e7349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572d7ac327b74327a29108eb270e7349" member_type: VOTER } }
I20260709 13:02:00.269902  9756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:00.270509  9757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:00.274386  9760 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:00.279778  9760 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:00.282940   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:00.288658  9760 catalog_manager.cc:1383] Generated new cluster ID: efa4e6fff794481a821cdd918d83dd31
I20260709 13:02:00.288955  9760 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:00.305614  9760 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:00.306974  9760 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:00.332858  9760 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349: Generated new TSK 0
I20260709 13:02:00.333519  9760 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:00.350126   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:00.355888  9773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.357152  9774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.358983  9776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.359200   431 server_base.cc:1061] running on GCE node
I20260709 13:02:00.360213   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:00.360502   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:00.360680   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602120360663 us; error 0 us; skew 500 ppm
I20260709 13:02:00.361217   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:00.363464   431 webserver.cc:533] Webserver started at http://127.0.107.193:34835/ using document root <none> and password file <none>
I20260709 13:02:00.363945   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:00.364151   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:00.364565   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:00.365697   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.370617   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:00.373885  9781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.374616   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:00.374922   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.375195   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:00.401190   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:00.402375   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:00.403923   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:00.406236   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:00.406409   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.406706   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:00.406864   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.444448   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34227
I20260709 13:02:00.444546  9843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34227 every 8 connection(s)
I20260709 13:02:00.449482   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:00.455957  9848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.457322  9849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.460359  9851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.461244   431 server_base.cc:1061] running on GCE node
I20260709 13:02:00.463253   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:02:00.463325  9844 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
W20260709 13:02:00.463546   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:00.463771  9844 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:00.463788   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602120463767 us; error 0 us; skew 500 ppm
I20260709 13:02:00.464787   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:00.464787  9844 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:00.467396  9717 ts_manager.cc:194] Registered new tserver with Master: 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227)
I20260709 13:02:00.468097   431 webserver.cc:533] Webserver started at http://127.0.107.194:37569/ using document root <none> and password file <none>
I20260709 13:02:00.468746   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:00.468930   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:00.469219   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:00.469544  9717 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41526
I20260709 13:02:00.470317   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "0759fd38a97a44038af6a83f582c00b3"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.475415   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:00.478971  9856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.479687   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:00.479995   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "0759fd38a97a44038af6a83f582c00b3"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.480326   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:00.497802   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:00.498875   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:00.500357   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:00.502599   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:00.502825   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.503120   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:00.503305   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.541767   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45187
I20260709 13:02:00.541872  9918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45187 every 8 connection(s)
I20260709 13:02:00.546723   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:00.553789  9922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.555294  9923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.558141   431 server_base.cc:1061] running on GCE node
W20260709 13:02:00.558717  9925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.559458  9919 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:00.559828  9919 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:00.559849   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:00.560274   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:00.560470   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602120560454 us; error 0 us; skew 500 ppm
I20260709 13:02:00.560580  9919 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:00.561134   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:00.562582  9717 ts_manager.cc:194] Registered new tserver with Master: 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:00.564025   431 webserver.cc:533] Webserver started at http://127.0.107.195:41773/ using document root <none> and password file <none>
I20260709 13:02:00.564148  9717 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41528
I20260709 13:02:00.564747   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:00.564990   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:00.565289   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:00.566761   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "15f7695b2731408a917102458963b729"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.571396   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:02:00.574870  9930 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.575954   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:00.576370   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "15f7695b2731408a917102458963b729"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-vcr9"
I20260709 13:02:00.576666   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:00.605258   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:00.606329   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:00.607740   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:00.610014   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:00.610199   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.610491   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:00.610669   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:00.648499   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36469
I20260709 13:02:00.648622  9992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36469 every 8 connection(s)
I20260709 13:02:00.663190  9993 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:00.663733  9993 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:00.665122  9993 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:00.667119  9717 ts_manager.cc:194] Registered new tserver with Master: 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:00.667641   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015939503s
I20260709 13:02:00.668795  9717 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41538
I20260709 13:02:00.692162  9717 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41554:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:00.694887  9717 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:00.767648  9809 tablet_service.cc:1511] Processing CreateTablet for tablet 87f95fd36ed042ff809f0bddaf1b8b6e (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:00.769145  9809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f95fd36ed042ff809f0bddaf1b8b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.778194  9958 tablet_service.cc:1511] Processing CreateTablet for tablet 87f95fd36ed042ff809f0bddaf1b8b6e (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:00.778255  9808 tablet_service.cc:1511] Processing CreateTablet for tablet bf06f8f442d44235be93edcf2dcb62ba (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:00.779912  9958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f95fd36ed042ff809f0bddaf1b8b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.779912  9808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf06f8f442d44235be93edcf2dcb62ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.779975  9807 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba97ea993a548b28ac6ef9e4f46539a (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:00.781641  9807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba97ea993a548b28ac6ef9e4f46539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.784883  9806 tablet_service.cc:1511] Processing CreateTablet for tablet 9aad7a808f33496196cffc55eaca3f06 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:00.786267  9806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aad7a808f33496196cffc55eaca3f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.799003  9805 tablet_service.cc:1511] Processing CreateTablet for tablet 10fe6931cd7c43aa9056ab740cb02502 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:00.800583  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fe6931cd7c43aa9056ab740cb02502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.801890  9957 tablet_service.cc:1511] Processing CreateTablet for tablet bf06f8f442d44235be93edcf2dcb62ba (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:00.803355  9957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf06f8f442d44235be93edcf2dcb62ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.804557  9951 tablet_service.cc:1511] Processing CreateTablet for tablet bd6723897cc540539cd25d7edc455dfd (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:00.804834  9804 tablet_service.cc:1511] Processing CreateTablet for tablet c833bf469e0a459eb59ad466a794e3c6 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:00.805372  9956 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba97ea993a548b28ac6ef9e4f46539a (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:00.806025  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6723897cc540539cd25d7edc455dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.806232  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c833bf469e0a459eb59ad466a794e3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.806823  9956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba97ea993a548b28ac6ef9e4f46539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.808313  9950 tablet_service.cc:1511] Processing CreateTablet for tablet fe0e4d4c95f1495a8f137254738c8e02 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:00.808562  9955 tablet_service.cc:1511] Processing CreateTablet for tablet 9aad7a808f33496196cffc55eaca3f06 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:00.809636  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0e4d4c95f1495a8f137254738c8e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.810585  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 10fe6931cd7c43aa9056ab740cb02502 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:00.811468  9876 tablet_service.cc:1511] Processing CreateTablet for tablet fe0e4d4c95f1495a8f137254738c8e02 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:00.811940  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fe6931cd7c43aa9056ab740cb02502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.812851  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0e4d4c95f1495a8f137254738c8e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.813298  9953 tablet_service.cc:1511] Processing CreateTablet for tablet c833bf469e0a459eb59ad466a794e3c6 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:00.814198  9803 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff21ef07ff740d0914ce320a762f923 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:00.814905  9952 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff21ef07ff740d0914ce320a762f923 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:00.833079  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c833bf469e0a459eb59ad466a794e3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.833856  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff21ef07ff740d0914ce320a762f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.815865  9802 tablet_service.cc:1511] Processing CreateTablet for tablet bd6723897cc540539cd25d7edc455dfd (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:00.836555  9955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aad7a808f33496196cffc55eaca3f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.817481  9801 tablet_service.cc:1511] Processing CreateTablet for tablet fe0e4d4c95f1495a8f137254738c8e02 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:00.818967  9883 tablet_service.cc:1511] Processing CreateTablet for tablet bf06f8f442d44235be93edcf2dcb62ba (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:00.838300  9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf06f8f442d44235be93edcf2dcb62ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.821312  9880 tablet_service.cc:1511] Processing CreateTablet for tablet 10fe6931cd7c43aa9056ab740cb02502 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:00.841020  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fe6931cd7c43aa9056ab740cb02502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.823019  9879 tablet_service.cc:1511] Processing CreateTablet for tablet c833bf469e0a459eb59ad466a794e3c6 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:00.845049  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c833bf469e0a459eb59ad466a794e3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.824707  9878 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff21ef07ff740d0914ce320a762f923 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:00.849069  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff21ef07ff740d0914ce320a762f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.826382  9877 tablet_service.cc:1511] Processing CreateTablet for tablet bd6723897cc540539cd25d7edc455dfd (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:00.829032  9882 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba97ea993a548b28ac6ef9e4f46539a (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:00.828044  9881 tablet_service.cc:1511] Processing CreateTablet for tablet 9aad7a808f33496196cffc55eaca3f06 (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:00.817610  9884 tablet_service.cc:1511] Processing CreateTablet for tablet 87f95fd36ed042ff809f0bddaf1b8b6e (DEFAULT_TABLE table=test-workload [id=7793cabc07d14bef88d2e2c26d66b5bb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:00.853083  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6723897cc540539cd25d7edc455dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.854072  9881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aad7a808f33496196cffc55eaca3f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.833079  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff21ef07ff740d0914ce320a762f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.856453  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0e4d4c95f1495a8f137254738c8e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.858075  9884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f95fd36ed042ff809f0bddaf1b8b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.860567  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6723897cc540539cd25d7edc455dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.860975  9882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba97ea993a548b28ac6ef9e4f46539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:00.874045 10009 tablet_bootstrap.cc:492] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:00.945852 10009 tablet_bootstrap.cc:654] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.950701 10008 tablet_bootstrap.cc:492] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:00.966850 10010 tablet_bootstrap.cc:492] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:00.973096 10010 tablet_bootstrap.cc:654] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.979843 10009 tablet_bootstrap.cc:492] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:00.980396 10009 ts_tablet_manager.cc:1403] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.107s	user 0.004s	sys 0.010s
I20260709 13:02:00.984503 10009 raft_consensus.cc:359] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:00.985265 10009 raft_consensus.cc:385] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.985580 10009 raft_consensus.cc:740] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.986454 10009 consensus_queue.cc:260] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:00.995401 10008 tablet_bootstrap.cc:654] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.006522  9844 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:01.007114 10009 ts_tablet_manager.cc:1434] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 13:02:01.008379 10009 tablet_bootstrap.cc:492] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.012964 10010 tablet_bootstrap.cc:492] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.013582 10010 ts_tablet_manager.cc:1403] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.023s
I20260709 13:02:01.014654 10009 tablet_bootstrap.cc:654] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.017923 10010 raft_consensus.cc:359] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.019032 10010 raft_consensus.cc:385] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.019430 10010 raft_consensus.cc:740] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.020537 10008 tablet_bootstrap.cc:492] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.021198 10008 ts_tablet_manager.cc:1403] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.012s
I20260709 13:02:01.020629 10010 consensus_queue.cc:260] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.024531 10008 raft_consensus.cc:359] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.025408 10008 raft_consensus.cc:385] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.025763 10008 raft_consensus.cc:740] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.026777 10008 consensus_queue.cc:260] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.036211  9993 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:01.036693 10008 ts_tablet_manager.cc:1434] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:02:01.040932 10008 tablet_bootstrap.cc:492] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.047196 10008 tablet_bootstrap.cc:654] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.058655 10008 tablet_bootstrap.cc:492] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.059319 10008 ts_tablet_manager.cc:1403] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:02:01.062242 10008 raft_consensus.cc:359] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.065654  9919 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:01.065932 10008 raft_consensus.cc:385] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.066274 10008 raft_consensus.cc:740] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.066522 10009 tablet_bootstrap.cc:492] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.067091 10009 ts_tablet_manager.cc:1403] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.059s	user 0.031s	sys 0.025s
I20260709 13:02:01.067170 10008 consensus_queue.cc:260] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.069657 10008 ts_tablet_manager.cc:1434] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:01.070137 10009 raft_consensus.cc:359] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.070591 10008 tablet_bootstrap.cc:492] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.070920 10009 raft_consensus.cc:385] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.073289 10010 ts_tablet_manager.cc:1434] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.059s	user 0.016s	sys 0.035s
I20260709 13:02:01.073563 10009 raft_consensus.cc:740] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.074473 10010 tablet_bootstrap.cc:492] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.074473 10009 consensus_queue.cc:260] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.076887 10009 ts_tablet_manager.cc:1434] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:02:01.077886 10008 tablet_bootstrap.cc:654] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.077807 10009 tablet_bootstrap.cc:492] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.083913 10010 tablet_bootstrap.cc:654] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.087903 10009 tablet_bootstrap.cc:654] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.091024 10008 tablet_bootstrap.cc:492] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.091558 10008 ts_tablet_manager.cc:1403] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:02:01.093808 10010 tablet_bootstrap.cc:492] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.094695 10010 ts_tablet_manager.cc:1403] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:02:01.094458 10008 raft_consensus.cc:359] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.095265 10008 raft_consensus.cc:385] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.095573 10008 raft_consensus.cc:740] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.096478 10008 consensus_queue.cc:260] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.098696 10010 raft_consensus.cc:359] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.099768 10010 raft_consensus.cc:385] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.100137 10010 raft_consensus.cc:740] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.100639 10008 ts_tablet_manager.cc:1434] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:02:01.101768 10008 tablet_bootstrap.cc:492] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.101403 10010 consensus_queue.cc:260] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.105202 10010 ts_tablet_manager.cc:1434] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:01.106518 10010 tablet_bootstrap.cc:492] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.108649 10008 tablet_bootstrap.cc:654] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.114740 10017 raft_consensus.cc:493] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.114892 10010 tablet_bootstrap.cc:654] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.115391 10017 raft_consensus.cc:515] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.121695 10009 tablet_bootstrap.cc:492] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.122268 10009 ts_tablet_manager.cc:1403] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.045s	user 0.029s	sys 0.009s
I20260709 13:02:01.124979 10008 tablet_bootstrap.cc:492] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.125106 10009 raft_consensus.cc:359] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.125830 10008 ts_tablet_manager.cc:1403] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:02:01.126035 10009 raft_consensus.cc:385] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.126449 10009 raft_consensus.cc:740] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.127359 10009 consensus_queue.cc:260] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.129773 10009 ts_tablet_manager.cc:1434] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:01.129432 10008 raft_consensus.cc:359] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.130414 10008 raft_consensus.cc:385] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.130795 10008 raft_consensus.cc:740] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.130913 10009 tablet_bootstrap.cc:492] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.131875 10008 consensus_queue.cc:260] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.134646  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:01.135425  9819 raft_consensus.cc:2468] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:01.136875  9932 leader_election.cc:304] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.138477 10017 leader_election.cc:290] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.141839 10025 raft_consensus.cc:2804] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.143297 10009 tablet_bootstrap.cc:654] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.143334 10025 raft_consensus.cc:493] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.144722 10025 raft_consensus.cc:3060] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.145613 10013 raft_consensus.cc:493] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.147925 10013 raft_consensus.cc:515] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.153915 10024 raft_consensus.cc:493] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.154783 10024 raft_consensus.cc:515] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.154330 10013 leader_election.cc:290] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.160022  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0e4d4c95f1495a8f137254738c8e02" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
W20260709 13:02:01.162264  9932 leader_election.cc:343] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.164153 10024 leader_election.cc:290] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.171743 10008 ts_tablet_manager.cc:1434] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:02:01.183127 10008 tablet_bootstrap.cc:492] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.188133  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.189939  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0e4d4c95f1495a8f137254738c8e02" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.190744  9893 raft_consensus.cc:2468] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
W20260709 13:02:01.191988  9933 leader_election.cc:343] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.193338  9933 leader_election.cc:304] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.194239 10024 raft_consensus.cc:2804] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.194730 10024 raft_consensus.cc:493] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.194973 10008 tablet_bootstrap.cc:654] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.195178 10024 raft_consensus.cc:3060] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.206218 10010 tablet_bootstrap.cc:492] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.206470 10008 tablet_bootstrap.cc:492] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.206962 10010 ts_tablet_manager.cc:1403] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.101s	user 0.038s	sys 0.026s
I20260709 13:02:01.207015 10008 ts_tablet_manager.cc:1403] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.002s
I20260709 13:02:01.210307 10008 raft_consensus.cc:359] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.211299 10008 raft_consensus.cc:385] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.211642 10008 raft_consensus.cc:740] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.212697 10008 consensus_queue.cc:260] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.215004  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
W20260709 13:02:01.216719  9784 leader_election.cc:343] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.216400 10024 raft_consensus.cc:515] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.217654 10025 raft_consensus.cc:515] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.220322  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0e4d4c95f1495a8f137254738c8e02" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
W20260709 13:02:01.221750  9932 leader_election.cc:343] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.222383  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:01.223039  9819 raft_consensus.cc:3060] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.223930 10009 tablet_bootstrap.cc:492] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.224526 10009 ts_tablet_manager.cc:1403] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.094s	user 0.032s	sys 0.041s
I20260709 13:02:01.225286 10008 ts_tablet_manager.cc:1434] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:01.226881  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.227800 10009 raft_consensus.cc:359] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.228600 10009 raft_consensus.cc:385] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:01.228547  9784 leader_election.cc:343] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.229125 10009 raft_consensus.cc:740] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.229266  9784 leader_election.cc:304] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729
I20260709 13:02:01.229974 10009 consensus_queue.cc:260] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.230454 10013 raft_consensus.cc:2749] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.232527 10025 leader_election.cc:290] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.233886  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.235726 10010 raft_consensus.cc:359] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.236861 10010 raft_consensus.cc:385] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:01.236946  9933 leader_election.cc:343] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.237322 10010 raft_consensus.cc:740] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.238160 10008 tablet_bootstrap.cc:492] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.238305 10010 consensus_queue.cc:260] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.241887  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0e4d4c95f1495a8f137254738c8e02" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.242551  9893 raft_consensus.cc:3060] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.243719 10010 ts_tablet_manager.cc:1434] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:02:01.245170 10010 tablet_bootstrap.cc:492] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.239850  9819 raft_consensus.cc:2468] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.248733 10008 tablet_bootstrap.cc:654] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.240641 10024 leader_election.cc:290] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.249826  9932 leader_election.cc:304] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:01.251106 10024 raft_consensus.cc:2804] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.251848 10024 raft_consensus.cc:697] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:01.252815 10024 consensus_queue.cc:237] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.255030 10010 tablet_bootstrap.cc:654] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.256330 10032 raft_consensus.cc:493] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.257133 10032 raft_consensus.cc:515] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.257782 10009 ts_tablet_manager.cc:1434] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.019s
I20260709 13:02:01.259363 10009 tablet_bootstrap.cc:492] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.263875 10008 tablet_bootstrap.cc:492] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.264529 10008 ts_tablet_manager.cc:1403] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.002s
I20260709 13:02:01.265215  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.265990  9894 raft_consensus.cc:2468] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:01.267419  9784 leader_election.cc:304] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.268424 10013 raft_consensus.cc:2804] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.268929 10013 raft_consensus.cc:493] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.269093 10009 tablet_bootstrap.cc:654] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.269500 10013 raft_consensus.cc:3060] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.272169 10008 raft_consensus.cc:359] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.273152 10008 raft_consensus.cc:385] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.273442 10008 raft_consensus.cc:740] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.274394 10008 consensus_queue.cc:260] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.275796  9717 catalog_manager.cc:5697] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:01.278447  9765 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:01.278733 10008 ts_tablet_manager.cc:1434] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:02:01.280297 10024 raft_consensus.cc:493] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.280342 10008 tablet_bootstrap.cc:492] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.280913 10024 raft_consensus.cc:515] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.284123 10024 leader_election.cc:290] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.284864  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aad7a808f33496196cffc55eaca3f06" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:01.285568 10010 tablet_bootstrap.cc:492] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.286139 10010 ts_tablet_manager.cc:1403] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.011s
I20260709 13:02:01.286350  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aad7a808f33496196cffc55eaca3f06" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
W20260709 13:02:01.288130  9932 leader_election.cc:343] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:01.289227  9933 leader_election.cc:343] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.289711  9933 leader_election.cc:304] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15f7695b2731408a917102458963b729; no voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.290139 10008 tablet_bootstrap.cc:654] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.290890 10024 raft_consensus.cc:2749] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.289427 10010 raft_consensus.cc:359] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.291731 10010 raft_consensus.cc:385] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.292039 10010 raft_consensus.cc:740] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.292938 10010 consensus_queue.cc:260] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.295445 10010 ts_tablet_manager.cc:1434] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:01.295940 10024 raft_consensus.cc:493] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.296667 10010 tablet_bootstrap.cc:492] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.296490 10024 raft_consensus.cc:515] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.298731 10024 leader_election.cc:290] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.302368  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.302376  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:01.304153 10010 tablet_bootstrap.cc:654] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.304742  9819 raft_consensus.cc:2468] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:01.306496  9932 leader_election.cc:304] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.307209 10016 raft_consensus.cc:493] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.307696 10024 raft_consensus.cc:2804] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.308310 10024 raft_consensus.cc:493] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.307768 10016 raft_consensus.cc:515] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.308835 10024 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.308982  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.309720  9968 raft_consensus.cc:2468] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:01.311301 10032 leader_election.cc:290] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.313035 10016 leader_election.cc:290] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
W20260709 13:02:01.316864  9933 leader_election.cc:343] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.320540 10013 raft_consensus.cc:515] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.329316 10024 raft_consensus.cc:515] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.333278  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:01.334106  9819 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.322188 10008 tablet_bootstrap.cc:492] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.337626 10008 ts_tablet_manager.cc:1403] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.007s
I20260709 13:02:01.340417  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:01.341406  9968 raft_consensus.cc:3060] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.343367  9818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
W20260709 13:02:01.345570  9858 leader_election.cc:343] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.347550 10024 leader_election.cc:290] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.350018  9819 raft_consensus.cc:2468] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.351745  9932 leader_election.cc:304] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.354554 10024 raft_consensus.cc:2804] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.354305 10008 raft_consensus.cc:359] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.355259 10024 raft_consensus.cc:697] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:01.355459 10008 raft_consensus.cc:385] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.355973 10008 raft_consensus.cc:740] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.356415 10024 consensus_queue.cc:237] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.357054 10008 consensus_queue.cc:260] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.359915 10008 ts_tablet_manager.cc:1434] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:01.324267  9893 raft_consensus.cc:2468] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.361475 10008 tablet_bootstrap.cc:492] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.350562  9968 raft_consensus.cc:2468] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:01.363209 10013 leader_election.cc:290] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.363623  9784 leader_election.cc:304] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.365608 10013 raft_consensus.cc:2804] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.366281 10013 raft_consensus.cc:697] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:01.367101 10013 consensus_queue.cc:237] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.376364 10008 tablet_bootstrap.cc:654] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.376305  9933 leader_election.cc:304] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.377727 10024 raft_consensus.cc:2804] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.378499 10024 raft_consensus.cc:697] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:01.379420 10024 consensus_queue.cc:237] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.381589 10010 tablet_bootstrap.cc:492] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.383209  9716 catalog_manager.cc:5697] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.385238  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.386591  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.386759  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.387646 10009 tablet_bootstrap.cc:492] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.387600  9894 raft_consensus.cc:3060] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.388041 10010 ts_tablet_manager.cc:1403] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.025s
I20260709 13:02:01.388326 10009 ts_tablet_manager.cc:1403] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.129s	user 0.039s	sys 0.048s
I20260709 13:02:01.391598 10009 raft_consensus.cc:359] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.392375 10009 raft_consensus.cc:385] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.392715 10009 raft_consensus.cc:740] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.394284 10009 consensus_queue.cc:260] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.396694 10008 tablet_bootstrap.cc:492] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.396910 10010 raft_consensus.cc:359] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.397727 10010 raft_consensus.cc:385] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.398032 10010 raft_consensus.cc:740] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.398106 10009 ts_tablet_manager.cc:1434] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:02:01.399271 10009 tablet_bootstrap.cc:492] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.398898 10010 consensus_queue.cc:260] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.401516 10010 ts_tablet_manager.cc:1434] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:01.402596 10010 tablet_bootstrap.cc:492] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.403842 10008 ts_tablet_manager.cc:1403] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.008s
I20260709 13:02:01.405009 10024 raft_consensus.cc:493] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.405588 10024 raft_consensus.cc:515] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.407231 10008 raft_consensus.cc:359] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.408067 10008 raft_consensus.cc:385] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.408360 10008 raft_consensus.cc:740] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.408614  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:01.409287  9819 raft_consensus.cc:2468] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:01.409173 10008 consensus_queue.cc:260] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.409759 10009 tablet_bootstrap.cc:654] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.410758  9932 leader_election.cc:304] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.411351 10008 ts_tablet_manager.cc:1434] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:01.411629 10025 raft_consensus.cc:2804] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.412127 10025 raft_consensus.cc:493] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.412402 10008 tablet_bootstrap.cc:492] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:01.412515 10025 raft_consensus.cc:3060] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.413839 10010 tablet_bootstrap.cc:654] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.416111  9714 catalog_manager.cc:5697] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.425786  9714 catalog_manager.cc:5697] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.428557 10024 leader_election.cc:290] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.401551  9894 raft_consensus.cc:2468] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:01.427733 10008 tablet_bootstrap.cc:654] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:01.427958  9933 leader_election.cc:343] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.434964 10025 raft_consensus.cc:515] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
W20260709 13:02:01.428151  9859 leader_election.cc:343] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.439167  9859 leader_election.cc:304] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3; no voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.440372 10016 raft_consensus.cc:2749] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.442267  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.443367  9894 raft_consensus.cc:2468] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:01.449075  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:01.449844  9819 raft_consensus.cc:3060] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.458590  9819 raft_consensus.cc:2468] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.459268 10008 tablet_bootstrap.cc:492] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:01.459851 10008 ts_tablet_manager.cc:1403] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.020s
I20260709 13:02:01.459950  9932 leader_election.cc:304] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.461077 10024 raft_consensus.cc:2804] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.461536 10024 raft_consensus.cc:697] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:01.462349 10024 consensus_queue.cc:237] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.462729 10009 tablet_bootstrap.cc:492] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.462858 10008 raft_consensus.cc:359] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.463682 10009 ts_tablet_manager.cc:1403] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 13:02:01.463838 10008 raft_consensus.cc:385] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.464306 10008 raft_consensus.cc:740] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.465029 10008 consensus_queue.cc:260] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.467149 10008 ts_tablet_manager.cc:1434] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:01.469758 10025 leader_election.cc:290] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.472133 10009 raft_consensus.cc:359] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.472608  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.472982 10009 raft_consensus.cc:385] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.473222 10010 tablet_bootstrap.cc:492] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.473349 10009 raft_consensus.cc:740] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.473459  9894 raft_consensus.cc:3060] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.473810 10010 ts_tablet_manager.cc:1403] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.071s	user 0.044s	sys 0.012s
I20260709 13:02:01.474277 10009 consensus_queue.cc:260] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.475523  9715 catalog_manager.cc:5697] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.476734 10009 ts_tablet_manager.cc:1434] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:02:01.477381 10010 raft_consensus.cc:359] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.478282 10010 raft_consensus.cc:385] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.478590 10010 raft_consensus.cc:740] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.479478 10010 consensus_queue.cc:260] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.480262 10009 tablet_bootstrap.cc:492] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.483996  9894 raft_consensus.cc:2468] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.487524 10009 tablet_bootstrap.cc:654] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.489084 10010 ts_tablet_manager.cc:1434] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:02:01.490278 10010 tablet_bootstrap.cc:492] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.499056 10010 tablet_bootstrap.cc:654] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.502563 10009 tablet_bootstrap.cc:492] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.503098 10009 ts_tablet_manager.cc:1403] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:02:01.504045 10010 tablet_bootstrap.cc:492] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.504642 10010 ts_tablet_manager.cc:1403] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.002s
I20260709 13:02:01.506145 10009 raft_consensus.cc:359] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.506934 10009 raft_consensus.cc:385] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.507225 10009 raft_consensus.cc:740] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.507550 10010 raft_consensus.cc:359] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.507951 10016 raft_consensus.cc:493] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.508406 10010 raft_consensus.cc:385] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.508205 10009 consensus_queue.cc:260] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.508802 10010 raft_consensus.cc:740] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.508612 10016 raft_consensus.cc:515] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.509614 10010 consensus_queue.cc:260] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.510747 10016 leader_election.cc:290] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.510715 10009 ts_tablet_manager.cc:1434] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:02:01.511569  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:01.512195  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.512575  9819 raft_consensus.cc:2468] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:01.512926  9968 raft_consensus.cc:2468] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:01.513213 10009 tablet_bootstrap.cc:492] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.513898  9858 leader_election.cc:304] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.514901 10016 raft_consensus.cc:2804] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.515272 10016 raft_consensus.cc:493] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.515610 10016 raft_consensus.cc:3060] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.522716 10009 tablet_bootstrap.cc:654] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.524461 10016 raft_consensus.cc:515] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.527464  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:01.528093  9819 raft_consensus.cc:3060] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.534451 10010 ts_tablet_manager.cc:1434] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.019s
I20260709 13:02:01.535137  9819 raft_consensus.cc:2468] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:01.536374 10010 tablet_bootstrap.cc:492] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.536798  9858 leader_election.cc:304] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.539702 10009 tablet_bootstrap.cc:492] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.540355 10009 ts_tablet_manager.cc:1403] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:02:01.540457  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:01.541152  9968 raft_consensus.cc:3060] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.543350 10010 tablet_bootstrap.cc:654] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.543336 10009 raft_consensus.cc:359] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.544206 10009 raft_consensus.cc:385] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.544514 10016 leader_election.cc:290] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.544631 10009 raft_consensus.cc:740] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.543449 10054 raft_consensus.cc:2804] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.545966 10054 raft_consensus.cc:697] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:01.545694 10009 consensus_queue.cc:260] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.547150 10054 consensus_queue.cc:237] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.549564  9968 raft_consensus.cc:2468] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:01.554231 10009 ts_tablet_manager.cc:1434] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:02:01.555401 10009 tablet_bootstrap.cc:492] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:01.560109 10024 raft_consensus.cc:493] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.560750 10024 raft_consensus.cc:515] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.562860 10010 tablet_bootstrap.cc:492] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.562995 10024 leader_election.cc:290] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.563439 10010 ts_tablet_manager.cc:1403] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.008s
I20260709 13:02:01.565145  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.564916  9715 catalog_manager.cc:5697] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.565886  9894 raft_consensus.cc:2468] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:01.566808 10010 raft_consensus.cc:359] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.567939 10009 tablet_bootstrap.cc:654] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.567595 10010 raft_consensus.cc:385] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.567564  9933 leader_election.cc:304] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:01.565155  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:01.568665 10010 raft_consensus.cc:740] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.569038  9819 raft_consensus.cc:2468] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:01.569289 10024 raft_consensus.cc:2804] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.569437 10010 consensus_queue.cc:260] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.569952 10024 raft_consensus.cc:493] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.570387 10024 raft_consensus.cc:3060] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.571559 10010 ts_tablet_manager.cc:1434] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:01.572662 10010 tablet_bootstrap.cc:492] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:01.574440 10009 tablet_bootstrap.cc:492] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:01.574993 10009 ts_tablet_manager.cc:1403] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:02:01.577294 10010 tablet_bootstrap.cc:654] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.577898 10009 raft_consensus.cc:359] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.578363 10024 raft_consensus.cc:515] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.578832 10009 raft_consensus.cc:385] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.579113 10009 raft_consensus.cc:740] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.581341 10024 leader_election.cc:290] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:01.581717  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.582480  9894 raft_consensus.cc:3060] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.582783  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:01.583462  9819 raft_consensus.cc:3060] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.579934 10009 consensus_queue.cc:260] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.584595 10010 tablet_bootstrap.cc:492] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:01.585108 10010 ts_tablet_manager.cc:1403] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 13:02:01.586989 10009 ts_tablet_manager.cc:1434] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:02:01.591542  9819 raft_consensus.cc:2468] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.592423 10010 raft_consensus.cc:359] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.592890  9932 leader_election.cc:304] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.593233 10010 raft_consensus.cc:385] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.593544 10010 raft_consensus.cc:740] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.593891 10024 raft_consensus.cc:2804] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.594363 10010 consensus_queue.cc:260] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.594441 10024 raft_consensus.cc:697] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:01.597075  9894 raft_consensus.cc:2468] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:01.597486 10010 ts_tablet_manager.cc:1434] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:01.597981 10024 consensus_queue.cc:237] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.606985  9716 catalog_manager.cc:5697] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.614085 10013 raft_consensus.cc:493] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.614614 10013 raft_consensus.cc:515] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.616482 10013 leader_election.cc:290] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.617259  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.617448  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.617992  9894 raft_consensus.cc:2468] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:01.617996  9968 raft_consensus.cc:2468] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:01.619132  9784 leader_election.cc:304] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.619716 10013 raft_consensus.cc:2804] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.620045 10013 raft_consensus.cc:493] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.620496 10013 raft_consensus.cc:3060] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.625988 10013 raft_consensus.cc:515] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.627588 10013 leader_election.cc:290] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.628587  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.628902  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:01.629351  9894 raft_consensus.cc:3060] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.629462  9968 raft_consensus.cc:3060] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.636706  9894 raft_consensus.cc:2468] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:01.636706  9968 raft_consensus.cc:2468] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:01.638116  9784 leader_election.cc:304] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.638860 10013 raft_consensus.cc:2804] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.639317 10013 raft_consensus.cc:697] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:01.640144 10013 consensus_queue.cc:237] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.647493  9716 catalog_manager.cc:5697] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.660820 10013 raft_consensus.cc:493] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.661358 10013 raft_consensus.cc:515] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.663036 10013 leader_election.cc:290] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.663817  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aad7a808f33496196cffc55eaca3f06" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.664007  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aad7a808f33496196cffc55eaca3f06" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.664489  9894 raft_consensus.cc:2468] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:01.664669  9968 raft_consensus.cc:2468] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:01.665457  9784 leader_election.cc:304] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.666147 10013 raft_consensus.cc:2804] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.666508 10013 raft_consensus.cc:493] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.666931 10013 raft_consensus.cc:3060] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.672037 10013 raft_consensus.cc:515] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.673851 10013 leader_election.cc:290] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.674506  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aad7a808f33496196cffc55eaca3f06" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:01.674839  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aad7a808f33496196cffc55eaca3f06" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:01.675082  9894 raft_consensus.cc:3060] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.675490  9968 raft_consensus.cc:3060] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.680603  9968 raft_consensus.cc:2468] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:01.680603  9894 raft_consensus.cc:2468] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:01.681666  9784 leader_election.cc:304] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:01.682411 10013 raft_consensus.cc:2804] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.682847 10013 raft_consensus.cc:697] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:01.683569 10013 consensus_queue.cc:237] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.687688  9894 raft_consensus.cc:3060] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.691241  9716 catalog_manager.cc:5697] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.694373 10024 consensus_queue.cc:1048] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.706404 10017 consensus_queue.cc:1048] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.760679 10013 raft_consensus.cc:493] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.761211 10013 raft_consensus.cc:515] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:01.763054 10013 leader_election.cc:290] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:01.763936  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0e4d4c95f1495a8f137254738c8e02" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:01.764032  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0e4d4c95f1495a8f137254738c8e02" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:01.764994  9894 raft_consensus.cc:2393] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93f454af9a2f4c9a9c2c88c1755e75ac in current term 1: Already voted for candidate 15f7695b2731408a917102458963b729 in this term.
I20260709 13:02:01.765465  9893 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.765960  9784 leader_election.cc:304] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729
I20260709 13:02:01.766870 10013 raft_consensus.cc:3060] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.772035 10013 raft_consensus.cc:2749] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.772840 10017 consensus_queue.cc:1048] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.783520 10025 consensus_queue.cc:1048] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.849416 10025 consensus_queue.cc:1048] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.859143 10032 consensus_queue.cc:1048] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.860985 10017 consensus_queue.cc:1048] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.863449  9967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e"
dest_uuid: "15f7695b2731408a917102458963b729"
mode: GRACEFUL
new_leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:02:01.864136  9967 raft_consensus.cc:606] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Received request to transfer leadership to TS 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.866394 10013 consensus_queue.cc:1048] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:01.871134  9967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba"
dest_uuid: "15f7695b2731408a917102458963b729"
mode: GRACEFUL
new_leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:02:01.871917  9967 raft_consensus.cc:606] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Received request to transfer leadership to TS 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.879693  9967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a"
dest_uuid: "15f7695b2731408a917102458963b729"
mode: GRACEFUL
new_leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:02:01.880313  9967 raft_consensus.cc:606] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Received request to transfer leadership to TS 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:01.899875 10024 consensus_queue.cc:1048] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.922128 10017 consensus_queue.cc:1048] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.923888  9819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
mode: GRACEFUL
new_leader_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:37744
I20260709 13:02:01.924687  9819 raft_consensus.cc:606] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Received request to transfer leadership to TS 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:01.934619  9819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
mode: GRACEFUL
new_leader_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:37744
I20260709 13:02:01.935243  9819 raft_consensus.cc:606] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Received request to transfer leadership to TS 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:01.941504  9968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd"
dest_uuid: "15f7695b2731408a917102458963b729"
mode: GRACEFUL
new_leader_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:02:01.942359  9968 raft_consensus.cc:606] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Received request to transfer leadership to TS 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:02.033417 10054 consensus_queue.cc:1048] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.043953 10054 consensus_queue.cc:1048] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.094928 10025 consensus_queue.cc:1048] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.101351 10017 raft_consensus.cc:993] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: : Instructing follower 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:02.101854 10024 raft_consensus.cc:1081] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Signalling peer 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:02.104411  9818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:37720
I20260709 13:02:02.105017  9818 raft_consensus.cc:493] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.105409  9818 raft_consensus.cc:3060] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.107203 10017 consensus_queue.cc:1048] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.113508  9818 raft_consensus.cc:515] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.115664  9818 leader_election.cc:290] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:02.116747  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:02.117151  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f95fd36ed042ff809f0bddaf1b8b6e" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:02.117434  9968 raft_consensus.cc:3055] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.117753  9968 raft_consensus.cc:740] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:02.117779  9893 raft_consensus.cc:3060] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.118664  9968 consensus_queue.cc:260] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.119415  9968 raft_consensus.cc:3060] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.125432  9968 raft_consensus.cc:2468] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:02.125586  9893 raft_consensus.cc:2468] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:02.126509  9784 leader_election.cc:304] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:02.127341 10013 raft_consensus.cc:2804] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.127889 10013 raft_consensus.cc:697] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:02.128764 10013 consensus_queue.cc:237] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.133379 10013 consensus_queue.cc:1048] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.135907  9716 catalog_manager.cc:5697] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 1 to 2, leader changed from 15f7695b2731408a917102458963b729 (127.0.107.195) to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.144320 10032 consensus_queue.cc:1048] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:02.155205 10032 raft_consensus.cc:993] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: : Instructing follower 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:02.155699 10032 raft_consensus.cc:1081] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Signalling peer 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:02.157553  9893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923"
dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:02:02.158205  9893 raft_consensus.cc:493] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.158617  9893 raft_consensus.cc:3060] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.164076  9893 raft_consensus.cc:515] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.165568 10084 consensus_queue.cc:1048] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:02.166281  9893 leader_election.cc:290] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:02.166926  9818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:02.167572  9818 raft_consensus.cc:3055] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.167896  9818 raft_consensus.cc:740] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:02.168300  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff21ef07ff740d0914ce320a762f923" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:02.168946  9968 raft_consensus.cc:3060] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.168705  9818 consensus_queue.cc:260] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.169965  9818 raft_consensus.cc:3060] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.176616  9968 raft_consensus.cc:2468] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:02.177953  9859 leader_election.cc:304] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:02.178790 10054 raft_consensus.cc:2804] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.179129  9818 raft_consensus.cc:2468] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:02.179318 10054 raft_consensus.cc:697] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:02.180488 10054 consensus_queue.cc:237] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.192202 10013 consensus_queue.cc:1048] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.200124 10024 raft_consensus.cc:993] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: : Instructing follower 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:02.200707 10024 raft_consensus.cc:1081] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Signalling peer 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:02.199810  9713 catalog_manager.cc:5697] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 1 to 2, leader changed from 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193) to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.202466  9818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:37720
I20260709 13:02:02.203011  9818 raft_consensus.cc:493] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.203373  9818 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.212723  9818 raft_consensus.cc:515] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.215095  9818 leader_election.cc:290] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:02.215813  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:02.216218  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:02.216588  9893 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.216919  9968 raft_consensus.cc:3055] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.217303  9968 raft_consensus.cc:740] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:02.218101  9968 consensus_queue.cc:260] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.219038  9968 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.223356  9893 raft_consensus.cc:2468] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:02.224674  9784 leader_election.cc:304] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:02.225457 10013 raft_consensus.cc:2804] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.225602  9968 raft_consensus.cc:2468] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:02.225904 10013 raft_consensus.cc:697] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:02.227069 10013 consensus_queue.cc:237] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.233502  9716 catalog_manager.cc:5697] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 1 to 2, leader changed from 15f7695b2731408a917102458963b729 (127.0.107.195) to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.290639 10017 raft_consensus.cc:993] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: : Instructing follower 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:02.291152 10025 raft_consensus.cc:1081] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Signalling peer 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:02.292632  9893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd"
dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:36822
I20260709 13:02:02.293239  9893 raft_consensus.cc:493] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.293608  9893 raft_consensus.cc:3060] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.297111 10032 raft_consensus.cc:993] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: : Instructing follower 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:02.297696 10013 raft_consensus.cc:1081] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Signalling peer 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:02.299258  9894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6"
dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:02:02.299743  9894 raft_consensus.cc:493] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.300058  9894 raft_consensus.cc:3060] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.300570  9893 raft_consensus.cc:515] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.302271  9893 leader_election.cc:290] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:02.303231  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:02.303879  9968 raft_consensus.cc:3055] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.303155  9818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6723897cc540539cd25d7edc455dfd" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:02.304399  9968 raft_consensus.cc:740] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:02.304683  9818 raft_consensus.cc:3060] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.305303  9968 consensus_queue.cc:260] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.306625  9968 raft_consensus.cc:3060] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.306373  9894 raft_consensus.cc:515] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.308800  9894 leader_election.cc:290] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:02.309605  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:02.310238  9819 raft_consensus.cc:3055] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.310565  9819 raft_consensus.cc:740] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:02.311345  9819 consensus_queue.cc:260] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.312335  9818 raft_consensus.cc:2468] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:02.314514  9858 leader_election.cc:304] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:02.315193 10054 raft_consensus.cc:2804] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.315649 10025 raft_consensus.cc:993] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: : Instructing follower 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:02.316027  9819 raft_consensus.cc:3060] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.316156 10025 raft_consensus.cc:1081] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Signalling peer 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:02.315666 10054 raft_consensus.cc:697] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:02.317744 10054 consensus_queue.cc:237] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.318143  9817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:37720
I20260709 13:02:02.318717  9817 raft_consensus.cc:493] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.319061  9817 raft_consensus.cc:3060] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.323115  9819 raft_consensus.cc:2468] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:02.314538  9968 raft_consensus.cc:2468] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:02.324548  9858 leader_election.cc:304] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:02.325448 10054 raft_consensus.cc:2804] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.326120 10054 raft_consensus.cc:697] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:02.326830  9817 raft_consensus.cc:515] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.326874  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c833bf469e0a459eb59ad466a794e3c6" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:02.326996 10054 consensus_queue.cc:237] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.328054  9968 raft_consensus.cc:3060] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.327029  9716 catalog_manager.cc:5697] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 1 to 2, leader changed from 15f7695b2731408a917102458963b729 (127.0.107.195) to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.330411  9817 leader_election.cc:290] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:02.330636  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:02.331367  9967 raft_consensus.cc:3055] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.331696  9967 raft_consensus.cc:740] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:02.332248  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf06f8f442d44235be93edcf2dcb62ba" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:02.332855  9894 raft_consensus.cc:3060] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.340103  9968 raft_consensus.cc:2468] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:02.340909  9967 consensus_queue.cc:260] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.342229  9967 raft_consensus.cc:3060] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.343127  9894 raft_consensus.cc:2468] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:02.344197  9784 leader_election.cc:304] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:02.344971 10013 raft_consensus.cc:2804] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.345489 10013 raft_consensus.cc:697] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:02.346259 10013 consensus_queue.cc:237] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:02.349258  9967 raft_consensus.cc:2468] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:02.350250  9716 catalog_manager.cc:5697] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 1 to 2, leader changed from 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193) to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.353545  9713 catalog_manager.cc:5697] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 1 to 2, leader changed from 15f7695b2731408a917102458963b729 (127.0.107.195) to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.582614  9967 raft_consensus.cc:1275] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.584417 10054 consensus_queue.cc:1048] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.592974  9894 raft_consensus.cc:1275] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.602573  9817 raft_consensus.cc:1275] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.604252 10013 consensus_queue.cc:1048] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.605353 10089 consensus_queue.cc:1048] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.622483  9968 raft_consensus.cc:1275] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.625169 10084 consensus_queue.cc:1048] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.698520  9968 raft_consensus.cc:1275] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.700186 10079 consensus_queue.cc:1048] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.710544  9817 raft_consensus.cc:1275] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.713107 10089 consensus_queue.cc:1048] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.721022  9968 raft_consensus.cc:1275] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.722973 10084 consensus_queue.cc:1048] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.734884  9894 raft_consensus.cc:1275] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.736989 10032 consensus_queue.cc:1048] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.765522  9817 raft_consensus.cc:1275] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.766868 10089 consensus_queue.cc:1048] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.778803  9968 raft_consensus.cc:1275] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.780305 10016 consensus_queue.cc:1048] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.849534  9894 raft_consensus.cc:1275] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.850965 10032 consensus_queue.cc:1048] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.854550  9968 raft_consensus.cc:1275] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.856014 10032 consensus_queue.cc:1048] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:04.977687  9716 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41558:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:04.980536  9716 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:05.041143  9803 tablet_service.cc:1511] Processing CreateTablet for tablet 138375b17d89465ea500f9f2b597664b (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:05.042761  9881 tablet_service.cc:1511] Processing CreateTablet for tablet 138375b17d89465ea500f9f2b597664b (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:05.043195  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138375b17d89465ea500f9f2b597664b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.044543  9881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138375b17d89465ea500f9f2b597664b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.047346  9882 tablet_service.cc:1511] Processing CreateTablet for tablet a1f7cbcf58fe44ee8cf658dfb392cda9 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:05.049088  9882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f7cbcf58fe44ee8cf658dfb392cda9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.049165  9801 tablet_service.cc:1511] Processing CreateTablet for tablet a1f7cbcf58fe44ee8cf658dfb392cda9 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:05.050717  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f7cbcf58fe44ee8cf658dfb392cda9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.055822  9952 tablet_service.cc:1511] Processing CreateTablet for tablet a1f7cbcf58fe44ee8cf658dfb392cda9 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:05.057503  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f7cbcf58fe44ee8cf658dfb392cda9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.061556  9958 tablet_service.cc:1511] Processing CreateTablet for tablet 2362c51fede6485188fdfafe4a24f5aa (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:05.062356  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 2362c51fede6485188fdfafe4a24f5aa (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:05.063082  9958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2362c51fede6485188fdfafe4a24f5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.063802  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2362c51fede6485188fdfafe4a24f5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.066708  9883 tablet_service.cc:1511] Processing CreateTablet for tablet 2362c51fede6485188fdfafe4a24f5aa (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:05.069551  9880 tablet_service.cc:1511] Processing CreateTablet for tablet b0b3e556034b411086c9ff30ea89c593 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:05.044145  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 138375b17d89465ea500f9f2b597664b (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:05.071770  9883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2362c51fede6485188fdfafe4a24f5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.074581  9802 tablet_service.cc:1511] Processing CreateTablet for tablet b0b3e556034b411086c9ff30ea89c593 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:05.076172  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b3e556034b411086c9ff30ea89c593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.076390  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b3e556034b411086c9ff30ea89c593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.081142 10103 tablet_bootstrap.cc:492] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.083175  9953 tablet_service.cc:1511] Processing CreateTablet for tablet b0b3e556034b411086c9ff30ea89c593 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:05.085566  9955 tablet_service.cc:1511] Processing CreateTablet for tablet dfc46c44bd404d3ea3008955814755fd (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:05.085695  9878 tablet_service.cc:1511] Processing CreateTablet for tablet dfc46c44bd404d3ea3008955814755fd (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:05.087303  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc46c44bd404d3ea3008955814755fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.089768  9957 tablet_service.cc:1511] Processing CreateTablet for tablet 9609d18207fe4571b4d069e464cc272f (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:05.090106  9950 tablet_service.cc:1511] Processing CreateTablet for tablet ce157a994b9740bc8939488c7492c702 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:05.091910  9877 tablet_service.cc:1511] Processing CreateTablet for tablet ce157a994b9740bc8939488c7492c702 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:05.092334  9956 tablet_service.cc:1511] Processing CreateTablet for tablet 7923dc54eac449fa82428dec1fdc1ba5 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:05.092465  9884 tablet_service.cc:1511] Processing CreateTablet for tablet 7923dc54eac449fa82428dec1fdc1ba5 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:05.093436  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce157a994b9740bc8939488c7492c702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.094138  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138375b17d89465ea500f9f2b597664b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.095263  9951 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0e532c3659440d8f102bf0a4f93a87 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:05.097153  9884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7923dc54eac449fa82428dec1fdc1ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.102533  9879 tablet_service.cc:1511] Processing CreateTablet for tablet 9609d18207fe4571b4d069e464cc272f (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:05.103174  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b3e556034b411086c9ff30ea89c593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.104571  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9609d18207fe4571b4d069e464cc272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.109246  9956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7923dc54eac449fa82428dec1fdc1ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.112864  9955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc46c44bd404d3ea3008955814755fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.116971  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce157a994b9740bc8939488c7492c702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.118070  9876 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0e532c3659440d8f102bf0a4f93a87 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:05.119448  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0e532c3659440d8f102bf0a4f93a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.119544  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0e532c3659440d8f102bf0a4f93a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.122200  9957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9609d18207fe4571b4d069e464cc272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.126317  9803 tablet_service.cc:1511] Processing CreateTablet for tablet dfc46c44bd404d3ea3008955814755fd (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:05.127879  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc46c44bd404d3ea3008955814755fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.127926  9806 tablet_service.cc:1511] Processing CreateTablet for tablet ce157a994b9740bc8939488c7492c702 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:05.129716  9806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce157a994b9740bc8939488c7492c702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.090165 10103 tablet_bootstrap.cc:654] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.176873  9805 tablet_service.cc:1511] Processing CreateTablet for tablet 7923dc54eac449fa82428dec1fdc1ba5 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:05.178433  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7923dc54eac449fa82428dec1fdc1ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.179250  9807 tablet_service.cc:1511] Processing CreateTablet for tablet 9609d18207fe4571b4d069e464cc272f (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:05.180725  9807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9609d18207fe4571b4d069e464cc272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.184116  9808 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0e532c3659440d8f102bf0a4f93a87 (DEFAULT_TABLE table=soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:05.185513  9808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0e532c3659440d8f102bf0a4f93a87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:05.170819  9702 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:34227, user_credentials={real_user=slave}} blocked reactor thread for 44724.8us
I20260709 13:02:05.272569 10107 tablet_bootstrap.cc:492] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.293860 10103 tablet_bootstrap.cc:492] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.294575 10103 ts_tablet_manager.cc:1403] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.024s
I20260709 13:02:05.298408 10107 tablet_bootstrap.cc:654] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.303224 10103 raft_consensus.cc:359] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.303925 10103 raft_consensus.cc:385] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.304354 10103 raft_consensus.cc:740] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.305640 10103 consensus_queue.cc:260] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.307821 10108 tablet_bootstrap.cc:492] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.315204 10108 tablet_bootstrap.cc:654] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.318048 10103 ts_tablet_manager.cc:1434] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:02:05.319197 10103 tablet_bootstrap.cc:492] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
W20260709 13:02:05.321635  9765 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:05.327097 10107 tablet_bootstrap.cc:492] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.328011 10107 ts_tablet_manager.cc:1403] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.011s
I20260709 13:02:05.328896 10103 tablet_bootstrap.cc:654] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.331169 10107 raft_consensus.cc:359] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.331980 10107 raft_consensus.cc:385] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.332027 10108 tablet_bootstrap.cc:492] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.332383 10107 raft_consensus.cc:740] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.332866 10108 ts_tablet_manager.cc:1403] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 13:02:05.333351 10107 consensus_queue.cc:260] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.336184 10107 ts_tablet_manager.cc:1434] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:05.337245 10107 tablet_bootstrap.cc:492] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.337231 10108 raft_consensus.cc:359] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.338498 10108 raft_consensus.cc:385] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.338907 10108 raft_consensus.cc:740] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.340621 10108 consensus_queue.cc:260] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.345322 10107 tablet_bootstrap.cc:654] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.357734 10107 tablet_bootstrap.cc:492] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.358280 10107 ts_tablet_manager.cc:1403] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:02:05.358580 10108 ts_tablet_manager.cc:1434] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.005s
I20260709 13:02:05.358800 10103 tablet_bootstrap.cc:492] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.359400 10103 ts_tablet_manager.cc:1403] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.019s
I20260709 13:02:05.359732 10108 tablet_bootstrap.cc:492] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.361534 10107 raft_consensus.cc:359] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.362306 10107 raft_consensus.cc:385] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.362640 10107 raft_consensus.cc:740] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.362500 10103 raft_consensus.cc:359] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.363349 10103 raft_consensus.cc:385] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.363668 10103 raft_consensus.cc:740] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.363610 10107 consensus_queue.cc:260] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.366389 10107 ts_tablet_manager.cc:1434] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:05.367492 10108 tablet_bootstrap.cc:654] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.367560 10107 tablet_bootstrap.cc:492] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.368589 10103 consensus_queue.cc:260] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.371161 10103 ts_tablet_manager.cc:1434] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:05.372279 10103 tablet_bootstrap.cc:492] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.375590 10107 tablet_bootstrap.cc:654] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.386509 10103 tablet_bootstrap.cc:654] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.389792 10104 raft_consensus.cc:493] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.393071 10104 raft_consensus.cc:515] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.394778 10107 tablet_bootstrap.cc:492] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.395418 10107 ts_tablet_manager.cc:1403] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.010s
I20260709 13:02:05.395665 10104 leader_election.cc:290] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.396641 10103 tablet_bootstrap.cc:492] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.397116 10108 tablet_bootstrap.cc:492] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.397250 10103 ts_tablet_manager.cc:1403] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 13:02:05.397748 10108 ts_tablet_manager.cc:1403] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.019s
I20260709 13:02:05.397672  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce157a994b9740bc8939488c7492c702" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:05.398770 10107 raft_consensus.cc:359] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.399621 10107 raft_consensus.cc:385] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:05.399716  9858 leader_election.cc:343] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.399977 10107 raft_consensus.cc:740] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.400827 10107 consensus_queue.cc:260] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.401063 10103 raft_consensus.cc:359] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.401551  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce157a994b9740bc8939488c7492c702" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.402026 10103 raft_consensus.cc:385] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.401288 10108 raft_consensus.cc:359] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.402412 10103 raft_consensus.cc:740] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.402599 10108 raft_consensus.cc:385] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.402941 10108 raft_consensus.cc:740] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.403262 10107 ts_tablet_manager.cc:1434] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:05.403383 10103 consensus_queue.cc:260] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.403874 10108 consensus_queue.cc:260] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.404626 10107 tablet_bootstrap.cc:492] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.408182 10103 ts_tablet_manager.cc:1434] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:02:05.409700 10103 tablet_bootstrap.cc:492] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.410838 10108 ts_tablet_manager.cc:1434] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:05.411942 10108 tablet_bootstrap.cc:492] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.413216 10107 tablet_bootstrap.cc:654] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.414278  9968 raft_consensus.cc:2468] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:05.418908 10103 tablet_bootstrap.cc:654] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.422595 10104 raft_consensus.cc:493] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.423378 10104 raft_consensus.cc:515] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.427088 10104 leader_election.cc:290] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.429780  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.430127 10108 tablet_bootstrap.cc:654] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.430604  9967 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:05.433391  9859 leader_election.cc:304] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:05.434635 10104 raft_consensus.cc:2804] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.435158 10104 raft_consensus.cc:493] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.435505 10104 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.437621 10103 tablet_bootstrap.cc:492] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.438472 10103 ts_tablet_manager.cc:1403] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:02:05.441220 10108 tablet_bootstrap.cc:492] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.441835 10108 ts_tablet_manager.cc:1403] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:02:05.441990 10103 raft_consensus.cc:359] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.442940 10103 raft_consensus.cc:385] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.443306 10103 raft_consensus.cc:740] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.444283 10103 consensus_queue.cc:260] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.445188 10108 raft_consensus.cc:359] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.445976 10108 raft_consensus.cc:385] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.446278 10108 raft_consensus.cc:740] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.447419 10103 ts_tablet_manager.cc:1434] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:05.447273 10108 consensus_queue.cc:260] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.448725 10103 tablet_bootstrap.cc:492] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.446869  9859 leader_election.cc:304] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:05.450068 10108 ts_tablet_manager.cc:1434] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:05.429920  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:05.450748 10016 raft_consensus.cc:2804] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.451452 10016 raft_consensus.cc:493] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.451663 10108 tablet_bootstrap.cc:492] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.451946 10016 raft_consensus.cc:3060] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.450798  9817 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:05.456982 10103 tablet_bootstrap.cc:654] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.459672 10108 tablet_bootstrap.cc:654] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.472424 10108 tablet_bootstrap.cc:492] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.472424 10103 tablet_bootstrap.cc:492] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.473080 10103 ts_tablet_manager.cc:1403] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.010s
I20260709 13:02:05.473080 10108 ts_tablet_manager.cc:1403] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:02:05.476609 10103 raft_consensus.cc:359] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.477121 10105 raft_consensus.cc:493] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.477437 10103 raft_consensus.cc:385] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.477885 10103 raft_consensus.cc:740] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.477737 10105 raft_consensus.cc:515] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.478719 10103 consensus_queue.cc:260] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.480280 10105 leader_election.cc:290] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.482100 10108 raft_consensus.cc:359] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.482887 10108 raft_consensus.cc:385] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.482970  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:05.483199 10108 raft_consensus.cc:740] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.484212 10108 consensus_queue.cc:260] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
W20260709 13:02:05.484735  9784 leader_election.cc:343] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.487054 10108 ts_tablet_manager.cc:1434] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:05.487771  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.488116 10108 tablet_bootstrap.cc:492] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: Bootstrap starting.
W20260709 13:02:05.493382  9784 leader_election.cc:343] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.493847  9784 leader_election.cc:304] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729
I20260709 13:02:05.495092 10092 raft_consensus.cc:2749] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.481449 10103 ts_tablet_manager.cc:1434] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:02:05.489955 10105 raft_consensus.cc:493] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.498157 10105 raft_consensus.cc:515] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.500124 10108 tablet_bootstrap.cc:654] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.504562  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3e556034b411086c9ff30ea89c593" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.506714  9968 raft_consensus.cc:2468] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:05.500744 10105 leader_election.cc:290] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.500993 10025 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.502041 10104 raft_consensus.cc:515] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.501456  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3e556034b411086c9ff30ea89c593" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:05.509156 10025 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
W20260709 13:02:05.510736  9784 leader_election.cc:343] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.511864 10025 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:05.513082  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:05.513192  9784 leader_election.cc:304] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:05.508304 10103 tablet_bootstrap.cc:492] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.517503 10092 raft_consensus.cc:2804] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.517910 10092 raft_consensus.cc:493] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.518258 10092 raft_consensus.cc:3060] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.521265  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:05.522010  9819 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.513505  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:05.529536 10104 leader_election.cc:290] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.530117  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:05.530745  9968 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.502708 10016 raft_consensus.cc:515] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.533214 10107 tablet_bootstrap.cc:492] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.533948 10107 ts_tablet_manager.cc:1403] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.130s	user 0.032s	sys 0.052s
I20260709 13:02:05.535588 10016 leader_election.cc:290] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
W20260709 13:02:05.514853  9933 leader_election.cc:343] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.536329  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce157a994b9740bc8939488c7492c702" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
W20260709 13:02:05.537137  9932 leader_election.cc:343] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.537454  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce157a994b9740bc8939488c7492c702" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
W20260709 13:02:05.537956  9858 leader_election.cc:343] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.538234  9967 raft_consensus.cc:3060] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.538441  9932 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15f7695b2731408a917102458963b729; no voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:05.539644 10025 raft_consensus.cc:2749] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.540340  9819 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:05.541893  9858 leader_election.cc:304] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:05.545331 10107 raft_consensus.cc:359] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.546108 10107 raft_consensus.cc:385] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.546392 10107 raft_consensus.cc:740] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.547235 10107 consensus_queue.cc:260] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.546860 10016 raft_consensus.cc:2804] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.549990 10016 raft_consensus.cc:697] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:05.551507 10107 ts_tablet_manager.cc:1434] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 13:02:05.551944 10016 consensus_queue.cc:237] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.555933 10107 tablet_bootstrap.cc:492] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.556099  9968 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:05.557106 10103 tablet_bootstrap.cc:654] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.556638 10104 raft_consensus.cc:493] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.558164 10104 raft_consensus.cc:515] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.561302  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc46c44bd404d3ea3008955814755fd" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:05.562044  9819 raft_consensus.cc:2468] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:05.563678  9858 leader_election.cc:304] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:05.563839 10108 tablet_bootstrap.cc:492] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.564663 10108 ts_tablet_manager.cc:1403] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.003s
I20260709 13:02:05.564991 10107 tablet_bootstrap.cc:654] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.564670 10121 raft_consensus.cc:2804] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.566123 10121 raft_consensus.cc:493] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.566454 10121 raft_consensus.cc:3060] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.568053 10108 raft_consensus.cc:359] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.569479 10108 raft_consensus.cc:385] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.555789 10092 raft_consensus.cc:515] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.569857 10108 raft_consensus.cc:740] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.571257 10108 consensus_queue.cc:260] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.573869 10108 ts_tablet_manager.cc:1434] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:05.575258 10104 leader_election.cc:290] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.583576 10121 raft_consensus.cc:515] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.573968 10092 leader_election.cc:290] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.576174  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3e556034b411086c9ff30ea89c593" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:05.585455  9968 raft_consensus.cc:3060] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.588114 10121 leader_election.cc:290] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.588104  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc46c44bd404d3ea3008955814755fd" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
W20260709 13:02:05.590054  9859 leader_election.cc:343] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.590255 10108 tablet_bootstrap.cc:492] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.578724  9966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc46c44bd404d3ea3008955814755fd" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.578630  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3e556034b411086c9ff30ea89c593" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
W20260709 13:02:05.593762  9859 leader_election.cc:343] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.594887  9784 leader_election.cc:343] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.577924  9967 raft_consensus.cc:2468] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:05.596607  9859 leader_election.cc:304] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:05.602831 10121 raft_consensus.cc:2804] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.618609 10121 raft_consensus.cc:697] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:05.620890 10121 consensus_queue.cc:237] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.625787  9968 raft_consensus.cc:2468] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:05.628770 10103 tablet_bootstrap.cc:492] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.630240 10103 ts_tablet_manager.cc:1403] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.014s
W20260709 13:02:05.632688  9858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34227, user_credentials={real_user=slave}} blocked reactor thread for 69075.5us
I20260709 13:02:05.633316  9784 leader_election.cc:304] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:05.634469  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc46c44bd404d3ea3008955814755fd" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:05.635149  9819 raft_consensus.cc:3060] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.636085 10107 tablet_bootstrap.cc:492] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.636412 10092 raft_consensus.cc:2804] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.636662 10107 ts_tablet_manager.cc:1403] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.083s	user 0.057s	sys 0.015s
I20260709 13:02:05.636997 10092 raft_consensus.cc:697] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:05.637907 10092 consensus_queue.cc:237] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.639986 10107 raft_consensus.cc:359] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.640811 10107 raft_consensus.cc:385] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.641085 10107 raft_consensus.cc:740] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.642081 10107 consensus_queue.cc:260] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.644520 10107 ts_tablet_manager.cc:1434] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:05.627993 10108 tablet_bootstrap.cc:654] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.633320 10103 raft_consensus.cc:359] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.651022 10121 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.657764 10103 raft_consensus.cc:385] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.660826  9819 raft_consensus.cc:2468] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:05.667704 10107 tablet_bootstrap.cc:492] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.668148 10103 raft_consensus.cc:740] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.669735  9858 leader_election.cc:304] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 15f7695b2731408a917102458963b729
I20260709 13:02:05.670889 10124 raft_consensus.cc:2804] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.674467 10103 consensus_queue.cc:260] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.674491 10124 raft_consensus.cc:697] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:05.677381 10124 consensus_queue.cc:237] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.658298 10121 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.703495 10121 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.710296  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.710246  9716 catalog_manager.cc:5697] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.711544  9968 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 0.
I20260709 13:02:05.714138 10107 tablet_bootstrap.cc:654] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.715049  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:05.715649  9713 catalog_manager.cc:5697] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.716754 10108 tablet_bootstrap.cc:492] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.717759 10108 ts_tablet_manager.cc:1403] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.010s
I20260709 13:02:05.717402  9713 catalog_manager.cc:5697] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:05.720711  9858 leader_election.cc:343] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.722388 10103 ts_tablet_manager.cc:1434] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.012s
I20260709 13:02:05.723582  9859 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:05.723650 10103 tablet_bootstrap.cc:492] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.724820 10108 raft_consensus.cc:359] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.727145 10124 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.727402 10108 raft_consensus.cc:385] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.727691 10124 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.727958 10108 raft_consensus.cc:740] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.728149 10124 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.729128 10108 consensus_queue.cc:260] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.732031 10108 ts_tablet_manager.cc:1434] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:05.733109 10108 tablet_bootstrap.cc:492] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.739984 10124 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.742404 10124 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.744314 10108 tablet_bootstrap.cc:654] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.747768 10103 tablet_bootstrap.cc:654] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.751701  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:05.756740  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:05.759127  9967 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.764961 10092 raft_consensus.cc:493] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.765764 10092 raft_consensus.cc:515] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.769168 10092 leader_election.cc:290] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.772002  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7cbcf58fe44ee8cf658dfb392cda9" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:05.772506  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7cbcf58fe44ee8cf658dfb392cda9" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:05.773057  9893 raft_consensus.cc:2468] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:05.774818  9784 leader_election.cc:304] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:05.776168 10128 raft_consensus.cc:2804] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.776683 10128 raft_consensus.cc:493] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.777063 10128 raft_consensus.cc:3060] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:05.778225  9858 leader_election.cc:343] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.776182  9784 leader_election.cc:343] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.788692 10128 raft_consensus.cc:515] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.794543  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7cbcf58fe44ee8cf658dfb392cda9" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:05.795382  9893 raft_consensus.cc:3060] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.797209  9967 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 1.
I20260709 13:02:05.800808  9859 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:05.803586 10124 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.804129 10124 raft_consensus.cc:697] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:05.804999 10124 consensus_queue.cc:237] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.808203 10103 tablet_bootstrap.cc:492] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.808804 10103 ts_tablet_manager.cc:1403] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.017s
I20260709 13:02:05.810091 10108 tablet_bootstrap.cc:492] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.810510 10108 ts_tablet_manager.cc:1403] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.014s
I20260709 13:02:05.811843 10103 raft_consensus.cc:359] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.812628 10103 raft_consensus.cc:385] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.812901 10103 raft_consensus.cc:740] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.812911 10108 raft_consensus.cc:359] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.813752 10108 raft_consensus.cc:385] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.814039 10108 raft_consensus.cc:740] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.814852 10108 consensus_queue.cc:260] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.817606 10107 tablet_bootstrap.cc:492] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.818187 10107 ts_tablet_manager.cc:1403] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.151s	user 0.040s	sys 0.027s
I20260709 13:02:05.817637  9713 catalog_manager.cc:5697] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.821200 10107 raft_consensus.cc:359] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.821954 10107 raft_consensus.cc:385] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.822221 10107 raft_consensus.cc:740] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.819974 10128 leader_election.cc:290] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:05.823293 10025 raft_consensus.cc:493] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.823083 10107 consensus_queue.cc:260] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.823408  9893 raft_consensus.cc:2468] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:05.824061  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7cbcf58fe44ee8cf658dfb392cda9" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:05.823885 10025 raft_consensus.cc:515] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.825699 10107 ts_tablet_manager.cc:1434] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:05.826444  9784 leader_election.cc:304] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:05.826987 10107 tablet_bootstrap.cc:492] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
W20260709 13:02:05.827400  9784 leader_election.cc:343] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15f7695b2731408a917102458963b729 (127.0.107.195:36469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.828127  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0e532c3659440d8f102bf0a4f93a87" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:05.828680 10092 raft_consensus.cc:2804] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.828816  9819 raft_consensus.cc:2468] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:05.829245 10092 raft_consensus.cc:697] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:05.825802 10108 ts_tablet_manager.cc:1434] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:02:05.830564 10108 tablet_bootstrap.cc:492] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.830184 10092 consensus_queue.cc:237] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.830204 10103 consensus_queue.cc:260] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.833257  9932 leader_election.cc:304] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:05.838285 10108 tablet_bootstrap.cc:654] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.841133 10141 raft_consensus.cc:2804] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.843041 10141 raft_consensus.cc:493] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.843967 10141 raft_consensus.cc:3060] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.846042 10107 tablet_bootstrap.cc:654] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.848193  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0e532c3659440d8f102bf0a4f93a87" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
W20260709 13:02:05.851441  9933 leader_election.cc:343] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.826997 10025 leader_election.cc:290] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:05.859573 10103 ts_tablet_manager.cc:1434] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.006s
I20260709 13:02:05.860836 10103 tablet_bootstrap.cc:492] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.861189  9713 catalog_manager.cc:5697] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.862711 10141 raft_consensus.cc:515] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.865890 10141 leader_election.cc:290] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:05.871140 10107 tablet_bootstrap.cc:492] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.872001 10107 ts_tablet_manager.cc:1403] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.004s
I20260709 13:02:05.872177 10103 tablet_bootstrap.cc:654] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.873138  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0e532c3659440d8f102bf0a4f93a87" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:05.876358  9819 raft_consensus.cc:3060] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.876555 10107 raft_consensus.cc:359] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.877763 10107 raft_consensus.cc:385] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.878172 10107 raft_consensus.cc:740] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.879168 10107 consensus_queue.cc:260] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.881735 10107 ts_tablet_manager.cc:1434] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:02:05.883325 10107 tablet_bootstrap.cc:492] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.885615  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0e532c3659440d8f102bf0a4f93a87" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:05.886620  9893 raft_consensus.cc:3060] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.887161  9715 catalog_manager.cc:5697] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.902799 10107 tablet_bootstrap.cc:654] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.906996  9893 raft_consensus.cc:2468] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:05.908953  9933 leader_election.cc:304] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:05.910286 10141 raft_consensus.cc:2804] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.910910 10141 raft_consensus.cc:697] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:05.912029 10141 consensus_queue.cc:237] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.936304  9716 catalog_manager.cc:5697] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.938094  9819 raft_consensus.cc:2468] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:05.944115 10107 tablet_bootstrap.cc:492] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:05.945012 10107 ts_tablet_manager.cc:1403] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.000s
I20260709 13:02:05.949038 10107 raft_consensus.cc:359] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.950062 10107 raft_consensus.cc:385] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.950420 10107 raft_consensus.cc:740] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.951375 10107 consensus_queue.cc:260] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.954761 10107 ts_tablet_manager.cc:1434] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:05.956131 10107 tablet_bootstrap.cc:492] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: Bootstrap starting.
I20260709 13:02:05.959369 10108 tablet_bootstrap.cc:492] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.959982 10108 ts_tablet_manager.cc:1403] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.130s	user 0.045s	sys 0.061s
I20260709 13:02:05.962884 10108 raft_consensus.cc:359] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.963567 10108 raft_consensus.cc:385] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.963745 10107 tablet_bootstrap.cc:654] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.963855 10108 raft_consensus.cc:740] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.964692 10108 consensus_queue.cc:260] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.966763 10108 ts_tablet_manager.cc:1434] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:05.969705 10124 consensus_queue.cc:1048] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.970467 10108 tablet_bootstrap.cc:492] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: Bootstrap starting.
I20260709 13:02:05.974037 10103 tablet_bootstrap.cc:492] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:05.974959 10103 ts_tablet_manager.cc:1403] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.114s	user 0.034s	sys 0.056s
I20260709 13:02:05.978924 10108 tablet_bootstrap.cc:654] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.979562 10103 raft_consensus.cc:359] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.980815 10103 raft_consensus.cc:385] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.981261 10103 raft_consensus.cc:740] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.982374 10103 consensus_queue.cc:260] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.985725 10103 ts_tablet_manager.cc:1434] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:05.987547 10103 tablet_bootstrap.cc:492] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: Bootstrap starting.
I20260709 13:02:05.990306 10108 tablet_bootstrap.cc:492] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: No bootstrap required, opened a new log
I20260709 13:02:05.990897 10108 ts_tablet_manager.cc:1403] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:02:05.992340 10124 consensus_queue.cc:1048] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.993736 10108 raft_consensus.cc:359] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.994477 10108 raft_consensus.cc:385] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.994786 10108 raft_consensus.cc:740] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.995529 10108 consensus_queue.cc:260] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:05.996845 10103 tablet_bootstrap.cc:654] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.997641 10108 ts_tablet_manager.cc:1434] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:05.999984 10141 raft_consensus.cc:493] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.000617 10141 raft_consensus.cc:515] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.002785 10141 leader_election.cc:290] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:06.004670  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:06.005396  9817 raft_consensus.cc:2468] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 0.
I20260709 13:02:06.007716  9932 leader_election.cc:304] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:06.010564  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
W20260709 13:02:06.013271  9933 leader_election.cc:343] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.014596 10141 raft_consensus.cc:2804] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.015311 10141 raft_consensus.cc:493] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.016155 10141 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.037518 10103 tablet_bootstrap.cc:492] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: No bootstrap required, opened a new log
I20260709 13:02:06.038421 10103 ts_tablet_manager.cc:1403] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.018s
I20260709 13:02:06.042541 10103 raft_consensus.cc:359] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.043586 10103 raft_consensus.cc:385] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.043946 10103 raft_consensus.cc:740] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.045188  9817 raft_consensus.cc:3060] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.045125 10103 consensus_queue.cc:260] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.048059 10103 ts_tablet_manager.cc:1434] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:02:06.058146 10025 raft_consensus.cc:493] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.058781 10025 raft_consensus.cc:515] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.061305 10025 leader_election.cc:290] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:06.062325  9818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc46c44bd404d3ea3008955814755fd" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:06.063207  9818 raft_consensus.cc:2393] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15f7695b2731408a917102458963b729 in current term 1: Already voted for candidate 0759fd38a97a44038af6a83f582c00b3 in this term.
I20260709 13:02:06.065685  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc46c44bd404d3ea3008955814755fd" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:06.059111 10141 raft_consensus.cc:515] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.067214  9933 leader_election.cc:304] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15f7695b2731408a917102458963b729; no voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:06.070363 10025 raft_consensus.cc:3060] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.072199 10141 leader_election.cc:290] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:06.073836 10140 consensus_queue.cc:1048] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.074517 10016 consensus_queue.cc:1048] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.079757 10025 raft_consensus.cc:2749] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.080855 10025 raft_consensus.cc:493] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.081439 10025 raft_consensus.cc:515] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.084169 10025 leader_election.cc:290] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:06.086932  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:06.087955  9819 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.092389  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:06.087025 10107 tablet_bootstrap.cc:492] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: No bootstrap required, opened a new log
I20260709 13:02:06.093714  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7cbcf58fe44ee8cf658dfb392cda9" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:06.094620 10107 ts_tablet_manager.cc:1403] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: Time spent bootstrapping tablet: real 0.139s	user 0.054s	sys 0.051s
I20260709 13:02:06.094826  9894 raft_consensus.cc:2393] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15f7695b2731408a917102458963b729 in current term 1: Already voted for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in this term.
W20260709 13:02:06.097337  9933 leader_election.cc:343] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.097234 10107 raft_consensus.cc:359] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.098070 10107 raft_consensus.cc:385] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.098372 10107 raft_consensus.cc:740] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.099098 10107 consensus_queue.cc:260] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.103551 10016 consensus_queue.cc:1048] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.108832 10107 ts_tablet_manager.cc:1434] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:06.116447  9818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7cbcf58fe44ee8cf658dfb392cda9" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:06.117264  9819 raft_consensus.cc:2468] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 1.
I20260709 13:02:06.118841  9932 leader_election.cc:304] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15f7695b2731408a917102458963b729; no voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:06.120087  9932 leader_election.cc:304] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:06.120369 10155 raft_consensus.cc:3060] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.121659 10141 raft_consensus.cc:2804] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.122153 10141 raft_consensus.cc:697] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:06.122996 10141 consensus_queue.cc:237] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.128162 10155 raft_consensus.cc:2749] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.137809  9893 raft_consensus.cc:3060] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.145897  9713 catalog_manager.cc:5697] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:06.147397 10140 consensus_queue.cc:1048] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.175045 10016 consensus_queue.cc:1048] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.175828 10140 raft_consensus.cc:493] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.176476 10140 raft_consensus.cc:515] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.178589 10140 leader_election.cc:290] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.179643  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:06.179481  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:06.180451  9967 raft_consensus.cc:2468] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:06.180687  9893 raft_consensus.cc:2468] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 0.
I20260709 13:02:06.181643  9784 leader_election.cc:304] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:06.182564 10140 raft_consensus.cc:2804] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.182940 10140 raft_consensus.cc:493] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.183292 10140 raft_consensus.cc:3060] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.191114 10016 consensus_queue.cc:1048] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.191645 10140 raft_consensus.cc:515] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.193806 10140 leader_election.cc:290] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.197572  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:06.198194  9968 raft_consensus.cc:3060] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.198479  9819 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.199875  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:06.200758  9893 raft_consensus.cc:3060] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.207846 10105 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.208429 10105 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.209770  9968 raft_consensus.cc:2468] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:06.210858 10016 consensus_queue.cc:1048] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.211196  9784 leader_election.cc:304] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:06.212007 10128 raft_consensus.cc:2804] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.212360 10105 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.212522 10128 raft_consensus.cc:697] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:06.213418 10128 consensus_queue.cc:237] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.213809  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:06.215729  9893 raft_consensus.cc:2468] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:06.218010  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:06.218726  9968 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 1.
I20260709 13:02:06.219720  9784 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:06.220948 10092 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:06.221326 10092 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0759fd38a97a44038af6a83f582c00b3)
I20260709 13:02:06.221684 10092 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.226140 10016 consensus_queue.cc:1048] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.229120 10092 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.231310 10092 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.231808  9819 raft_consensus.cc:1240] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Rejecting Update request from peer 0759fd38a97a44038af6a83f582c00b3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:06.233806  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:06.233978  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:06.235845  9784 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729
I20260709 13:02:06.236877 10092 raft_consensus.cc:2749] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:06.236930 10016 consensus_queue.cc:1059] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.238178 10121 raft_consensus.cc:3055] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:06.238684 10121 raft_consensus.cc:740] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:06.239814 10121 consensus_queue.cc:260] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.243445 10121 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.252893  9713 catalog_manager.cc:5697] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 1 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.314985 10128 consensus_queue.cc:1048] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.331717 10105 consensus_queue.cc:1048] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.359944 10141 consensus_queue.cc:1048] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.372167 10171 consensus_queue.cc:1048] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.464781  9968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "138375b17d89465ea500f9f2b597664b"
dest_uuid: "15f7695b2731408a917102458963b729"
mode: GRACEFUL
new_leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:02:06.465512  9968 raft_consensus.cc:606] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Received request to transfer leadership to TS 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:06.484392  9893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa"
dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
mode: GRACEFUL
new_leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:02:06.484953  9893 raft_consensus.cc:606] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Received request to transfer leadership to TS 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:06.502197  9819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
mode: GRACEFUL
new_leader_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:37744
I20260709 13:02:06.502730  9819 raft_consensus.cc:606] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Received request to transfer leadership to TS 0759fd38a97a44038af6a83f582c00b3
I20260709 13:02:06.534619 10121 raft_consensus.cc:993] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: : Instructing follower 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:06.535174 10121 raft_consensus.cc:1081] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Signalling peer 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:06.537051  9819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:37736
I20260709 13:02:06.537631  9819 raft_consensus.cc:493] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:06.537933  9819 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.544350  9819 raft_consensus.cc:515] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.545995  9819 leader_election.cc:290] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.547037  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:06.547252  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:06.548048  9893 raft_consensus.cc:3055] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:06.548331  9968 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.548385  9893 raft_consensus.cc:740] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:06.549585  9893 consensus_queue.cc:260] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.550604  9893 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.554070  9968 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:06.555478  9784 leader_election.cc:304] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:06.555774  9893 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:06.556196 10105 raft_consensus.cc:2804] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:06.556813 10105 raft_consensus.cc:697] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:06.556986 10121 raft_consensus.cc:493] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.557512 10121 raft_consensus.cc:515] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.557670 10105 consensus_queue.cc:237] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.559820 10121 leader_election.cc:290] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.560635  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:06.561594  9819 raft_consensus.cc:2393] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0759fd38a97a44038af6a83f582c00b3 in current term 1: Already voted for candidate 15f7695b2731408a917102458963b729 in this term.
I20260709 13:02:06.561453  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:06.562959  9858 leader_election.cc:304] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3; no voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:06.564178 10121 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.568113  9716 catalog_manager.cc:5697] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 1 to 2, leader changed from 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194) to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.570840 10121 raft_consensus.cc:2749] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.612123 10171 consensus_queue.cc:1048] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.612350 10092 consensus_queue.cc:1048] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.615456 10105 consensus_queue.cc:1048] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.628216 10092 raft_consensus.cc:993] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: : Instructing follower 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:06.628760 10140 raft_consensus.cc:1081] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Signalling peer 0759fd38a97a44038af6a83f582c00b3 to start an election
I20260709 13:02:06.631618 10171 raft_consensus.cc:993] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: : Instructing follower 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:06.632035 10171 raft_consensus.cc:1081] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Signalling peer 93f454af9a2f4c9a9c2c88c1755e75ac to start an election
I20260709 13:02:06.633541  9894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f"
dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:02:06.635836  9894 raft_consensus.cc:493] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:06.636219  9818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "138375b17d89465ea500f9f2b597664b"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
 from {username='slave'} at 127.0.0.1:37720
I20260709 13:02:06.636906  9818 raft_consensus.cc:493] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:06.637246  9818 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.636327  9894 raft_consensus.cc:3060] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.646623  9894 raft_consensus.cc:515] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.654187 10141 consensus_queue.cc:1048] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.661460  9818 raft_consensus.cc:515] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.662690  9894 leader_election.cc:290] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.663692  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:06.665370  9968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9609d18207fe4571b4d069e464cc272f" candidate_uuid: "0759fd38a97a44038af6a83f582c00b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:06.674767  9817 raft_consensus.cc:3055] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:06.674913  9968 raft_consensus.cc:3060] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.665370  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:06.675993  9893 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.673828  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:06.676865  9967 raft_consensus.cc:3055] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:06.677187  9967 raft_consensus.cc:740] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:06.678035  9967 consensus_queue.cc:260] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.679184  9967 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.673243  9818 leader_election.cc:290] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:06.675256  9817 raft_consensus.cc:740] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:06.681097  9817 consensus_queue.cc:260] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.682372  9817 raft_consensus.cc:3060] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.684279  9968 raft_consensus.cc:2468] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:06.685484  9859 leader_election.cc:304] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:06.686265 10124 raft_consensus.cc:2804] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:06.686949 10124 raft_consensus.cc:697] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Becoming Leader. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:06.687840 10124 consensus_queue.cc:237] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.689167  9893 raft_consensus.cc:2468] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:06.690445  9784 leader_election.cc:304] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:06.663839  9819 raft_consensus.cc:1240] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Rejecting Update request from peer 15f7695b2731408a917102458963b729 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:06.691447  9967 raft_consensus.cc:2468] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:06.691938 10140 raft_consensus.cc:2804] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:06.693209 10140 raft_consensus.cc:697] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:06.694082 10140 consensus_queue.cc:237] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:06.696169  9817 raft_consensus.cc:2468] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0759fd38a97a44038af6a83f582c00b3 in term 2.
I20260709 13:02:06.701274  9716 catalog_manager.cc:5697] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 reported cstate change: term changed from 1 to 2, leader changed from 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193) to 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0759fd38a97a44038af6a83f582c00b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.701912  9715 catalog_manager.cc:5697] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 1 to 2, leader changed from 15f7695b2731408a917102458963b729 (127.0.107.195) to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 2 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.086869  9967 raft_consensus.cc:1275] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.088213 10140 consensus_queue.cc:1048] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:07.097043  9894 raft_consensus.cc:1275] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.099287 10092 consensus_queue.cc:1048] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:07.161931  9967 raft_consensus.cc:1275] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.163091 10092 consensus_queue.cc:1048] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:07.172442  9894 raft_consensus.cc:1275] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.174046 10092 consensus_queue.cc:1048] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:07.193111  9817 raft_consensus.cc:1275] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.194252 10104 consensus_queue.cc:1048] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:07.211967  9967 raft_consensus.cc:1275] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Refusing update from remote peer 0759fd38a97a44038af6a83f582c00b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:07.215386 10016 consensus_queue.cc:1048] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:07.730191 10171 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0759fd38a97a44038af6a83f582c00b3)
I20260709 13:02:07.730646 10171 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:07.732390 10171 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:07.733261  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" is_pre_election: true
I20260709 13:02:07.733407  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:07.734055  9819 raft_consensus.cc:2393] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15f7695b2731408a917102458963b729 in current term 2: Already voted for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in this term.
I20260709 13:02:07.734072  9894 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 2.
I20260709 13:02:07.735291  9933 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:07.735975 10171 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:07.736366 10171 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0759fd38a97a44038af6a83f582c00b3)
I20260709 13:02:07.736686 10171 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:07.742063 10171 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:07.743877 10171 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 2 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:07.744655  9819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:07.744881  9894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:07.745344  9819 raft_consensus.cc:2393] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 15f7695b2731408a917102458963b729 in current term 2: Already voted for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in this term.
I20260709 13:02:07.750106  9894 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 2.
I20260709 13:02:07.751430  9933 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 93f454af9a2f4c9a9c2c88c1755e75ac
I20260709 13:02:07.752210 10171 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:07.753147 10171 raft_consensus.cc:697] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 2 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:07.754021 10171 consensus_queue.cc:237] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:07.761343  9715 catalog_manager.cc:5697] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 1 to 2, leader changed from 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194) to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.098743 10140 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.099318 10140 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:08.101250 10140 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:08.102072  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3" is_pre_election: true
I20260709 13:02:08.102262  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729" is_pre_election: true
I20260709 13:02:08.102661  9893 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 2.
I20260709 13:02:08.103624  9784 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:08.104281 10140 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:08.104592 10140 raft_consensus.cc:493] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.104862 10140 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:08.110028 10140 raft_consensus.cc:515] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:08.111865 10140 leader_election.cc:290] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 3 election: Requested vote from peers 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187), 15f7695b2731408a917102458963b729 (127.0.107.195:36469)
I20260709 13:02:08.112589  9893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:08.112890  9967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7923dc54eac449fa82428dec1fdc1ba5" candidate_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15f7695b2731408a917102458963b729"
I20260709 13:02:08.113199  9893 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:08.118113  9893 raft_consensus.cc:2468] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f454af9a2f4c9a9c2c88c1755e75ac in term 3.
I20260709 13:02:08.119239  9784 leader_election.cc:304] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 15f7695b2731408a917102458963b729
I20260709 13:02:08.120069 10140 raft_consensus.cc:2804] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:08.120631 10140 raft_consensus.cc:697] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 LEADER]: Becoming Leader. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:08.121402 10140 consensus_queue.cc:237] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:08.128420  9715 catalog_manager.cc:5697] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac reported cstate change: term changed from 2 to 3, leader changed from 15f7695b2731408a917102458963b729 (127.0.107.195) to 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193). New cstate: current_term: 3 leader_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.231562  9893 raft_consensus.cc:1240] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Rejecting Update request from peer 15f7695b2731408a917102458963b729 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:08.232982 10171 consensus_queue.cc:1059] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:08.233692 10184 raft_consensus.cc:3055] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:08.234050 10184 raft_consensus.cc:740] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:08.234772 10184 consensus_queue.cc:260] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:08.235770 10184 raft_consensus.cc:3060] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:08.669623  9893 raft_consensus.cc:1275] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:08.671178 10140 consensus_queue.cc:1048] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:08.678131  9968 raft_consensus.cc:1275] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Refusing update from remote peer 93f454af9a2f4c9a9c2c88c1755e75ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:08.678527  9968 pending_rounds.cc:85] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Aborting all ops after (but not including) 1
I20260709 13:02:08.678786  9968 pending_rounds.cc:107] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:08.679073  9968 raft_consensus.cc:2889] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.683629 10196 consensus_queue.cc:1048] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:09.509867  9713 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41558:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:09.531680  9713 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41558:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:09.581959   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:02:09.672817 10237 tablet.cc:1724] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.682914 10235 tablet.cc:1724] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.675980 10242 tablet.cc:1724] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.678030 10240 tablet.cc:1724] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.649456 10233 tablet.cc:1724] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.804716 10248 tablet.cc:1724] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.847134 10249 tablet.cc:1724] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.872107 10260 tablet.cc:1724] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.898252 10235 tablet.cc:1724] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.898851 10248 tablet.cc:1724] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.893953 10258 tablet.cc:1724] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:09.895805  9784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45187, user_credentials={real_user=slave}} blocked reactor thread for 109866us
I20260709 13:02:09.905934 10259 tablet.cc:1724] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.907984 10237 tablet.cc:1724] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.959061 10262 tablet.cc:1724] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.978236 10266 tablet.cc:1724] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.981448 10240 tablet.cc:1724] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.982802 10249 tablet.cc:1724] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.987519 10262 tablet.cc:1724] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.989650  9817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "138375b17d89465ea500f9f2b597664b"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
mode: GRACEFUL
new_leader_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:37730
I20260709 13:02:09.974278 10248 tablet.cc:1724] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.975613 10242 tablet.cc:1724] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.997890 10233 tablet.cc:1724] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:09.997582 10258 tablet.cc:1724] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:10.001490 10235 tablet.cc:1724] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:10.008730 10237 tablet.cc:1724] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:10.012576  9817 raft_consensus.cc:606] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Received request to transfer leadership to TS 15f7695b2731408a917102458963b729
I20260709 13:02:10.035880 10258 tablet.cc:1724] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:10.003343 10260 tablet.cc:1724] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:10.047084  9817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
mode: GRACEFUL
new_leader_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:37730
I20260709 13:02:10.047809  9817 raft_consensus.cc:606] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Received request to transfer leadership to TS 15f7695b2731408a917102458963b729
I20260709 13:02:10.003463 10259 tablet.cc:1724] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:10.053588   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:02:10.054334   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:10.079371  9716 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349: soft_deleted_table [id=01174a0a072947e785ba219d8a300ac2] alter complete (version 1)
I20260709 13:02:10.088555  9891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502"
dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
mode: GRACEFUL
new_leader_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:02:10.089241  9891 raft_consensus.cc:606] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Received request to transfer leadership to TS 15f7695b2731408a917102458963b729
I20260709 13:02:10.093925  9817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a"
dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
mode: GRACEFUL
new_leader_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:37730
I20260709 13:02:10.094590  9817 raft_consensus.cc:606] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Received request to transfer leadership to TS 15f7695b2731408a917102458963b729
I20260709 13:02:10.095804   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:10.096455   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:10.173511 10261 raft_consensus.cc:993] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: : Instructing follower 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.174227 10201 raft_consensus.cc:1081] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Signalling peer 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.175865  9965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "138375b17d89465ea500f9f2b597664b"
dest_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:51460
I20260709 13:02:10.176359  9965 raft_consensus.cc:493] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.176625  9965 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.182813  9965 raft_consensus.cc:515] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.184626  9965 leader_election.cc:290] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 3 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:10.185323  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:10.185667  9891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138375b17d89465ea500f9f2b597664b" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:10.185992  9817 raft_consensus.cc:3055] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:10.186276  9891 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.186391  9817 raft_consensus.cc:740] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:10.187224  9817 consensus_queue.cc:260] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.188184  9817 raft_consensus.cc:3060] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.192652  9891 raft_consensus.cc:2468] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 3.
I20260709 13:02:10.193459  9817 raft_consensus.cc:2468] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 3.
I20260709 13:02:10.193940  9933 leader_election.cc:304] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:10.194873 10246 raft_consensus.cc:2804] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:10.195752 10246 raft_consensus.cc:697] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 3 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:10.196574 10246 consensus_queue.cc:237] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.203037  9716 catalog_manager.cc:5697] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 2 to 3, leader changed from 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193) to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.259399 10261 raft_consensus.cc:993] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: : Instructing follower 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.259918 10201 raft_consensus.cc:1081] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Signalling peer 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.261313  9965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa"
dest_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:51460
I20260709 13:02:10.261816  9965 raft_consensus.cc:493] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.262123  9965 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.267216  9965 raft_consensus.cc:515] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.269132  9965 leader_election.cc:290] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 3 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:10.270135  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:10.270256  9891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2362c51fede6485188fdfafe4a24f5aa" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:10.270778  9817 raft_consensus.cc:3055] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:10.270857  9891 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.271087  9817 raft_consensus.cc:740] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:10.271973  9817 consensus_queue.cc:260] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.273022  9817 raft_consensus.cc:3060] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.276424  9891 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 3.
I20260709 13:02:10.277667  9933 leader_election.cc:304] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:10.278565 10246 raft_consensus.cc:2804] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:10.278564  9817 raft_consensus.cc:2468] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 3.
I20260709 13:02:10.279094 10246 raft_consensus.cc:697] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 3 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:10.280037 10246 consensus_queue.cc:237] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.286984  9716 catalog_manager.cc:5697] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 2 to 3, leader changed from 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193) to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.326577 10261 raft_consensus.cc:993] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: : Instructing follower 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.327040 10201 raft_consensus.cc:1081] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Signalling peer 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.328431  9965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a"
dest_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:51460
I20260709 13:02:10.328938  9965 raft_consensus.cc:493] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.329321  9965 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.335563  9965 raft_consensus.cc:515] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.337739  9965 leader_election.cc:290] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 3 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:10.338495  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:10.338789  9891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba97ea993a548b28ac6ef9e4f46539a" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:10.339365  9817 raft_consensus.cc:3055] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:10.339434  9891 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.339715  9817 raft_consensus.cc:740] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93f454af9a2f4c9a9c2c88c1755e75ac, State: Running, Role: LEADER
I20260709 13:02:10.340628  9817 consensus_queue.cc:260] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.341580  9817 raft_consensus.cc:3060] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.344971  9891 raft_consensus.cc:2468] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 3.
I20260709 13:02:10.346095  9933 leader_election.cc:304] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0759fd38a97a44038af6a83f582c00b3, 15f7695b2731408a917102458963b729; no voters: 
I20260709 13:02:10.346827 10246 raft_consensus.cc:2804] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:10.346858  9817 raft_consensus.cc:2468] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 3.
I20260709 13:02:10.347517 10246 raft_consensus.cc:697] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 3 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:10.348713 10246 consensus_queue.cc:237] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.355877  9716 catalog_manager.cc:5697] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 2 to 3, leader changed from 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193) to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.402483 10191 raft_consensus.cc:993] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: : Instructing follower 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.403054 10200 raft_consensus.cc:1081] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Signalling peer 15f7695b2731408a917102458963b729 to start an election
I20260709 13:02:10.404516  9965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502"
dest_uuid: "15f7695b2731408a917102458963b729"
 from {username='slave'} at 127.0.0.1:51470
I20260709 13:02:10.405025  9965 raft_consensus.cc:493] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.405340  9965 raft_consensus.cc:3060] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.412640  9965 raft_consensus.cc:515] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.415127  9965 leader_election.cc:290] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 2 election: Requested vote from peers 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227), 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187)
I20260709 13:02:10.415303  9817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac"
I20260709 13:02:10.415685  9891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fe6931cd7c43aa9056ab740cb02502" candidate_uuid: "15f7695b2731408a917102458963b729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0759fd38a97a44038af6a83f582c00b3"
I20260709 13:02:10.416018  9817 raft_consensus.cc:3060] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.416323  9891 raft_consensus.cc:3055] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:10.416677  9891 raft_consensus.cc:740] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0759fd38a97a44038af6a83f582c00b3, State: Running, Role: LEADER
I20260709 13:02:10.417514  9891 consensus_queue.cc:260] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.418828  9891 raft_consensus.cc:3060] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.423728  9817 raft_consensus.cc:2468] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 2.
I20260709 13:02:10.425092  9932 leader_election.cc:304] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f7695b2731408a917102458963b729, 93f454af9a2f4c9a9c2c88c1755e75ac; no voters: 
I20260709 13:02:10.425949 10246 raft_consensus.cc:2804] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.426179  9891 raft_consensus.cc:2468] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f7695b2731408a917102458963b729 in term 2.
I20260709 13:02:10.426450 10246 raft_consensus.cc:697] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 2 LEADER]: Becoming Leader. State: Replica: 15f7695b2731408a917102458963b729, State: Running, Role: LEADER
I20260709 13:02:10.427397 10246 consensus_queue.cc:237] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } }
I20260709 13:02:10.435088  9716 catalog_manager.cc:5697] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 reported cstate change: term changed from 1 to 2, leader changed from 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194) to 15f7695b2731408a917102458963b729 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "15f7695b2731408a917102458963b729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f7695b2731408a917102458963b729" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36469 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.634006  9894 raft_consensus.cc:1275] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:10.635267 10246 consensus_queue.cc:1048] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:10.646008  9817 raft_consensus.cc:1275] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:10.647625 10246 consensus_queue.cc:1048] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:10.671614  9894 raft_consensus.cc:1275] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:10.672796 10246 consensus_queue.cc:1048] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:10.681092  9817 raft_consensus.cc:1275] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:10.683583 10271 consensus_queue.cc:1048] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:10.748008  9817 raft_consensus.cc:1275] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:10.749298 10271 consensus_queue.cc:1048] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:10.759364  9894 raft_consensus.cc:1275] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:10.760646 10271 consensus_queue.cc:1048] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:10.925838  9894 raft_consensus.cc:1275] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.926954 10271 consensus_queue.cc:1048] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0759fd38a97a44038af6a83f582c00b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.934643  9817 raft_consensus.cc:1275] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Refusing update from remote peer 15f7695b2731408a917102458963b729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.936028 10275 consensus_queue.cc:1048] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f454af9a2f4c9a9c2c88c1755e75ac" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.153146   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:02:11.158193   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:02:11.158677   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.163295   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:02:11.163764   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:12.194852   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:12.217288  9858 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:02:12.220813   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:12.221163  9858 consensus_peers.cc:597] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.221797   431 tablet_replica.cc:333] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.222854   431 raft_consensus.cc:2243] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.223840   431 raft_consensus.cc:2272] T 7923dc54eac449fa82428dec1fdc1ba5 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.226109   431 tablet_replica.cc:333] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.226912   431 raft_consensus.cc:2243] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.227401   431 raft_consensus.cc:2272] T ce157a994b9740bc8939488c7492c702 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.229413   431 tablet_replica.cc:333] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.229995   431 raft_consensus.cc:2243] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.230422   431 raft_consensus.cc:2272] T 2362c51fede6485188fdfafe4a24f5aa P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.232311   431 tablet_replica.cc:333] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.232846   431 raft_consensus.cc:2243] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.233361   431 raft_consensus.cc:2272] T 9609d18207fe4571b4d069e464cc272f P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.235056   431 tablet_replica.cc:333] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.235687   431 raft_consensus.cc:2243] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.236121   431 raft_consensus.cc:2272] T 138375b17d89465ea500f9f2b597664b P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.237993   431 tablet_replica.cc:333] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.238565   431 raft_consensus.cc:2243] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.238971   431 raft_consensus.cc:2272] T 7ba97ea993a548b28ac6ef9e4f46539a P 93f454af9a2f4c9a9c2c88c1755e75ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.241014   431 tablet_replica.cc:333] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.241617   431 raft_consensus.cc:2243] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.242075   431 raft_consensus.cc:2272] T 2ff21ef07ff740d0914ce320a762f923 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.244073   431 tablet_replica.cc:333] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.244668   431 raft_consensus.cc:2243] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.245106   431 raft_consensus.cc:2272] T dfc46c44bd404d3ea3008955814755fd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.246785   431 tablet_replica.cc:333] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.247328   431 raft_consensus.cc:2243] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.248067   431 raft_consensus.cc:2272] T b0b3e556034b411086c9ff30ea89c593 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.250072   431 tablet_replica.cc:333] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.250665   431 raft_consensus.cc:2243] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.251102   431 raft_consensus.cc:2272] T fe0e4d4c95f1495a8f137254738c8e02 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.253109   431 tablet_replica.cc:333] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.253614   431 raft_consensus.cc:2243] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.254047   431 raft_consensus.cc:2272] T 10fe6931cd7c43aa9056ab740cb02502 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.256049   431 tablet_replica.cc:333] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.256618   431 raft_consensus.cc:2243] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.257489   431 raft_consensus.cc:2272] T 9aad7a808f33496196cffc55eaca3f06 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.259505   431 tablet_replica.cc:333] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.260186   431 raft_consensus.cc:2243] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.260617   431 raft_consensus.cc:2272] T bd6723897cc540539cd25d7edc455dfd P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.262406   431 tablet_replica.cc:333] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.262916   431 raft_consensus.cc:2243] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.263336   431 raft_consensus.cc:2272] T 9d0e532c3659440d8f102bf0a4f93a87 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.265105   431 tablet_replica.cc:333] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.265712   431 raft_consensus.cc:2243] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.266507   431 raft_consensus.cc:2272] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.268843   431 tablet_replica.cc:333] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.269395   431 raft_consensus.cc:2243] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.270284   431 raft_consensus.cc:2272] T 87f95fd36ed042ff809f0bddaf1b8b6e P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.272473   431 tablet_replica.cc:333] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.273002   431 raft_consensus.cc:2243] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.273437   431 raft_consensus.cc:2272] T c833bf469e0a459eb59ad466a794e3c6 P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.275384   431 tablet_replica.cc:333] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac: stopping tablet replica
I20260709 13:02:12.275796   431 raft_consensus.cc:2243] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.276530   431 raft_consensus.cc:2272] T bf06f8f442d44235be93edcf2dcb62ba P 93f454af9a2f4c9a9c2c88c1755e75ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.318913   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:12.349653   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:12.383112  9933 consensus_peers.cc:597] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 -> Peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Couldn't send request to peer 0759fd38a97a44038af6a83f582c00b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.383916   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:12.384742   431 tablet_replica.cc:333] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.385409   431 raft_consensus.cc:2243] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.385895   431 raft_consensus.cc:2272] T 138375b17d89465ea500f9f2b597664b P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.387948   431 tablet_replica.cc:333] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.388622   431 raft_consensus.cc:2243] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.389447   431 raft_consensus.cc:2272] T 9609d18207fe4571b4d069e464cc272f P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.391541   431 tablet_replica.cc:333] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.392120   431 raft_consensus.cc:2243] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.392658   431 raft_consensus.cc:2272] T 7923dc54eac449fa82428dec1fdc1ba5 P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.394537   431 tablet_replica.cc:333] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.395097   431 raft_consensus.cc:2243] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.395536   431 raft_consensus.cc:2272] T 9d0e532c3659440d8f102bf0a4f93a87 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.397490   431 tablet_replica.cc:333] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.398056   431 raft_consensus.cc:2243] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.398475   431 raft_consensus.cc:2272] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.400404   431 tablet_replica.cc:333] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.400935   431 raft_consensus.cc:2243] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.401371   431 raft_consensus.cc:2272] T 2362c51fede6485188fdfafe4a24f5aa P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.403155   431 tablet_replica.cc:333] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.403683   431 raft_consensus.cc:2243] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.404079   431 raft_consensus.cc:2272] T b0b3e556034b411086c9ff30ea89c593 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.405923   431 tablet_replica.cc:333] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.406454   431 raft_consensus.cc:2243] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.406862   431 raft_consensus.cc:2272] T fe0e4d4c95f1495a8f137254738c8e02 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.409229   431 tablet_replica.cc:333] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.409953   431 raft_consensus.cc:2243] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.411012   431 raft_consensus.cc:2272] T dfc46c44bd404d3ea3008955814755fd P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.413697   431 tablet_replica.cc:333] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.414482   431 raft_consensus.cc:2243] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.415289   431 raft_consensus.cc:2272] T 2ff21ef07ff740d0914ce320a762f923 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.417392   431 tablet_replica.cc:333] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.417935   431 raft_consensus.cc:2243] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.418378   431 raft_consensus.cc:2272] T 7ba97ea993a548b28ac6ef9e4f46539a P 0759fd38a97a44038af6a83f582c00b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.420439   431 tablet_replica.cc:333] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.420974   431 raft_consensus.cc:2243] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.421401   431 raft_consensus.cc:2272] T bf06f8f442d44235be93edcf2dcb62ba P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.423585   431 tablet_replica.cc:333] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.424104   431 raft_consensus.cc:2243] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.424970   431 raft_consensus.cc:2272] T ce157a994b9740bc8939488c7492c702 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.426921   431 tablet_replica.cc:333] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.427585   431 raft_consensus.cc:2243] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.427994   431 raft_consensus.cc:2272] T 9aad7a808f33496196cffc55eaca3f06 P 0759fd38a97a44038af6a83f582c00b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.430589   431 tablet_replica.cc:333] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.431332   431 raft_consensus.cc:2243] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.431859   431 raft_consensus.cc:2272] T 10fe6931cd7c43aa9056ab740cb02502 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:12.433049  9933 consensus_peers.cc:597] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 -> Peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Couldn't send request to peer 0759fd38a97a44038af6a83f582c00b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.434506   431 tablet_replica.cc:333] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.435309   431 raft_consensus.cc:2243] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.436177   431 raft_consensus.cc:2272] T bd6723897cc540539cd25d7edc455dfd P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.438426   431 tablet_replica.cc:333] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.438908   431 raft_consensus.cc:2243] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.439675   431 raft_consensus.cc:2272] T c833bf469e0a459eb59ad466a794e3c6 P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.441870   431 tablet_replica.cc:333] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3: stopping tablet replica
I20260709 13:02:12.442339   431 raft_consensus.cc:2243] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.442759   431 raft_consensus.cc:2272] T 87f95fd36ed042ff809f0bddaf1b8b6e P 0759fd38a97a44038af6a83f582c00b3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:12.465286  9932 consensus_peers.cc:597] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:12.513489  9932 consensus_peers.cc:597] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:12.514587  9932 consensus_peers.cc:597] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:12.515169  9933 consensus_peers.cc:597] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 -> Peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Couldn't send request to peer 0759fd38a97a44038af6a83f582c00b3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.516005   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:12.575687  9933 consensus_peers.cc:597] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 -> Peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Couldn't send request to peer 0759fd38a97a44038af6a83f582c00b3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:12.587630  9932 consensus_peers.cc:597] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.588554   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:02:12.612835  9932 consensus_peers.cc:597] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:12.618352  9933 consensus_peers.cc:597] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 -> Peer 0759fd38a97a44038af6a83f582c00b3 (127.0.107.194:45187): Couldn't send request to peer 0759fd38a97a44038af6a83f582c00b3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.621975   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:12.623284   431 tablet_replica.cc:333] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.624977   431 raft_consensus.cc:2243] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.625798   431 raft_consensus.cc:2272] T 9609d18207fe4571b4d069e464cc272f P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.629128   431 tablet_replica.cc:333] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.630419   431 raft_consensus.cc:2243] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.631814   431 raft_consensus.cc:2272] T 138375b17d89465ea500f9f2b597664b P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.634343   431 tablet_replica.cc:333] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.635254   431 raft_consensus.cc:2243] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.635892   431 raft_consensus.cc:2272] T a1f7cbcf58fe44ee8cf658dfb392cda9 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.638640   431 tablet_replica.cc:333] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.639278   431 raft_consensus.cc:2243] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.640897   431 raft_consensus.cc:2272] T 9d0e532c3659440d8f102bf0a4f93a87 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.644428   431 tablet_replica.cc:333] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.645561   431 raft_consensus.cc:2243] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:12.646360  9932 consensus_peers.cc:597] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 -> Peer 93f454af9a2f4c9a9c2c88c1755e75ac (127.0.107.193:34227): Couldn't send request to peer 93f454af9a2f4c9a9c2c88c1755e75ac. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.646567   431 raft_consensus.cc:2272] T 7923dc54eac449fa82428dec1fdc1ba5 P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.649587   431 tablet_replica.cc:333] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.650264   431 raft_consensus.cc:2243] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.651713   431 raft_consensus.cc:2272] T 7ba97ea993a548b28ac6ef9e4f46539a P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.654356   431 tablet_replica.cc:333] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.655082   431 raft_consensus.cc:2243] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.655721   431 raft_consensus.cc:2272] T 2ff21ef07ff740d0914ce320a762f923 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.658284   431 tablet_replica.cc:333] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.658875   431 raft_consensus.cc:2243] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.659559   431 raft_consensus.cc:2272] T 87f95fd36ed042ff809f0bddaf1b8b6e P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.662251   431 tablet_replica.cc:333] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.663066   431 raft_consensus.cc:2243] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.663661   431 raft_consensus.cc:2272] T c833bf469e0a459eb59ad466a794e3c6 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.666847   431 tablet_replica.cc:333] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.667490   431 raft_consensus.cc:2243] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.668388   431 raft_consensus.cc:2272] T ce157a994b9740bc8939488c7492c702 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.670701   431 tablet_replica.cc:333] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.671285   431 raft_consensus.cc:2243] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.672420   431 raft_consensus.cc:2272] T 10fe6931cd7c43aa9056ab740cb02502 P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.674932   431 tablet_replica.cc:333] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.675552   431 raft_consensus.cc:2243] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.676162   431 raft_consensus.cc:2272] T 9aad7a808f33496196cffc55eaca3f06 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.679189   431 tablet_replica.cc:333] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.680044   431 raft_consensus.cc:2243] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.680711   431 raft_consensus.cc:2272] T bf06f8f442d44235be93edcf2dcb62ba P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.683467   431 tablet_replica.cc:333] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.684098   431 raft_consensus.cc:2243] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.684746   431 raft_consensus.cc:2272] T bd6723897cc540539cd25d7edc455dfd P 15f7695b2731408a917102458963b729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.687399   431 tablet_replica.cc:333] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.687994   431 raft_consensus.cc:2243] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.689213   431 raft_consensus.cc:2272] T 2362c51fede6485188fdfafe4a24f5aa P 15f7695b2731408a917102458963b729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.691705   431 tablet_replica.cc:333] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.692302   431 raft_consensus.cc:2243] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.692965   431 raft_consensus.cc:2272] T dfc46c44bd404d3ea3008955814755fd P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.695271   431 tablet_replica.cc:333] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.695819   431 raft_consensus.cc:2243] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:12.696440   431 raft_consensus.cc:2272] T b0b3e556034b411086c9ff30ea89c593 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.699033   431 tablet_replica.cc:333] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729: stopping tablet replica
I20260709 13:02:12.699718   431 raft_consensus.cc:2243] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.701177   431 raft_consensus.cc:2272] T fe0e4d4c95f1495a8f137254738c8e02 P 15f7695b2731408a917102458963b729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.747558   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:12.794793   431 master.cc:562] Master@127.0.107.254:34449 shutting down...
I20260709 13:02:12.819387   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:12.820170   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:12.820628   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 572d7ac327b74327a29108eb270e7349: stopping tablet replica
I20260709 13:02:12.842666   431 master.cc:584] Master@127.0.107.254:34449 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12760 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:02:12.902138   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:35559
I20260709 13:02:12.903290   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:12.909443 10290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:12.909443 10291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:12.910413 10293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:12.910874   431 server_base.cc:1061] running on GCE node
I20260709 13:02:12.911795   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:12.912005   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:12.912124   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602132912113 us; error 0 us; skew 500 ppm
I20260709 13:02:12.912801   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:12.915235   431 webserver.cc:533] Webserver started at http://127.0.107.254:36867/ using document root <none> and password file <none>
I20260709 13:02:12.915704   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:12.915858   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:12.916087   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:12.917398   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/master-0-root/instance:
uuid: "ae314f7449d04b5c9724026a3b5470dc"
format_stamp: "Formatted at 2026-07-09 13:02:12 on dist-test-slave-vcr9"
I20260709 13:02:12.921934   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:12.925324 10298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:12.926100   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:12.926391   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/master-0-root
uuid: "ae314f7449d04b5c9724026a3b5470dc"
format_stamp: "Formatted at 2026-07-09 13:02:12 on dist-test-slave-vcr9"
I20260709 13:02:12.926690   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:12.938725   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:12.939983   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:12.979269   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:35559
I20260709 13:02:12.979374 10349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:35559 every 8 connection(s)
I20260709 13:02:12.983604 10350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:12.997808 10350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc: Bootstrap starting.
I20260709 13:02:13.002787 10350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.007311 10350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc: No bootstrap required, opened a new log
I20260709 13:02:13.009747 10350 raft_consensus.cc:359] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae314f7449d04b5c9724026a3b5470dc" member_type: VOTER }
I20260709 13:02:13.010206 10350 raft_consensus.cc:385] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.010391 10350 raft_consensus.cc:740] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae314f7449d04b5c9724026a3b5470dc, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.011059 10350 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae314f7449d04b5c9724026a3b5470dc" member_type: VOTER }
I20260709 13:02:13.011562 10350 raft_consensus.cc:399] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:13.011770 10350 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:13.012018 10350 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.017071 10350 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae314f7449d04b5c9724026a3b5470dc" member_type: VOTER }
I20260709 13:02:13.017602 10350 leader_election.cc:304] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae314f7449d04b5c9724026a3b5470dc; no voters: 
I20260709 13:02:13.018759 10350 leader_election.cc:290] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:13.019268 10353 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:13.020882 10353 raft_consensus.cc:697] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 1 LEADER]: Becoming Leader. State: Replica: ae314f7449d04b5c9724026a3b5470dc, State: Running, Role: LEADER
I20260709 13:02:13.021834 10350 sys_catalog.cc:565] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:13.021759 10353 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae314f7449d04b5c9724026a3b5470dc" member_type: VOTER }
I20260709 13:02:13.029520 10354 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae314f7449d04b5c9724026a3b5470dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae314f7449d04b5c9724026a3b5470dc" member_type: VOTER } }
I20260709 13:02:13.029433 10355 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae314f7449d04b5c9724026a3b5470dc. Latest consensus state: current_term: 1 leader_uuid: "ae314f7449d04b5c9724026a3b5470dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae314f7449d04b5c9724026a3b5470dc" member_type: VOTER } }
I20260709 13:02:13.030196 10354 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:13.030339 10355 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:13.038643 10362 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:13.043803 10362 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:13.044891   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:13.053563 10362 catalog_manager.cc:1383] Generated new cluster ID: d1b029ea1371420da5aa49afdea0f76a
I20260709 13:02:13.053884 10362 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:13.083719 10362 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:13.085191 10362 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:13.103859 10362 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc: Generated new TSK 0
I20260709 13:02:13.104548 10362 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:13.111541   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:13.118163 10371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:13.119441 10372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.122545   431 server_base.cc:1061] running on GCE node
W20260709 13:02:13.122463 10374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.123943   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:13.124190   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:13.124455   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602133124436 us; error 0 us; skew 500 ppm
I20260709 13:02:13.125039   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:13.127539   431 webserver.cc:533] Webserver started at http://127.0.107.193:43551/ using document root <none> and password file <none>
I20260709 13:02:13.128063   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:13.128312   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:13.128651   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:13.129839   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-0-root/instance:
uuid: "fefaaaebea574a5192fd4677ef758607"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-vcr9"
I20260709 13:02:13.134580   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:02:13.138273 10379 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.139058   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:13.139370   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-0-root
uuid: "fefaaaebea574a5192fd4677ef758607"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-vcr9"
I20260709 13:02:13.139678   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:13.153790   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:13.155115   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:13.156709   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:13.159039   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:13.159274   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.159530   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:13.159716   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.201507   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42905
I20260709 13:02:13.201615 10441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42905 every 8 connection(s)
I20260709 13:02:13.206764   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:13.216786 10446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:13.217250 10447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.224151 10442 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35559
I20260709 13:02:13.224776 10442 heartbeater.cc:461] Registering TS with master...
W20260709 13:02:13.224944 10449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.225756 10442 heartbeater.cc:507] Master 127.0.107.254:35559 requested a full tablet report, sending...
I20260709 13:02:13.226505   431 server_base.cc:1061] running on GCE node
I20260709 13:02:13.228102   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:13.228408   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:13.228608   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602133228592 us; error 0 us; skew 500 ppm
I20260709 13:02:13.228526 10315 ts_manager.cc:194] Registered new tserver with Master: fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905)
I20260709 13:02:13.229470   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:13.231113 10315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40260
I20260709 13:02:13.232161   431 webserver.cc:533] Webserver started at http://127.0.107.194:36473/ using document root <none> and password file <none>
I20260709 13:02:13.232980   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:13.233224   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:13.233560   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:13.234927   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-1-root/instance:
uuid: "7d60d9c59d0b44aab8d1d917232ce058"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-vcr9"
I20260709 13:02:13.239789   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:02:13.243227 10454 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.244032   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:02:13.244380   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-1-root
uuid: "7d60d9c59d0b44aab8d1d917232ce058"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-vcr9"
I20260709 13:02:13.244696   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:13.254284   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:13.255540   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:13.257107   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:13.259373   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:13.259610   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.259869   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:13.260047   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.301846   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43023
I20260709 13:02:13.301981 10516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43023 every 8 connection(s)
I20260709 13:02:13.306799   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:13.315205 10520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:13.315862 10521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:13.318707 10523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.320257 10517 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35559
I20260709 13:02:13.320691 10517 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:13.321600 10517 heartbeater.cc:507] Master 127.0.107.254:35559 requested a full tablet report, sending...
I20260709 13:02:13.321700   431 server_base.cc:1061] running on GCE node
I20260709 13:02:13.322717   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:13.322948   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:13.323148   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602133323129 us; error 0 us; skew 500 ppm
I20260709 13:02:13.323745   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:13.323926 10315 ts_manager.cc:194] Registered new tserver with Master: 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:13.325982 10315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40270
I20260709 13:02:13.326588   431 webserver.cc:533] Webserver started at http://127.0.107.195:35347/ using document root <none> and password file <none>
I20260709 13:02:13.327311   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:13.327551   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:13.327853   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:13.329298   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-2-root/instance:
uuid: "9b830c0afee44934ae266f52e630f381"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-vcr9"
I20260709 13:02:13.333940   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:13.337805 10528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.338771   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:02:13.339115   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-2-root
uuid: "9b830c0afee44934ae266f52e630f381"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-vcr9"
I20260709 13:02:13.339424   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA9JSIL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601864268336-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:13.372006   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:13.373286   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:13.374807   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:13.377211   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:13.377451   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.377699   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:13.377877   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.418998   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43915
I20260709 13:02:13.419117 10590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43915 every 8 connection(s)
I20260709 13:02:13.433890 10591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35559
I20260709 13:02:13.434792 10591 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:13.435743 10591 heartbeater.cc:507] Master 127.0.107.254:35559 requested a full tablet report, sending...
I20260709 13:02:13.438350 10315 ts_manager.cc:194] Registered new tserver with Master: 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:13.438686   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016539289s
I20260709 13:02:13.440321 10315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40284
I20260709 13:02:13.467625 10315 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40300:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:13.470747 10315 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:13.539915 10481 tablet_service.cc:1511] Processing CreateTablet for tablet c6300b3b0c8c4af3a2ae2e4da3fd8841 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:13.541514 10481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6300b3b0c8c4af3a2ae2e4da3fd8841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.545313 10479 tablet_service.cc:1511] Processing CreateTablet for tablet aca8ba33c6244956886ae26068d4863f (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:13.547555 10479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca8ba33c6244956886ae26068d4863f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.553273 10480 tablet_service.cc:1511] Processing CreateTablet for tablet 298b72b24c3244629049a873bd831bf8 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:13.554984 10480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b72b24c3244629049a873bd831bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.554735 10478 tablet_service.cc:1511] Processing CreateTablet for tablet cccadc9a2dcf42f78928b8c65d22c325 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:13.556246 10478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cccadc9a2dcf42f78928b8c65d22c325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.557138 10482 tablet_service.cc:1511] Processing CreateTablet for tablet 40ac3e53127c467b8d1f57c16ed853ec (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:13.558537 10482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ac3e53127c467b8d1f57c16ed853ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.559865 10477 tablet_service.cc:1511] Processing CreateTablet for tablet b243ff0baebd41938163c175369ea41e (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:13.561375 10477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b243ff0baebd41938163c175369ea41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.566486 10476 tablet_service.cc:1511] Processing CreateTablet for tablet d7891a8e1aaf4854b11501a249c88160 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:13.567986 10476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7891a8e1aaf4854b11501a249c88160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.574541 10475 tablet_service.cc:1511] Processing CreateTablet for tablet f00b68caa2554546a3394e5cd2987252 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:13.576416 10475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00b68caa2554546a3394e5cd2987252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.574935 10474 tablet_service.cc:1511] Processing CreateTablet for tablet 063fe6f11c37465587328a4bcd2a2e06 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:13.581185 10474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063fe6f11c37465587328a4bcd2a2e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.600046 10401 tablet_service.cc:1511] Processing CreateTablet for tablet d7891a8e1aaf4854b11501a249c88160 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:13.600853 10407 tablet_service.cc:1511] Processing CreateTablet for tablet 40ac3e53127c467b8d1f57c16ed853ec (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:13.601701 10401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7891a8e1aaf4854b11501a249c88160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.603176 10406 tablet_service.cc:1511] Processing CreateTablet for tablet c6300b3b0c8c4af3a2ae2e4da3fd8841 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:13.604614 10406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6300b3b0c8c4af3a2ae2e4da3fd8841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.605448 10400 tablet_service.cc:1511] Processing CreateTablet for tablet f00b68caa2554546a3394e5cd2987252 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:13.606894 10400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00b68caa2554546a3394e5cd2987252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.609320 10405 tablet_service.cc:1511] Processing CreateTablet for tablet 298b72b24c3244629049a873bd831bf8 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:13.610821 10405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b72b24c3244629049a873bd831bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.609419 10399 tablet_service.cc:1511] Processing CreateTablet for tablet 063fe6f11c37465587328a4bcd2a2e06 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:13.613732 10399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063fe6f11c37465587328a4bcd2a2e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.613500 10404 tablet_service.cc:1511] Processing CreateTablet for tablet aca8ba33c6244956886ae26068d4863f (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:13.614892 10404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca8ba33c6244956886ae26068d4863f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.617480 10403 tablet_service.cc:1511] Processing CreateTablet for tablet cccadc9a2dcf42f78928b8c65d22c325 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:13.619385 10402 tablet_service.cc:1511] Processing CreateTablet for tablet b243ff0baebd41938163c175369ea41e (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:13.620409 10407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ac3e53127c467b8d1f57c16ed853ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.622284 10402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b243ff0baebd41938163c175369ea41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.623039 10403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cccadc9a2dcf42f78928b8c65d22c325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.650780 10556 tablet_service.cc:1511] Processing CreateTablet for tablet 40ac3e53127c467b8d1f57c16ed853ec (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:13.653486 10555 tablet_service.cc:1511] Processing CreateTablet for tablet c6300b3b0c8c4af3a2ae2e4da3fd8841 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:13.655936 10554 tablet_service.cc:1511] Processing CreateTablet for tablet 298b72b24c3244629049a873bd831bf8 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:13.658407 10553 tablet_service.cc:1511] Processing CreateTablet for tablet aca8ba33c6244956886ae26068d4863f (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:13.660799 10552 tablet_service.cc:1511] Processing CreateTablet for tablet cccadc9a2dcf42f78928b8c65d22c325 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:13.663311 10551 tablet_service.cc:1511] Processing CreateTablet for tablet b243ff0baebd41938163c175369ea41e (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:13.665534 10550 tablet_service.cc:1511] Processing CreateTablet for tablet d7891a8e1aaf4854b11501a249c88160 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:13.667930 10549 tablet_service.cc:1511] Processing CreateTablet for tablet f00b68caa2554546a3394e5cd2987252 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:13.671695 10548 tablet_service.cc:1511] Processing CreateTablet for tablet 063fe6f11c37465587328a4bcd2a2e06 (DEFAULT_TABLE table=test-workload [id=81fcca8df190422e9ecc2547e56bdccd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:13.676662 10556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ac3e53127c467b8d1f57c16ed853ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.680601 10551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b243ff0baebd41938163c175369ea41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.684633 10555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6300b3b0c8c4af3a2ae2e4da3fd8841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.696394 10552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cccadc9a2dcf42f78928b8c65d22c325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.700618 10548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063fe6f11c37465587328a4bcd2a2e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.704596 10550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7891a8e1aaf4854b11501a249c88160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.708689 10549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00b68caa2554546a3394e5cd2987252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.716537 10554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298b72b24c3244629049a873bd831bf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.720597 10553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca8ba33c6244956886ae26068d4863f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.741537 10606 tablet_bootstrap.cc:492] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:13.753890 10605 tablet_bootstrap.cc:492] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:13.770848 10606 tablet_bootstrap.cc:654] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.774556 10607 tablet_bootstrap.cc:492] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:13.778860 10605 tablet_bootstrap.cc:654] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.786199 10606 tablet_bootstrap.cc:492] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:13.786770 10606 ts_tablet_manager.cc:1403] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:02:13.790201 10606 raft_consensus.cc:359] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.791059 10606 raft_consensus.cc:385] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.791412 10606 raft_consensus.cc:740] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.792399 10606 consensus_queue.cc:260] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.793866 10607 tablet_bootstrap.cc:654] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.807276 10442 heartbeater.cc:499] Master 127.0.107.254:35559 was elected leader, sending a full tablet report...
I20260709 13:02:13.807770 10605 tablet_bootstrap.cc:492] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:13.808308 10606 ts_tablet_manager.cc:1434] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.016s
I20260709 13:02:13.808380 10605 ts_tablet_manager.cc:1403] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.009s
I20260709 13:02:13.809916 10606 tablet_bootstrap.cc:492] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:13.811971 10605 raft_consensus.cc:359] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.812791 10605 raft_consensus.cc:385] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.813099 10605 raft_consensus.cc:740] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.813948 10605 consensus_queue.cc:260] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.818946 10606 tablet_bootstrap.cc:654] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.823657 10605 ts_tablet_manager.cc:1434] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:02:13.824553 10517 heartbeater.cc:499] Master 127.0.107.254:35559 was elected leader, sending a full tablet report...
I20260709 13:02:13.831804 10607 tablet_bootstrap.cc:492] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:13.832865 10607 ts_tablet_manager.cc:1403] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.028s
I20260709 13:02:13.833546 10605 tablet_bootstrap.cc:492] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:13.837407 10607 raft_consensus.cc:359] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.838689 10607 raft_consensus.cc:385] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.839188 10607 raft_consensus.cc:740] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.840454 10607 consensus_queue.cc:260] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.843894 10605 tablet_bootstrap.cc:654] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.846017 10591 heartbeater.cc:499] Master 127.0.107.254:35559 was elected leader, sending a full tablet report...
I20260709 13:02:13.846624 10607 ts_tablet_manager.cc:1434] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 13:02:13.847422 10606 tablet_bootstrap.cc:492] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:13.847899 10607 tablet_bootstrap.cc:492] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:13.847991 10606 ts_tablet_manager.cc:1403] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.019s
I20260709 13:02:13.851373 10606 raft_consensus.cc:359] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.852178 10606 raft_consensus.cc:385] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.852499 10606 raft_consensus.cc:740] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.853291 10606 consensus_queue.cc:260] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.855261 10607 tablet_bootstrap.cc:654] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.855566 10606 ts_tablet_manager.cc:1434] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:13.858704 10606 tablet_bootstrap.cc:492] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:13.861137 10605 tablet_bootstrap.cc:492] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:13.861938 10605 ts_tablet_manager.cc:1403] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.006s
I20260709 13:02:13.865487 10606 tablet_bootstrap.cc:654] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.865826 10605 raft_consensus.cc:359] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.866650 10605 raft_consensus.cc:385] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.866951 10605 raft_consensus.cc:740] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.867866 10607 tablet_bootstrap.cc:492] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:13.868552 10607 ts_tablet_manager.cc:1403] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:02:13.867995 10605 consensus_queue.cc:260] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.871618 10606 tablet_bootstrap.cc:492] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:13.872184 10606 ts_tablet_manager.cc:1403] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:02:13.872007 10607 raft_consensus.cc:359] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.872980 10607 raft_consensus.cc:385] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.873342 10607 raft_consensus.cc:740] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.874286 10607 consensus_queue.cc:260] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.875501 10606 raft_consensus.cc:359] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.876343 10606 raft_consensus.cc:385] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.876643 10606 raft_consensus.cc:740] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.877005 10605 ts_tablet_manager.cc:1434] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:02:13.877450 10606 consensus_queue.cc:260] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.878777 10605 tablet_bootstrap.cc:492] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:13.879915 10606 ts_tablet_manager.cc:1434] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:13.881095 10606 tablet_bootstrap.cc:492] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:13.887904 10606 tablet_bootstrap.cc:654] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.889398 10605 tablet_bootstrap.cc:654] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.890297 10607 ts_tablet_manager.cc:1434] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 13:02:13.891611 10607 tablet_bootstrap.cc:492] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:13.899585 10607 tablet_bootstrap.cc:654] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.899802 10606 tablet_bootstrap.cc:492] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:13.900415 10606 ts_tablet_manager.cc:1403] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:02:13.903333 10606 raft_consensus.cc:359] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.904074 10606 raft_consensus.cc:385] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.905182 10606 raft_consensus.cc:740] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.907234 10606 consensus_queue.cc:260] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.907992 10605 tablet_bootstrap.cc:492] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:13.908636 10607 tablet_bootstrap.cc:492] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:13.908645 10605 ts_tablet_manager.cc:1403] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 13:02:13.909600 10606 ts_tablet_manager.cc:1434] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:13.909621 10607 ts_tablet_manager.cc:1403] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.006s
I20260709 13:02:13.910897 10606 tablet_bootstrap.cc:492] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:13.912358 10605 raft_consensus.cc:359] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.913233 10605 raft_consensus.cc:385] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.913204 10607 raft_consensus.cc:359] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.913806 10605 raft_consensus.cc:740] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.914314 10607 raft_consensus.cc:385] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.914932 10605 consensus_queue.cc:260] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.915582 10618 raft_consensus.cc:493] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.916163 10618 raft_consensus.cc:515] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.918466 10606 tablet_bootstrap.cc:654] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.920006 10605 ts_tablet_manager.cc:1434] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:13.921144 10605 tablet_bootstrap.cc:492] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:13.921861 10618 leader_election.cc:290] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:13.914752 10607 raft_consensus.cc:740] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.933380 10607 consensus_queue.cc:260] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.934681 10610 raft_consensus.cc:493] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.935279 10610 raft_consensus.cc:515] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.935776 10607 ts_tablet_manager.cc:1434] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 13:02:13.940430 10610 leader_election.cc:290] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:13.956490 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cccadc9a2dcf42f78928b8c65d22c325" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
W20260709 13:02:13.963410 10529 leader_election.cc:343] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.967785 10606 tablet_bootstrap.cc:492] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:13.959194 10607 tablet_bootstrap.cc:492] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:13.969210 10606 ts_tablet_manager.cc:1403] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.000s
I20260709 13:02:13.971450 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cccadc9a2dcf42f78928b8c65d22c325" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:13.972384 10606 raft_consensus.cc:359] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
W20260709 13:02:13.973112 10530 leader_election.cc:343] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.973302 10606 raft_consensus.cc:385] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.973752 10606 raft_consensus.cc:740] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.973658 10530 leader_election.cc:304] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b830c0afee44934ae266f52e630f381; no voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:13.974681 10618 raft_consensus.cc:2749] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.974768 10606 consensus_queue.cc:260] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:13.977154 10606 ts_tablet_manager.cc:1434] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:13.978109 10607 tablet_bootstrap.cc:654] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.978259 10606 tablet_bootstrap.cc:492] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:13.985880 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:13.986986 10566 raft_consensus.cc:2468] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:13.984841 10605 tablet_bootstrap.cc:654] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.989341 10380 leader_election.cc:304] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:13.990468 10610 raft_consensus.cc:2804] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:13.990871 10610 raft_consensus.cc:493] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.991231 10610 raft_consensus.cc:3060] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.986392 10606 tablet_bootstrap.cc:654] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.997730 10610 raft_consensus.cc:515] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.000828 10605 tablet_bootstrap.cc:492] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:14.001348 10610 leader_election.cc:290] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.001641 10605 ts_tablet_manager.cc:1403] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.005s
I20260709 13:02:14.002453 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.003139 10566 raft_consensus.cc:3060] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.003899 10607 tablet_bootstrap.cc:492] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:14.004516 10607 ts_tablet_manager.cc:1403] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.011s
I20260709 13:02:14.005043 10606 tablet_bootstrap.cc:492] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:14.005714 10606 ts_tablet_manager.cc:1403] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.010s
I20260709 13:02:14.005250 10605 raft_consensus.cc:359] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.006204 10605 raft_consensus.cc:385] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.006528 10605 raft_consensus.cc:740] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.007475 10605 consensus_queue.cc:260] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.007721 10607 raft_consensus.cc:359] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.008510 10607 raft_consensus.cc:385] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.008824 10607 raft_consensus.cc:740] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.009506 10606 raft_consensus.cc:359] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.009707 10607 consensus_queue.cc:260] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.010409 10606 raft_consensus.cc:385] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.010864 10606 raft_consensus.cc:740] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.011668 10606 consensus_queue.cc:260] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.012792 10566 raft_consensus.cc:2468] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.014123 10380 leader_election.cc:304] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.017361 10610 raft_consensus.cc:493] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.017900 10610 raft_consensus.cc:515] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.018787 10606 ts_tablet_manager.cc:1434] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:02:14.020361 10606 tablet_bootstrap.cc:492] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:14.020679 10610 leader_election.cc:290] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.021335 10610 raft_consensus.cc:2804] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.021777 10610 raft_consensus.cc:697] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.022718 10610 consensus_queue.cc:237] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.025429 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.026889 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.027619 10607 ts_tablet_manager.cc:1434] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:02:14.028100 10606 tablet_bootstrap.cc:654] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.028452 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.029786 10605 ts_tablet_manager.cc:1434] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:02:14.030754 10607 tablet_bootstrap.cc:492] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
W20260709 13:02:14.030687 10381 leader_election.cc:343] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:14.033331 10381 leader_election.cc:343] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:14.034281 10381 leader_election.cc:343] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:14.038847 10363 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:14.038748 10605 tablet_bootstrap.cc:492] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:14.051062 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
W20260709 13:02:14.053349 10380 leader_election.cc:343] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.053877 10605 tablet_bootstrap.cc:654] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.054014 10380 leader_election.cc:304] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381
I20260709 13:02:14.058593 10630 raft_consensus.cc:2749] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.057188 10607 tablet_bootstrap.cc:654] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.063647 10606 tablet_bootstrap.cc:492] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:14.062618 10314 catalog_manager.cc:5697] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.064718 10606 ts_tablet_manager.cc:1403] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.019s
I20260709 13:02:14.069617 10606 raft_consensus.cc:359] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.070971 10606 raft_consensus.cc:385] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.071511 10606 raft_consensus.cc:740] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.072976 10606 consensus_queue.cc:260] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.076642 10605 tablet_bootstrap.cc:492] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:14.077313 10605 ts_tablet_manager.cc:1403] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.002s
I20260709 13:02:14.077468 10606 ts_tablet_manager.cc:1434] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:02:14.079202 10606 tablet_bootstrap.cc:492] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:14.079527 10607 tablet_bootstrap.cc:492] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:14.080129 10607 ts_tablet_manager.cc:1403] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.004s
I20260709 13:02:14.080739 10605 raft_consensus.cc:359] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.081578 10605 raft_consensus.cc:385] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.081871 10605 raft_consensus.cc:740] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.082661 10605 consensus_queue.cc:260] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.085004 10605 ts_tablet_manager.cc:1434] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:14.086112 10605 tablet_bootstrap.cc:492] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:14.090095 10606 tablet_bootstrap.cc:654] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.093365 10605 tablet_bootstrap.cc:654] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.083470 10607 raft_consensus.cc:359] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.100975 10607 raft_consensus.cc:385] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.101393 10607 raft_consensus.cc:740] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.102623 10607 consensus_queue.cc:260] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.105039 10606 tablet_bootstrap.cc:492] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:14.105944 10606 ts_tablet_manager.cc:1403] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:02:14.107833 10607 ts_tablet_manager.cc:1434] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:02:14.109081 10607 tablet_bootstrap.cc:492] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:14.109935 10605 tablet_bootstrap.cc:492] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:14.109731 10606 raft_consensus.cc:359] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.110549 10605 ts_tablet_manager.cc:1403] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:02:14.110726 10606 raft_consensus.cc:385] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.111202 10606 raft_consensus.cc:740] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.112119 10606 consensus_queue.cc:260] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.114811 10606 ts_tablet_manager.cc:1434] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:14.114292 10605 raft_consensus.cc:359] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.115562 10605 raft_consensus.cc:385] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.115914 10605 raft_consensus.cc:740] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.116148 10606 tablet_bootstrap.cc:492] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:14.116315 10607 tablet_bootstrap.cc:654] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.116824 10605 consensus_queue.cc:260] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.119426 10610 raft_consensus.cc:493] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.120325 10610 raft_consensus.cc:515] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.121040 10605 ts_tablet_manager.cc:1434] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 13:02:14.122119 10605 tablet_bootstrap.cc:492] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:14.124163 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.124786 10606 tablet_bootstrap.cc:654] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.124987 10566 raft_consensus.cc:2468] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.127208 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.128346 10491 raft_consensus.cc:2468] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.128616 10380 leader_election.cc:304] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.129448 10605 tablet_bootstrap.cc:654] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.130383 10630 raft_consensus.cc:2804] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.130964 10630 raft_consensus.cc:493] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.131389 10630 raft_consensus.cc:3060] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.132828 10610 leader_election.cc:290] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.133781 10612 raft_consensus.cc:493] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.134479 10612 raft_consensus.cc:515] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.141599 10612 leader_election.cc:290] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.146853 10612 raft_consensus.cc:493] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.147511 10612 raft_consensus.cc:515] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.148736 10607 tablet_bootstrap.cc:492] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:14.149369 10607 ts_tablet_manager.cc:1403] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.004s
I20260709 13:02:14.150359 10630 raft_consensus.cc:515] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.152635 10630 leader_election.cc:290] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.150410 10612 leader_election.cc:290] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.154325 10606 tablet_bootstrap.cc:492] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:14.153954 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.154829 10606 ts_tablet_manager.cc:1403] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.005s
I20260709 13:02:14.154917 10566 raft_consensus.cc:3060] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.157371 10606 raft_consensus.cc:359] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.158161 10606 raft_consensus.cc:385] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.158162 10605 tablet_bootstrap.cc:492] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:14.158713 10606 raft_consensus.cc:740] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.159147 10605 ts_tablet_manager.cc:1403] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.002s
I20260709 13:02:14.159580 10606 consensus_queue.cc:260] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.152411 10607 raft_consensus.cc:359] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.161821 10606 ts_tablet_manager.cc:1434] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:02:14.161970 10607 raft_consensus.cc:385] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.162287 10607 raft_consensus.cc:740] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.163121 10607 consensus_queue.cc:260] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.165244 10607 ts_tablet_manager.cc:1434] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:02:14.165833 10605 raft_consensus.cc:359] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.166323 10607 tablet_bootstrap.cc:492] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:14.166785 10605 raft_consensus.cc:385] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.167207 10605 raft_consensus.cc:740] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.168185 10605 consensus_queue.cc:260] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.170658 10605 ts_tablet_manager.cc:1434] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:14.172269 10566 raft_consensus.cc:2468] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.174253 10605 tablet_bootstrap.cc:492] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:14.187834 10380 leader_election.cc:304] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.188791 10630 raft_consensus.cc:2804] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.189312 10630 raft_consensus.cc:697] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.190156 10630 consensus_queue.cc:237] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.190822 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cccadc9a2dcf42f78928b8c65d22c325" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.191511 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.191599 10416 raft_consensus.cc:2468] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:14.193730 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cccadc9a2dcf42f78928b8c65d22c325" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.193885 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.194329 10605 tablet_bootstrap.cc:654] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.194429 10565 raft_consensus.cc:2468] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:14.194664 10417 raft_consensus.cc:2468] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:14.179445 10607 tablet_bootstrap.cc:654] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.185815 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.196178 10455 leader_election.cc:304] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.196573 10491 raft_consensus.cc:3060] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.197113 10612 raft_consensus.cc:2804] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.197259 10455 leader_election.cc:304] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.197549 10612 raft_consensus.cc:493] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.197975 10612 raft_consensus.cc:3060] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.200925 10313 catalog_manager.cc:5697] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.205857 10491 raft_consensus.cc:2468] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.206090 10612 raft_consensus.cc:515] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.208657 10646 raft_consensus.cc:2804] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:14.209086 10455 leader_election.cc:343] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.209566 10646 raft_consensus.cc:493] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.209944 10646 raft_consensus.cc:3060] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.214218 10607 tablet_bootstrap.cc:492] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:14.214875 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cccadc9a2dcf42f78928b8c65d22c325" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.215459 10612 leader_election.cc:290] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.215517 10417 raft_consensus.cc:3060] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.215636 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cccadc9a2dcf42f78928b8c65d22c325" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.216440 10566 raft_consensus.cc:3060] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.217443 10646 raft_consensus.cc:515] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.219282 10646 leader_election.cc:290] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.220016 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.220896 10416 raft_consensus.cc:3060] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.214875 10607 ts_tablet_manager.cc:1403] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
I20260709 13:02:14.223547 10417 raft_consensus.cc:2468] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:14.223546 10566 raft_consensus.cc:2468] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:14.227254 10607 raft_consensus.cc:359] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.227918 10607 raft_consensus.cc:385] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.228322 10607 raft_consensus.cc:740] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.228791 10605 tablet_bootstrap.cc:492] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:14.229347 10605 ts_tablet_manager.cc:1403] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.010s
I20260709 13:02:14.229166 10607 consensus_queue.cc:260] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.229846 10416 raft_consensus.cc:2468] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:14.231500 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.232358 10605 raft_consensus.cc:359] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.232872 10566 raft_consensus.cc:3060] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.233057 10605 raft_consensus.cc:385] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.233417 10605 raft_consensus.cc:740] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.234076 10605 consensus_queue.cc:260] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.236536 10605 ts_tablet_manager.cc:1434] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:14.237538 10605 tablet_bootstrap.cc:492] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:14.231860 10455 leader_election.cc:304] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:14.238286 10646 raft_consensus.cc:2804] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.237393 10618 raft_consensus.cc:493] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.238808 10646 raft_consensus.cc:697] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.239008 10455 leader_election.cc:304] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.239142 10618 raft_consensus.cc:515] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.231477 10607 ts_tablet_manager.cc:1434] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:14.239689 10646 consensus_queue.cc:237] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.240937 10607 tablet_bootstrap.cc:492] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:14.243355 10618 leader_election.cc:290] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:14.243606 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b243ff0baebd41938163c175369ea41e" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.244328 10491 raft_consensus.cc:2468] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
I20260709 13:02:14.244587 10612 raft_consensus.cc:2804] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.245183 10612 raft_consensus.cc:697] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.245949 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b243ff0baebd41938163c175369ea41e" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.246161 10530 leader_election.cc:304] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:14.247416 10618 raft_consensus.cc:2804] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.247840 10618 raft_consensus.cc:493] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.248267 10618 raft_consensus.cc:3060] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.239782 10566 raft_consensus.cc:2468] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:14.246045 10612 consensus_queue.cc:237] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.251906 10607 tablet_bootstrap.cc:654] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.252530 10416 raft_consensus.cc:2468] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
I20260709 13:02:14.255126 10605 tablet_bootstrap.cc:654] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.259557 10618 raft_consensus.cc:515] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.264631 10630 raft_consensus.cc:493] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.265252 10607 tablet_bootstrap.cc:492] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:14.265208 10630 raft_consensus.cc:515] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.265810 10607 ts_tablet_manager.cc:1403] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:02:14.265631 10605 tablet_bootstrap.cc:492] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:14.266412 10605 ts_tablet_manager.cc:1403] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 13:02:14.266505 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b243ff0baebd41938163c175369ea41e" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.267145 10416 raft_consensus.cc:3060] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.267446 10630 leader_election.cc:290] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.268826 10607 raft_consensus.cc:359] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.269338 10605 raft_consensus.cc:359] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.270143 10605 raft_consensus.cc:385] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.270059 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b72b24c3244629049a873bd831bf8" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.270730 10605 raft_consensus.cc:740] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.271644 10605 consensus_queue.cc:260] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
W20260709 13:02:14.271942 10380 leader_election.cc:343] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.269629 10607 raft_consensus.cc:385] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.272646 10607 raft_consensus.cc:740] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.273056 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b72b24c3244629049a873bd831bf8" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.273718 10491 raft_consensus.cc:2468] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.273620 10607 consensus_queue.cc:260] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.275285 10381 leader_election.cc:304] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 9b830c0afee44934ae266f52e630f381
I20260709 13:02:14.275645 10605 ts_tablet_manager.cc:1434] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:14.276868 10313 catalog_manager.cc:5697] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.278749 10416 raft_consensus.cc:2468] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:14.278199 10630 raft_consensus.cc:2804] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.280401 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b243ff0baebd41938163c175369ea41e" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.281077 10491 raft_consensus.cc:3060] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.280874 10630 raft_consensus.cc:493] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.281160 10529 leader_election.cc:304] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.281816 10630 raft_consensus.cc:3060] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.282536 10614 raft_consensus.cc:2804] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.282996 10313 catalog_manager.cc:5697] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.288846 10491 raft_consensus.cc:2468] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:14.279232 10618 leader_election.cc:290] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:14.279170 10607 ts_tablet_manager.cc:1434] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:14.291024 10630 raft_consensus.cc:515] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.291836 10607 tablet_bootstrap.cc:492] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:14.296721 10630 leader_election.cc:290] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.297674 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b72b24c3244629049a873bd831bf8" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.298339 10614 raft_consensus.cc:697] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
W20260709 13:02:14.299117 10380 leader_election.cc:343] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.299124 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b72b24c3244629049a873bd831bf8" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.299419 10614 consensus_queue.cc:237] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.300499 10491 raft_consensus.cc:3060] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.301143 10607 tablet_bootstrap.cc:654] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.305446 10612 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.301096 10630 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.306246 10612 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.306671 10630 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.310434 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.310676 10612 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.311124 10490 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.312363 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.313031 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.313725 10416 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:14.313410 10381 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.315371 10610 raft_consensus.cc:2804] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.315795 10610 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.316028 10610 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.316422 10612 raft_consensus.cc:493] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.316864 10612 raft_consensus.cc:515] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.317873 10607 tablet_bootstrap.cc:492] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:14.318301 10612 leader_election.cc:290] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.318426 10607 ts_tablet_manager.cc:1403] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:02:14.313493 10630 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.319888 10491 raft_consensus.cc:2468] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.313371 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.321565 10607 raft_consensus.cc:359] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.322288 10607 raft_consensus.cc:385] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.322573 10607 raft_consensus.cc:740] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.322747 10381 leader_election.cc:304] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 9b830c0afee44934ae266f52e630f381
I20260709 13:02:14.322995 10455 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 9b830c0afee44934ae266f52e630f381
I20260709 13:02:14.323601 10630 raft_consensus.cc:2804] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.323309 10607 consensus_queue.cc:260] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.324030 10612 raft_consensus.cc:2804] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.324414 10612 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.324723 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.325522 10607 ts_tablet_manager.cc:1434] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:14.324733 10612 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.325661 10416 raft_consensus.cc:2468] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:14.327412 10654 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.327725 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.328449 10565 raft_consensus.cc:2468] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:14.328363 10654 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.332142 10612 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.333380 10610 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.334147 10566 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.335510 10654 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:14.336282 10610 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.336417 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.337348 10416 raft_consensus.cc:2393] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b830c0afee44934ae266f52e630f381 in current term 1: Already voted for candidate fefaaaebea574a5192fd4677ef758607 in this term.
I20260709 13:02:14.333067 10455 leader_election.cc:304] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:14.338079 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.339152 10649 raft_consensus.cc:2804] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.339200 10566 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.339414 10612 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.339831 10649 raft_consensus.cc:493] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.340297 10649 raft_consensus.cc:3060] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.340710 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.341549 10416 raft_consensus.cc:2393] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d60d9c59d0b44aab8d1d917232ce058 in current term 1: Already voted for candidate fefaaaebea574a5192fd4677ef758607 in this term.
I20260709 13:02:14.341359 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.343889 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.344542 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.344807 10491 raft_consensus.cc:2393] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b830c0afee44934ae266f52e630f381 in current term 1: Already voted for candidate 7d60d9c59d0b44aab8d1d917232ce058 in this term.
I20260709 13:02:14.344728 10455 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058; no voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.346354 10530 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b830c0afee44934ae266f52e630f381; no voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.347028 10612 raft_consensus.cc:2749] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.347529 10610 raft_consensus.cc:493] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.347909 10313 catalog_manager.cc:5697] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.332700 10630 raft_consensus.cc:697] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.348951 10649 raft_consensus.cc:515] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.349937 10630 consensus_queue.cc:237] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.351186 10649 leader_election.cc:290] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.348515 10610 raft_consensus.cc:515] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.352859 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.352624 10566 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.353497 10416 raft_consensus.cc:3060] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.353650 10614 raft_consensus.cc:2749] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.355721 10610 leader_election.cc:290] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.357371 10380 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:14.358238 10610 raft_consensus.cc:2804] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.358978 10610 raft_consensus.cc:697] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.360476 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.363832 10566 raft_consensus.cc:2468] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.364166 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.364833 10565 raft_consensus.cc:3060] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.359948 10610 consensus_queue.cc:237] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.366940 10380 leader_election.cc:304] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.366729 10313 catalog_manager.cc:5697] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.368203 10657 raft_consensus.cc:2804] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.368822 10657 raft_consensus.cc:493] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.369290 10657 raft_consensus.cc:3060] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.362926 10416 raft_consensus.cc:2468] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:14.372303 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.373046 10491 raft_consensus.cc:2468] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:14.373448 10455 leader_election.cc:304] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.375535 10565 raft_consensus.cc:2468] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:14.376438 10649 raft_consensus.cc:2804] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.377180 10649 raft_consensus.cc:697] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.377841 10649 consensus_queue.cc:237] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.381035 10657 raft_consensus.cc:515] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.383409 10657 leader_election.cc:290] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.384881 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.385598 10565 raft_consensus.cc:3060] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.386827 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.387475 10491 raft_consensus.cc:3060] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.387254 10314 catalog_manager.cc:5697] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.391103 10313 catalog_manager.cc:5697] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.395586 10491 raft_consensus.cc:2468] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.395862 10565 raft_consensus.cc:2468] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:14.397224 10381 leader_election.cc:304] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.397989 10657 raft_consensus.cc:2804] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.398488 10657 raft_consensus.cc:697] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.399330 10657 consensus_queue.cc:237] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.406913 10313 catalog_manager.cc:5697] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.427812 10649 raft_consensus.cc:493] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.428678 10649 raft_consensus.cc:515] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.430694 10649 leader_election.cc:290] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.431602 10614 raft_consensus.cc:493] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.431535 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.432080 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:14.432288 10614 raft_consensus.cc:515] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.432952 10565 raft_consensus.cc:2393] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d60d9c59d0b44aab8d1d917232ce058 in current term 1: Already voted for candidate fefaaaebea574a5192fd4677ef758607 in this term.
I20260709 13:02:14.433931 10455 leader_election.cc:304] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058; no voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.434592 10614 leader_election.cc:290] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:14.435065 10649 raft_consensus.cc:3060] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.435532 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b72b24c3244629049a873bd831bf8" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:14.435740 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298b72b24c3244629049a873bd831bf8" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:14.436594 10491 raft_consensus.cc:2393] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b830c0afee44934ae266f52e630f381 in current term 1: Already voted for candidate fefaaaebea574a5192fd4677ef758607 in this term.
I20260709 13:02:14.437603 10530 leader_election.cc:304] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b830c0afee44934ae266f52e630f381; no voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.438663 10614 raft_consensus.cc:3060] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.443707 10649 raft_consensus.cc:2749] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.446146 10614 raft_consensus.cc:2749] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.500699 10491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
mode: GRACEFUL
new_leader_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:42734
I20260709 13:02:14.501418 10491 raft_consensus.cc:606] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Received request to transfer leadership to TS fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.510505 10491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
mode: GRACEFUL
new_leader_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:42734
I20260709 13:02:14.511112 10491 raft_consensus.cc:606] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Received request to transfer leadership to TS fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.527199 10565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b243ff0baebd41938163c175369ea41e"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
mode: GRACEFUL
new_leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:14.527776 10565 raft_consensus.cc:606] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Received request to transfer leadership to TS 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:14.541711 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:02:14.542356 10416 raft_consensus.cc:606] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:14.548110 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:02:14.548725 10416 raft_consensus.cc:606] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:14.554206 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:02:14.554761 10416 raft_consensus.cc:606] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 9b830c0afee44934ae266f52e630f381
I20260709 13:02:14.582010 10657 consensus_queue.cc:1048] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.588637 10657 raft_consensus.cc:993] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: : Instructing follower 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:14.589100 10657 raft_consensus.cc:1081] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:14.591949 10491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:42722
I20260709 13:02:14.593046 10657 consensus_queue.cc:1048] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.595155 10491 raft_consensus.cc:493] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.595671 10491 raft_consensus.cc:3060] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.597050 10630 consensus_queue.cc:1048] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.607538 10491 raft_consensus.cc:515] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.615099 10491 leader_election.cc:290] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.617940 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.618708 10416 raft_consensus.cc:3055] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.619084 10416 raft_consensus.cc:740] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.619910 10416 consensus_queue.cc:260] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.621155 10416 raft_consensus.cc:3060] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.625720 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00b68caa2554546a3394e5cd2987252" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.626529 10565 raft_consensus.cc:3060] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.629999 10416 raft_consensus.cc:2468] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:14.631326 10455 leader_election.cc:304] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.631615 10666 consensus_queue.cc:1048] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.632393 10649 raft_consensus.cc:2804] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.632893 10649 raft_consensus.cc:697] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.634042 10649 consensus_queue.cc:237] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.635960 10565 raft_consensus.cc:2468] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:14.642755 10657 raft_consensus.cc:993] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: : Instructing follower 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:14.643278 10666 raft_consensus.cc:1081] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:14.644954 10566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:59790
I20260709 13:02:14.644709 10314 catalog_manager.cc:5697] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.645525 10566 raft_consensus.cc:493] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.646085 10566 raft_consensus.cc:3060] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.652081 10566 raft_consensus.cc:515] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.655390 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.655594 10566 leader_election.cc:290] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:14.656054 10416 raft_consensus.cc:3055] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.656442 10416 raft_consensus.cc:740] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.656839 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fe6f11c37465587328a4bcd2a2e06" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.657248 10416 consensus_queue.cc:260] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.657524 10491 raft_consensus.cc:3060] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.658605 10416 raft_consensus.cc:3060] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.664959 10416 raft_consensus.cc:2468] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 2.
I20260709 13:02:14.664994 10491 raft_consensus.cc:2468] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 2.
I20260709 13:02:14.666159 10529 leader_election.cc:304] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.667101 10614 raft_consensus.cc:2804] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.667606 10614 raft_consensus.cc:697] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 2 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:14.667871 10649 consensus_queue.cc:1048] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.668499 10614 consensus_queue.cc:237] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.670718 10649 consensus_queue.cc:1048] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.678480 10313 catalog_manager.cc:5697] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.685920 10646 consensus_queue.cc:1048] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.697350 10612 consensus_queue.cc:1048] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.701602 10649 raft_consensus.cc:993] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: : Instructing follower fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:14.703118 10612 raft_consensus.cc:1081] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Signalling peer fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:14.705479 10417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:58010
I20260709 13:02:14.706153 10417 raft_consensus.cc:493] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.706590 10417 raft_consensus.cc:3060] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.717253 10417 raft_consensus.cc:515] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.719381 10417 leader_election.cc:290] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.721935 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.722033 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6300b3b0c8c4af3a2ae2e4da3fd8841" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.722589 10565 raft_consensus.cc:3060] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.722741 10491 raft_consensus.cc:3055] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.723766 10491 raft_consensus.cc:740] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.724699 10654 consensus_queue.cc:1048] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.724642 10491 consensus_queue.cc:260] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.725980 10491 raft_consensus.cc:3060] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.729167 10565 raft_consensus.cc:2468] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:14.730659 10380 leader_election.cc:304] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.732151 10666 raft_consensus.cc:2804] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.732702 10666 raft_consensus.cc:697] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.733531 10666 consensus_queue.cc:237] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.735641 10491 raft_consensus.cc:2468] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:14.741779 10614 raft_consensus.cc:993] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: : Instructing follower 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:14.742259 10614 raft_consensus.cc:1081] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Signalling peer 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:14.743351 10315 catalog_manager.cc:5697] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 1 to 2, leader changed from 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194) to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.749354 10491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b243ff0baebd41938163c175369ea41e"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:02:14.750125 10491 raft_consensus.cc:493] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.750530 10491 raft_consensus.cc:3060] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.756840 10614 consensus_queue.cc:1048] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.758069 10491 raft_consensus.cc:515] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.762672 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b243ff0baebd41938163c175369ea41e" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.764650 10673 consensus_queue.cc:1048] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.767562 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b243ff0baebd41938163c175369ea41e" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.768515 10565 raft_consensus.cc:3055] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.768949 10565 raft_consensus.cc:740] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:14.770227 10565 consensus_queue.cc:260] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.771585 10565 raft_consensus.cc:3060] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.774607 10491 leader_election.cc:290] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.789896 10565 raft_consensus.cc:2468] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:14.791226 10666 consensus_queue.cc:1048] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.791375 10649 consensus_queue.cc:1048] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.791519 10455 leader_election.cc:304] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: fefaaaebea574a5192fd4677ef758607
I20260709 13:02:14.792868 10612 raft_consensus.cc:2804] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.793401 10612 raft_consensus.cc:697] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.794247 10612 consensus_queue.cc:237] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.802664 10313 catalog_manager.cc:5697] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 1 to 2, leader changed from 9b830c0afee44934ae266f52e630f381 (127.0.107.195) to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.806293 10610 consensus_queue.cc:1048] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.819777 10612 raft_consensus.cc:993] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: : Instructing follower fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:14.820299 10612 raft_consensus.cc:1081] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Signalling peer fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:14.822103 10417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:58010
I20260709 13:02:14.822741 10417 raft_consensus.cc:493] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.823113 10417 raft_consensus.cc:3060] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.829126 10417 raft_consensus.cc:515] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.830869 10417 leader_election.cc:290] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.831785 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:14.832011 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca8ba33c6244956886ae26068d4863f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.832566 10491 raft_consensus.cc:3055] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.833345 10491 raft_consensus.cc:740] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.833148 10565 raft_consensus.cc:3060] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.834769 10491 consensus_queue.cc:260] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.836427 10491 raft_consensus.cc:3060] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.836763 10610 consensus_queue.cc:1048] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:14.845119 10565 raft_consensus.cc:2468] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:14.845818 10491 raft_consensus.cc:2468] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:14.847029 10380 leader_election.cc:304] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:14.847975 10610 raft_consensus.cc:2804] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.848603 10610 raft_consensus.cc:697] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.849618 10610 consensus_queue.cc:237] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.858335 10666 consensus_queue.cc:1048] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.858495 10314 catalog_manager.cc:5697] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 1 to 2, leader changed from 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194) to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.939671 10666 consensus_queue.cc:1048] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.951364 10610 consensus_queue.cc:1048] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.959672 10610 raft_consensus.cc:993] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: : Instructing follower 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:14.960208 10610 raft_consensus.cc:1081] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:14.961906 10492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:42722
I20260709 13:02:14.962440 10492 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.962833 10492 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.968488 10492 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.970376 10492 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:14.971689 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:14.972086 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:14.973215 10565 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.973909 10417 raft_consensus.cc:3055] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.974596 10417 raft_consensus.cc:740] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:14.975452 10417 consensus_queue.cc:260] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.976702 10417 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.980608 10565 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:14.981887 10455 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:14.982113 10417 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:14.982834 10646 raft_consensus.cc:2804] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.983372 10646 raft_consensus.cc:697] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:14.984182 10646 consensus_queue.cc:237] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:14.990854 10315 catalog_manager.cc:5697] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.107568 10417 raft_consensus.cc:1275] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.108759 10492 raft_consensus.cc:1275] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.108861 10614 consensus_queue.cc:1048] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.110181 10618 consensus_queue.cc:1048] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.149115 10417 raft_consensus.cc:1275] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.150442 10646 consensus_queue.cc:1048] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.154089 10565 raft_consensus.cc:1275] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.155097 10566 raft_consensus.cc:1275] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.155730 10646 consensus_queue.cc:1048] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.156832 10610 consensus_queue.cc:1048] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.166329 10492 raft_consensus.cc:1275] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.168442 10666 consensus_queue.cc:1048] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.207409 10565 raft_consensus.cc:1275] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.208873 10646 consensus_queue.cc:1048] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.218899 10417 raft_consensus.cc:3060] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.226688 10417 raft_consensus.cc:1275] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.228454 10649 consensus_queue.cc:1048] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.283354 10565 raft_consensus.cc:1275] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.284745 10666 consensus_queue.cc:1048] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.292582 10492 raft_consensus.cc:1275] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.294100 10666 consensus_queue.cc:1048] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.416764 10565 raft_consensus.cc:1275] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.418080 10649 consensus_queue.cc:1048] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.423585 10417 raft_consensus.cc:1275] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.425297 10673 consensus_queue.cc:1048] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.584426 10313 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40302:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:17.586668 10313 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:17.642675 10406 tablet_service.cc:1511] Processing CreateTablet for tablet 9811fff2b43a412a9fb6a993d88d2821 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:17.643889 10406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9811fff2b43a412a9fb6a993d88d2821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.644107 10479 tablet_service.cc:1511] Processing CreateTablet for tablet 9811fff2b43a412a9fb6a993d88d2821 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:17.645471 10479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9811fff2b43a412a9fb6a993d88d2821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.647650 10480 tablet_service.cc:1511] Processing CreateTablet for tablet d4c0f7704ba64ec2a07db9796e2bbbfe (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:17.649138 10480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c0f7704ba64ec2a07db9796e2bbbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.651371 10554 tablet_service.cc:1511] Processing CreateTablet for tablet 9811fff2b43a412a9fb6a993d88d2821 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:17.653013 10554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9811fff2b43a412a9fb6a993d88d2821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.652745 10402 tablet_service.cc:1511] Processing CreateTablet for tablet d4c0f7704ba64ec2a07db9796e2bbbfe (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:17.654071 10402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c0f7704ba64ec2a07db9796e2bbbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.657272 10553 tablet_service.cc:1511] Processing CreateTablet for tablet d4c0f7704ba64ec2a07db9796e2bbbfe (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:17.658275 10399 tablet_service.cc:1511] Processing CreateTablet for tablet c12d1f7470184381b693f2b8211e693f (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:17.659723 10399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12d1f7470184381b693f2b8211e693f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.662633 10481 tablet_service.cc:1511] Processing CreateTablet for tablet 858c570fc8f141c8901de20bdc550223 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:17.663352 10478 tablet_service.cc:1511] Processing CreateTablet for tablet b8824884fcd346a4bdd6fe6ce338d855 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:17.664103 10481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858c570fc8f141c8901de20bdc550223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.657272 10482 tablet_service.cc:1511] Processing CreateTablet for tablet c12d1f7470184381b693f2b8211e693f (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:17.665016 10478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8824884fcd346a4bdd6fe6ce338d855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.665752 10482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12d1f7470184381b693f2b8211e693f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.666246 10474 tablet_service.cc:1511] Processing CreateTablet for tablet 36fffe7baa384b2988070ea389f55bad (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:17.667608 10474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fffe7baa384b2988070ea389f55bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.669977 10555 tablet_service.cc:1511] Processing CreateTablet for tablet c12d1f7470184381b693f2b8211e693f (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:17.658720 10553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c0f7704ba64ec2a07db9796e2bbbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.679510 10477 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7fc682fbf84a1baeee7cab59a4b1b1 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:17.681346 10477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7fc682fbf84a1baeee7cab59a4b1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.681486 10475 tablet_service.cc:1511] Processing CreateTablet for tablet 94d7a6678c0e4eff86f69e87f9aabb29 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:17.682901 10475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d7a6678c0e4eff86f69e87f9aabb29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.683302 10476 tablet_service.cc:1511] Processing CreateTablet for tablet f9d99fa200de45c789c0fa6c57f9d40f (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:17.673662 10403 tablet_service.cc:1511] Processing CreateTablet for tablet 858c570fc8f141c8901de20bdc550223 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:17.684675 10476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d99fa200de45c789c0fa6c57f9d40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.684973 10403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858c570fc8f141c8901de20bdc550223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.688736 10555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12d1f7470184381b693f2b8211e693f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.696916 10551 tablet_service.cc:1511] Processing CreateTablet for tablet 858c570fc8f141c8901de20bdc550223 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:17.697089 10550 tablet_service.cc:1511] Processing CreateTablet for tablet 36fffe7baa384b2988070ea389f55bad (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:17.698428 10551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858c570fc8f141c8901de20bdc550223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.698864 10548 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7fc682fbf84a1baeee7cab59a4b1b1 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:17.699700 10552 tablet_service.cc:1511] Processing CreateTablet for tablet f9d99fa200de45c789c0fa6c57f9d40f (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:17.701247 10556 tablet_service.cc:1511] Processing CreateTablet for tablet 94d7a6678c0e4eff86f69e87f9aabb29 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:17.702095 10401 tablet_service.cc:1511] Processing CreateTablet for tablet 36fffe7baa384b2988070ea389f55bad (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:17.703413 10401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fffe7baa384b2988070ea389f55bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.703210 10404 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7fc682fbf84a1baeee7cab59a4b1b1 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:17.704514 10404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7fc682fbf84a1baeee7cab59a4b1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.705175 10407 tablet_service.cc:1511] Processing CreateTablet for tablet b8824884fcd346a4bdd6fe6ce338d855 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:17.706489 10407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8824884fcd346a4bdd6fe6ce338d855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.698523 10549 tablet_service.cc:1511] Processing CreateTablet for tablet b8824884fcd346a4bdd6fe6ce338d855 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:17.708825 10548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7fc682fbf84a1baeee7cab59a4b1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.709518 10549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8824884fcd346a4bdd6fe6ce338d855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.709275 10400 tablet_service.cc:1511] Processing CreateTablet for tablet 94d7a6678c0e4eff86f69e87f9aabb29 (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:17.710592 10400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d7a6678c0e4eff86f69e87f9aabb29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.712504 10405 tablet_service.cc:1511] Processing CreateTablet for tablet f9d99fa200de45c789c0fa6c57f9d40f (DEFAULT_TABLE table=soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:17.713888 10405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d99fa200de45c789c0fa6c57f9d40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.718436 10552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d99fa200de45c789c0fa6c57f9d40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.720813 10556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d7a6678c0e4eff86f69e87f9aabb29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.728761 10550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fffe7baa384b2988070ea389f55bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.793404 10701 tablet_bootstrap.cc:492] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:17.821756 10702 tablet_bootstrap.cc:492] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:17.848100 10701 tablet_bootstrap.cc:654] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.851349 10703 tablet_bootstrap.cc:492] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:17.851963 10702 tablet_bootstrap.cc:654] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.871606 10701 tablet_bootstrap.cc:492] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:17.872165 10701 ts_tablet_manager.cc:1403] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.013s
I20260709 13:02:17.872918 10702 tablet_bootstrap.cc:492] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:17.873558 10702 ts_tablet_manager.cc:1403] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.014s
I20260709 13:02:17.873673 10703 tablet_bootstrap.cc:654] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.875290 10701 raft_consensus.cc:359] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.876130 10701 raft_consensus.cc:385] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.876464 10701 raft_consensus.cc:740] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.877244 10701 consensus_queue.cc:260] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.879091 10703 tablet_bootstrap.cc:492] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:17.878964 10702 raft_consensus.cc:359] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.879839 10703 ts_tablet_manager.cc:1403] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.005s
I20260709 13:02:17.879869 10702 raft_consensus.cc:385] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.880635 10702 raft_consensus.cc:740] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.881423 10702 consensus_queue.cc:260] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.883857 10702 ts_tablet_manager.cc:1434] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:17.883776 10703 raft_consensus.cc:359] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.884553 10701 ts_tablet_manager.cc:1434] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:17.884976 10703 raft_consensus.cc:385] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.885193 10702 tablet_bootstrap.cc:492] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:17.885390 10703 raft_consensus.cc:740] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.886358 10703 consensus_queue.cc:260] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.888679 10703 ts_tablet_manager.cc:1434] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:17.890074 10703 tablet_bootstrap.cc:492] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:17.894970 10702 tablet_bootstrap.cc:654] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.898451 10703 tablet_bootstrap.cc:654] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.885646 10701 tablet_bootstrap.cc:492] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:17.905503 10703 tablet_bootstrap.cc:492] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:17.906244 10703 ts_tablet_manager.cc:1403] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:02:17.911158 10701 tablet_bootstrap.cc:654] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.910573 10703 raft_consensus.cc:359] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.911739 10703 raft_consensus.cc:385] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.912160 10703 raft_consensus.cc:740] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.913244 10703 consensus_queue.cc:260] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.916560 10703 ts_tablet_manager.cc:1434] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:02:17.917626 10702 tablet_bootstrap.cc:492] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:17.917656 10703 tablet_bootstrap.cc:492] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:17.918497 10702 ts_tablet_manager.cc:1403] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.020s
I20260709 13:02:17.921800 10702 raft_consensus.cc:359] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.922432 10701 tablet_bootstrap.cc:492] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:17.922597 10702 raft_consensus.cc:385] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.923237 10702 raft_consensus.cc:740] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.923396 10701 ts_tablet_manager.cc:1403] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.007s
I20260709 13:02:17.924167 10702 consensus_queue.cc:260] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.924789 10703 tablet_bootstrap.cc:654] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.926970 10702 ts_tablet_manager.cc:1434] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:17.926972 10701 raft_consensus.cc:359] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.928109 10701 raft_consensus.cc:385] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.928333 10702 tablet_bootstrap.cc:492] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:17.928537 10701 raft_consensus.cc:740] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.929512 10701 consensus_queue.cc:260] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.938659 10702 tablet_bootstrap.cc:654] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.940379 10701 ts_tablet_manager.cc:1434] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:02:17.948698 10701 tablet_bootstrap.cc:492] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:17.950526 10703 tablet_bootstrap.cc:492] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:17.951139 10703 ts_tablet_manager.cc:1403] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.009s
I20260709 13:02:17.951558 10702 tablet_bootstrap.cc:492] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:17.952124 10702 ts_tablet_manager.cc:1403] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.014s
I20260709 13:02:17.954366 10703 raft_consensus.cc:359] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.955209 10703 raft_consensus.cc:385] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.955426 10701 tablet_bootstrap.cc:654] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.955122 10702 raft_consensus.cc:359] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.955667 10703 raft_consensus.cc:740] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.956054 10702 raft_consensus.cc:385] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.956408 10702 raft_consensus.cc:740] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.956576 10703 consensus_queue.cc:260] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.957183 10702 consensus_queue.cc:260] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.959336 10703 ts_tablet_manager.cc:1434] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:17.960877 10703 tablet_bootstrap.cc:492] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:17.961246 10686 raft_consensus.cc:493] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.961997 10686 raft_consensus.cc:515] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.968880 10689 raft_consensus.cc:493] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.969512 10703 tablet_bootstrap.cc:654] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.969491 10689 raft_consensus.cc:515] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.970498 10702 ts_tablet_manager.cc:1434] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:02:17.971705 10702 tablet_bootstrap.cc:492] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:17.972929 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:17.973419 10689 leader_election.cc:290] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:17.974716 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
W20260709 13:02:17.975443 10381 leader_election.cc:343] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:17.974716 10592 tablet.cc:2406] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:02:17.982735 10380 leader_election.cc:343] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.983358 10380 leader_election.cc:304] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381
I20260709 13:02:17.983922 10686 leader_election.cc:290] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:17.984046 10703 tablet_bootstrap.cc:492] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:17.984808 10703 ts_tablet_manager.cc:1403] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:02:17.985234 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:17.985472 10689 raft_consensus.cc:2749] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.985292 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
W20260709 13:02:17.987864 10529 leader_election.cc:343] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:17.988530 10530 leader_election.cc:343] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:17.988108 10703 raft_consensus.cc:359] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.989055 10530 leader_election.cc:304] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b830c0afee44934ae266f52e630f381; no voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:17.989143 10703 raft_consensus.cc:385] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.989717 10703 raft_consensus.cc:740] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.990623 10703 consensus_queue.cc:260] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.991906 10701 tablet_bootstrap.cc:492] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:17.992007 10702 tablet_bootstrap.cc:654] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:17.992576 10701 ts_tablet_manager.cc:1403] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.020s
I20260709 13:02:17.993476 10703 ts_tablet_manager.cc:1434] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:17.994660 10703 tablet_bootstrap.cc:492] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:17.995842 10701 raft_consensus.cc:359] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:17.996313 10686 raft_consensus.cc:2749] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:17.996677 10701 raft_consensus.cc:385] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:17.997066 10701 raft_consensus.cc:740] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:17.997967 10701 consensus_queue.cc:260] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.001461 10701 ts_tablet_manager.cc:1434] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:02:18.002645 10701 tablet_bootstrap.cc:492] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:18.004838 10702 tablet_bootstrap.cc:492] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:18.005518 10702 ts_tablet_manager.cc:1403] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.005s
I20260709 13:02:18.007022 10703 tablet_bootstrap.cc:654] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.009183 10701 tablet_bootstrap.cc:654] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.008961 10702 raft_consensus.cc:359] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.010012 10702 raft_consensus.cc:385] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.010509 10702 raft_consensus.cc:740] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.011631 10702 consensus_queue.cc:260] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.014032 10702 ts_tablet_manager.cc:1434] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:18.015198 10702 tablet_bootstrap.cc:492] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:18.021350 10701 tablet_bootstrap.cc:492] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:18.022017 10701 ts_tablet_manager.cc:1403] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:02:18.024693 10703 tablet_bootstrap.cc:492] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:18.025068 10702 tablet_bootstrap.cc:654] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.025296 10703 ts_tablet_manager.cc:1403] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 13:02:18.025266 10701 raft_consensus.cc:359] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.026242 10701 raft_consensus.cc:385] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.026578 10701 raft_consensus.cc:740] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.027426 10701 consensus_queue.cc:260] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.030228 10701 ts_tablet_manager.cc:1434] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:02:18.029578 10703 raft_consensus.cc:359] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.030881 10703 raft_consensus.cc:385] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.031368 10701 tablet_bootstrap.cc:492] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:18.031363 10703 raft_consensus.cc:740] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.032884 10703 consensus_queue.cc:260] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.038156 10702 tablet_bootstrap.cc:492] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:18.038440 10701 tablet_bootstrap.cc:654] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.038763 10702 ts_tablet_manager.cc:1403] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:02:18.039942 10703 ts_tablet_manager.cc:1434] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:02:18.041218 10703 tablet_bootstrap.cc:492] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:18.042392 10702 raft_consensus.cc:359] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.043200 10702 raft_consensus.cc:385] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.043524 10702 raft_consensus.cc:740] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.044502 10702 consensus_queue.cc:260] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.050293 10703 tablet_bootstrap.cc:654] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.059223 10702 ts_tablet_manager.cc:1434] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.012s
I20260709 13:02:18.060688 10696 raft_consensus.cc:493] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.061542 10696 raft_consensus.cc:515] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.060976 10702 tablet_bootstrap.cc:492] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:18.064275 10703 tablet_bootstrap.cc:492] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:18.064970 10703 ts_tablet_manager.cc:1403] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 13:02:18.067678 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:18.068161 10703 raft_consensus.cc:359] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.069176 10703 raft_consensus.cc:385] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.069556 10703 raft_consensus.cc:740] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.069777 10702 tablet_bootstrap.cc:654] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:18.069972 10455 leader_election.cc:343] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.070475 10703 consensus_queue.cc:260] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.071694 10696 leader_election.cc:290] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.073952 10703 ts_tablet_manager.cc:1434] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:18.073982 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.076426 10566 raft_consensus.cc:2468] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
W20260709 13:02:18.080881 10363 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:18.092589 10455 leader_election.cc:304] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: fefaaaebea574a5192fd4677ef758607
I20260709 13:02:18.093541 10673 raft_consensus.cc:2804] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.092586 10701 tablet_bootstrap.cc:492] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:18.093952 10673 raft_consensus.cc:493] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.094708 10701 ts_tablet_manager.cc:1403] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.064s	user 0.034s	sys 0.021s
I20260709 13:02:18.094718 10673 raft_consensus.cc:3060] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.094103 10689 raft_consensus.cc:493] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.101105 10689 raft_consensus.cc:515] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.097877 10701 raft_consensus.cc:359] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.104866 10701 raft_consensus.cc:385] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.105096 10689 leader_election.cc:290] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.105194 10701 raft_consensus.cc:740] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.107280 10701 consensus_queue.cc:260] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.108841 10703 tablet_bootstrap.cc:492] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:18.116557 10673 raft_consensus.cc:515] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.119237 10673 leader_election.cc:290] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.120116 10702 tablet_bootstrap.cc:492] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:18.120764 10702 ts_tablet_manager.cc:1403] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.028s
I20260709 13:02:18.121631 10703 tablet_bootstrap.cc:654] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.123876 10702 raft_consensus.cc:359] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.124778 10702 raft_consensus.cc:385] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.125141 10702 raft_consensus.cc:740] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.126370 10701 ts_tablet_manager.cc:1434] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 13:02:18.126323 10702 consensus_queue.cc:260] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.130117 10701 tablet_bootstrap.cc:492] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:18.135337 10702 ts_tablet_manager.cc:1434] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:02:18.138032 10702 tablet_bootstrap.cc:492] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:18.141415 10701 tablet_bootstrap.cc:654] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.143693 10703 tablet_bootstrap.cc:492] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:18.143476 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:18.144275 10703 ts_tablet_manager.cc:1403] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.015s
I20260709 13:02:18.146309 10702 tablet_bootstrap.cc:654] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.147523 10703 raft_consensus.cc:359] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.148012 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.148360 10703 raft_consensus.cc:385] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.148653 10566 raft_consensus.cc:3060] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.148703 10703 raft_consensus.cc:740] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.149622 10703 consensus_queue.cc:260] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.152184 10703 ts_tablet_manager.cc:1434] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:02:18.153929 10703 tablet_bootstrap.cc:492] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:18.156394 10702 tablet_bootstrap.cc:492] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:18.156991 10702 ts_tablet_manager.cc:1403] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:02:18.157267 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.160663 10703 tablet_bootstrap.cc:654] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:18.160487 10381 leader_election.cc:343] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.160399 10702 raft_consensus.cc:359] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.161418 10702 raft_consensus.cc:385] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.161744 10702 raft_consensus.cc:740] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.162477 10702 consensus_queue.cc:260] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
W20260709 13:02:18.163590 10455 leader_election.cc:343] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.165140 10566 raft_consensus.cc:2468] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:18.165164 10702 ts_tablet_manager.cc:1434] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:18.166842 10702 tablet_bootstrap.cc:492] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:18.171291 10701 tablet_bootstrap.cc:492] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:18.171991 10703 tablet_bootstrap.cc:492] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:18.172597 10703 ts_tablet_manager.cc:1403] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.010s
I20260709 13:02:18.172623 10455 leader_election.cc:304] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: fefaaaebea574a5192fd4677ef758607
I20260709 13:02:18.173297 10702 tablet_bootstrap.cc:654] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.175459 10703 raft_consensus.cc:359] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.176194 10703 raft_consensus.cc:385] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.176530 10703 raft_consensus.cc:740] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.171993 10701 ts_tablet_manager.cc:1403] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.005s
I20260709 13:02:18.177343 10703 consensus_queue.cc:260] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.179417 10703 ts_tablet_manager.cc:1434] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:18.175961 10696 raft_consensus.cc:2804] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.180464 10703 tablet_bootstrap.cc:492] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: Bootstrap starting.
I20260709 13:02:18.180568 10696 raft_consensus.cc:697] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:18.181509 10696 consensus_queue.cc:237] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.186673 10701 raft_consensus.cc:359] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.187989 10701 raft_consensus.cc:385] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.188515 10701 raft_consensus.cc:740] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.190096 10703 tablet_bootstrap.cc:654] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.189623 10701 consensus_queue.cc:260] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.193264 10689 raft_consensus.cc:493] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.194093 10689 raft_consensus.cc:515] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.195998 10701 ts_tablet_manager.cc:1434] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:02:18.198494 10701 tablet_bootstrap.cc:492] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:18.200819 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12d1f7470184381b693f2b8211e693f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.201879 10492 raft_consensus.cc:2468] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.203776 10381 leader_election.cc:304] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.205564 10724 raft_consensus.cc:2804] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.206125 10724 raft_consensus.cc:493] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.206010 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12d1f7470184381b693f2b8211e693f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.206899 10724 raft_consensus.cc:3060] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.207314 10565 raft_consensus.cc:2468] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.203732 10689 leader_election.cc:290] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.220013 10724 raft_consensus.cc:515] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.220664 10689 raft_consensus.cc:493] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.221753 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.231618 10701 tablet_bootstrap.cc:654] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.231019 10689 raft_consensus.cc:515] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.224529 10703 tablet_bootstrap.cc:492] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: No bootstrap required, opened a new log
I20260709 13:02:18.236796 10703 ts_tablet_manager.cc:1403] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.016s
I20260709 13:02:18.235685 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12d1f7470184381b693f2b8211e693f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.237488 10492 raft_consensus.cc:3060] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.240353 10703 raft_consensus.cc:359] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.241205 10703 raft_consensus.cc:385] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.241492 10703 raft_consensus.cc:740] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.242326 10703 consensus_queue.cc:260] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.246975 10702 tablet_bootstrap.cc:492] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:18.244676 10724 leader_election.cc:290] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.247515 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12d1f7470184381b693f2b8211e693f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.248189 10565 raft_consensus.cc:3060] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.247553 10702 ts_tablet_manager.cc:1403] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.081s	user 0.042s	sys 0.036s
I20260709 13:02:18.251839 10720 raft_consensus.cc:493] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.252422 10720 raft_consensus.cc:515] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.254637 10720 leader_election.cc:290] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.254516 10702 raft_consensus.cc:359] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.255359 10702 raft_consensus.cc:385] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.255641 10702 raft_consensus.cc:740] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.255756 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.256404 10702 consensus_queue.cc:260] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.257054 10491 raft_consensus.cc:2468] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.258651 10702 ts_tablet_manager.cc:1434] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:02:18.258407 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:18.259369 10417 raft_consensus.cc:2468] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
I20260709 13:02:18.261036 10529 leader_election.cc:304] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.262110 10720 raft_consensus.cc:2804] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.262498 10720 raft_consensus.cc:493] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.262871 10720 raft_consensus.cc:3060] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.262661 10381 leader_election.cc:304] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.266289 10702 tablet_bootstrap.cc:492] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: Bootstrap starting.
I20260709 13:02:18.255963 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.268867 10490 raft_consensus.cc:2468] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
I20260709 13:02:18.270802 10720 raft_consensus.cc:515] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.272734 10314 catalog_manager.cc:5697] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.275192 10689 leader_election.cc:290] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.275725 10720 leader_election.cc:290] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.276136 10724 raft_consensus.cc:2804] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.276678 10724 raft_consensus.cc:493] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.276983 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:18.277944 10417 raft_consensus.cc:3060] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.245011 10566 raft_consensus.cc:2468] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.277120 10724 raft_consensus.cc:3060] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.284488 10703 ts_tablet_manager.cc:1434] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.015s
I20260709 13:02:18.286976 10701 tablet_bootstrap.cc:492] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:18.287600 10701 ts_tablet_manager.cc:1403] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.089s	user 0.022s	sys 0.012s
I20260709 13:02:18.287462 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.288422 10491 raft_consensus.cc:3060] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.290107 10492 raft_consensus.cc:2468] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.291020 10701 raft_consensus.cc:359] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.291795 10701 raft_consensus.cc:385] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.292091 10701 raft_consensus.cc:740] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.292982 10701 consensus_queue.cc:260] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.293270 10380 leader_election.cc:304] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.294153 10734 raft_consensus.cc:2804] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.294551 10734 raft_consensus.cc:493] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.294880 10734 raft_consensus.cc:3060] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.294766 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.295639 10566 raft_consensus.cc:2468] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.298991 10724 raft_consensus.cc:515] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.302522 10734 raft_consensus.cc:515] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.300633 10702 tablet_bootstrap.cc:654] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.304481 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.305199 10566 raft_consensus.cc:3060] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.306279 10564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.304733 10734 leader_election.cc:290] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.307093 10564 raft_consensus.cc:3060] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.306615 10701 ts_tablet_manager.cc:1434] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:02:18.308811 10724 leader_election.cc:290] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.310231 10701 tablet_bootstrap.cc:492] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:18.324493 10701 tablet_bootstrap.cc:654] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.354809 10417 raft_consensus.cc:2468] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:18.358234 10491 raft_consensus.cc:2468] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:18.360361 10565 raft_consensus.cc:2468] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.362233 10530 leader_election.cc:304] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
W20260709 13:02:18.362862 10381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43023, user_credentials={real_user=slave}} blocked reactor thread for 91522.4us
I20260709 13:02:18.363477 10720 raft_consensus.cc:2804] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.362274 10380 leader_election.cc:304] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.364499 10720 raft_consensus.cc:697] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:18.365439 10720 consensus_queue.cc:237] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.366276 10735 raft_consensus.cc:2804] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.367120 10735 raft_consensus.cc:697] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.367624 10723 raft_consensus.cc:493] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.368018 10735 consensus_queue.cc:237] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.368466 10723 raft_consensus.cc:515] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.376641 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.377207 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.378050 10491 raft_consensus.cc:3060] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.378288 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8824884fcd346a4bdd6fe6ce338d855" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:18.379024 10416 raft_consensus.cc:2468] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
W20260709 13:02:18.381436 10381 leader_election.cc:343] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.381600 10455 leader_election.cc:304] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.383529 10563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8824884fcd346a4bdd6fe6ce338d855" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.385377 10563 raft_consensus.cc:2468] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 0.
I20260709 13:02:18.384496 10673 raft_consensus.cc:2804] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.386502 10673 raft_consensus.cc:493] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.386987 10673 raft_consensus.cc:3060] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.371840 10723 leader_election.cc:290] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.397092 10564 raft_consensus.cc:2468] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.398919 10380 leader_election.cc:304] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.400614 10724 raft_consensus.cc:2804] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.401244 10724 raft_consensus.cc:697] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.402343 10724 consensus_queue.cc:237] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.411530 10491 raft_consensus.cc:2468] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.415475 10702 tablet_bootstrap.cc:492] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: No bootstrap required, opened a new log
I20260709 13:02:18.416428 10702 ts_tablet_manager.cc:1403] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: Time spent bootstrapping tablet: real 0.150s	user 0.035s	sys 0.024s
I20260709 13:02:18.412304 10566 raft_consensus.cc:2468] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.415298 10381 leader_election.cc:304] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.418586 10689 raft_consensus.cc:2804] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.418771 10673 raft_consensus.cc:515] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.419353 10689 raft_consensus.cc:697] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.420666 10689 consensus_queue.cc:237] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.423163 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8824884fcd346a4bdd6fe6ce338d855" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:18.423550 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8824884fcd346a4bdd6fe6ce338d855" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.423990 10417 raft_consensus.cc:3060] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.424258 10566 raft_consensus.cc:3060] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.422708 10673 leader_election.cc:290] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.430900 10702 raft_consensus.cc:359] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.431949 10702 raft_consensus.cc:385] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.432305 10702 raft_consensus.cc:740] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.428725 10701 tablet_bootstrap.cc:492] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:18.432669 10417 raft_consensus.cc:2468] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:18.433285 10701 ts_tablet_manager.cc:1403] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.028s
I20260709 13:02:18.435801 10315 catalog_manager.cc:5697] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.437182 10702 consensus_queue.cc:260] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.438510 10455 leader_election.cc:304] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.439394 10673 raft_consensus.cc:2804] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.439909 10673 raft_consensus.cc:697] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:18.436309 10701 raft_consensus.cc:359] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.440806 10673 consensus_queue.cc:237] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.441620 10702 ts_tablet_manager.cc:1434] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:02:18.441308 10701 raft_consensus.cc:385] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.442519 10701 raft_consensus.cc:740] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.443390 10701 consensus_queue.cc:260] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.445626 10701 ts_tablet_manager.cc:1434] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:18.446638 10701 tablet_bootstrap.cc:492] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: Bootstrap starting.
I20260709 13:02:18.454613 10701 tablet_bootstrap.cc:654] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:18.459133 10566 raft_consensus.cc:2468] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 1.
I20260709 13:02:18.464638 10720 raft_consensus.cc:493] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.465281 10720 raft_consensus.cc:515] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.467537 10720 leader_election.cc:290] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.469000 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858c570fc8f141c8901de20bdc550223" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:18.469226 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858c570fc8f141c8901de20bdc550223" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.469836 10417 raft_consensus.cc:2468] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
I20260709 13:02:18.470224 10491 raft_consensus.cc:2468] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
I20260709 13:02:18.471596 10529 leader_election.cc:304] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.474483 10720 raft_consensus.cc:2804] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.474889 10720 raft_consensus.cc:493] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.475215 10720 raft_consensus.cc:3060] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.478832 10689 raft_consensus.cc:493] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.479641 10689 raft_consensus.cc:515] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.483804 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.484014 10720 raft_consensus.cc:515] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.484882 10491 raft_consensus.cc:2468] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.486766 10381 leader_election.cc:304] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.487202 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858c570fc8f141c8901de20bdc550223" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:18.487947 10417 raft_consensus.cc:3060] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.488480 10724 raft_consensus.cc:2804] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.489077 10724 raft_consensus.cc:493] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.489537 10724 raft_consensus.cc:3060] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.490196 10314 catalog_manager.cc:5697] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.491926 10314 catalog_manager.cc:5697] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.493664 10314 catalog_manager.cc:5697] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.494721 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.495735 10566 raft_consensus.cc:2468] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 0.
I20260709 13:02:18.496378 10689 leader_election.cc:290] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.499490 10720 leader_election.cc:290] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.495703 10417 raft_consensus.cc:2468] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:18.502786 10529 leader_election.cc:304] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.503679 10720 raft_consensus.cc:2804] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.504143 10720 raft_consensus.cc:697] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:18.504673 10724 raft_consensus.cc:515] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.504978 10720 consensus_queue.cc:237] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.507617 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.508291 10492 raft_consensus.cc:3060] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.500484 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858c570fc8f141c8901de20bdc550223" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.509235 10491 raft_consensus.cc:3060] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.497643 10712 raft_consensus.cc:493] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.510820 10712 raft_consensus.cc:515] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.513005 10712 leader_election.cc:290] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.514914 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.515280 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:18.516021 10417 raft_consensus.cc:2468] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 0.
W20260709 13:02:18.516440 10530 leader_election.cc:343] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:18.517273 10529 leader_election.cc:304] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.518165 10712 raft_consensus.cc:2804] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:18.518528 10712 raft_consensus.cc:493] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.518868 10712 raft_consensus.cc:3060] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.519054 10492 raft_consensus.cc:2468] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.520512 10724 leader_election.cc:290] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.521716 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.522385 10566 raft_consensus.cc:3060] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.525987 10701 tablet_bootstrap.cc:492] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: No bootstrap required, opened a new log
I20260709 13:02:18.526590 10701 ts_tablet_manager.cc:1403] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent bootstrapping tablet: real 0.080s	user 0.037s	sys 0.010s
I20260709 13:02:18.528687 10381 leader_election.cc:304] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.529982 10491 raft_consensus.cc:2468] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:18.529659 10712 raft_consensus.cc:515] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.530325 10724 raft_consensus.cc:2804] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.530665 10315 catalog_manager.cc:5697] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.532670 10724 raft_consensus.cc:697] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.532846 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:18.533656 10417 raft_consensus.cc:3060] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.533540 10701 raft_consensus.cc:359] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.534282 10701 raft_consensus.cc:385] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:18.534561 10701 raft_consensus.cc:740] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Initialized, Role: FOLLOWER
I20260709 13:02:18.535229 10701 consensus_queue.cc:260] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.535610 10566 raft_consensus.cc:2468] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 1.
I20260709 13:02:18.537371 10712 leader_election.cc:290] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.539018 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.539712 10491 raft_consensus.cc:3060] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.533629 10724 consensus_queue.cc:237] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.544625 10417 raft_consensus.cc:2468] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:18.545965 10529 leader_election.cc:304] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.547376 10712 raft_consensus.cc:2804] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:18.548555 10712 raft_consensus.cc:697] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:18.549500 10701 ts_tablet_manager.cc:1434] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:02:18.548048 10491 raft_consensus.cc:2468] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 1.
I20260709 13:02:18.550307 10712 consensus_queue.cc:237] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.559562 10315 catalog_manager.cc:5697] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.561195 10312 catalog_manager.cc:5697] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 0 to 1, leader changed from <none> to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.575388 10312 catalog_manager.cc:5697] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.628703 10491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
mode: GRACEFUL
new_leader_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:42734
I20260709 13:02:18.629223 10491 raft_consensus.cc:606] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Received request to transfer leadership to TS fefaaaebea574a5192fd4677ef758607
I20260709 13:02:18.634516 10566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
mode: GRACEFUL
new_leader_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:18.635145 10566 raft_consensus.cc:606] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Received request to transfer leadership to TS fefaaaebea574a5192fd4677ef758607
I20260709 13:02:18.637465 10724 raft_consensus.cc:493] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.638084 10724 raft_consensus.cc:515] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.640924 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058" is_pre_election: true
I20260709 13:02:18.641399 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.642577 10566 raft_consensus.cc:2393] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fefaaaebea574a5192fd4677ef758607 in current term 1: Already voted for candidate 7d60d9c59d0b44aab8d1d917232ce058 in this term.
I20260709 13:02:18.641222 10724 leader_election.cc:290] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.643555 10380 leader_election.cc:304] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381
I20260709 13:02:18.644378 10724 raft_consensus.cc:3060] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.646668 10566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "858c570fc8f141c8901de20bdc550223"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
mode: GRACEFUL
new_leader_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:18.647388 10566 raft_consensus.cc:606] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Received request to transfer leadership to TS fefaaaebea574a5192fd4677ef758607
I20260709 13:02:18.650908 10724 raft_consensus.cc:2749] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:18.653615 10417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:02:18.654223 10417 raft_consensus.cc:606] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.662875 10566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
mode: GRACEFUL
new_leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:59820
I20260709 13:02:18.663448 10566 raft_consensus.cc:606] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Received request to transfer leadership to TS 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.668857 10417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:02:18.669427 10417 raft_consensus.cc:606] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.675051 10417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:58022
I20260709 13:02:18.675558 10417 raft_consensus.cc:606] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 9b830c0afee44934ae266f52e630f381
I20260709 13:02:18.687111 10673 consensus_queue.cc:1048] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.698822 10696 consensus_queue.cc:1048] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:18.707981 10673 raft_consensus.cc:993] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: : Instructing follower fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:18.708458 10696 raft_consensus.cc:1081] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Signalling peer fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:18.710089 10417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:58010
I20260709 13:02:18.710580 10417 raft_consensus.cc:493] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.710855 10417 raft_consensus.cc:3060] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.715556 10417 raft_consensus.cc:515] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.717468 10417 leader_election.cc:290] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.718389 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.718603 10564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9811fff2b43a412a9fb6a993d88d2821" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.719094 10491 raft_consensus.cc:3055] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.719244 10564 raft_consensus.cc:3060] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.719473 10491 raft_consensus.cc:740] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:18.720433 10491 consensus_queue.cc:260] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.721769 10491 raft_consensus.cc:3060] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.727385 10564 raft_consensus.cc:2468] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:18.728595 10380 leader_election.cc:304] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:18.729406 10724 raft_consensus.cc:2804] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.729387 10491 raft_consensus.cc:2468] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:18.730195 10724 raft_consensus.cc:697] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.731081 10724 consensus_queue.cc:237] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.737912 10312 catalog_manager.cc:5697] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 1 to 2, leader changed from 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194) to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.750535 10689 consensus_queue.cc:1048] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.762185 10735 consensus_queue.cc:1048] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.861966 10673 raft_consensus.cc:493] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.862497 10673 raft_consensus.cc:515] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.864612 10673 leader_election.cc:290] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.865264 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefaaaebea574a5192fd4677ef758607" is_pre_election: true
I20260709 13:02:18.865918 10735 consensus_queue.cc:1048] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.866062 10564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b830c0afee44934ae266f52e630f381" is_pre_election: true
I20260709 13:02:18.866947 10564 raft_consensus.cc:2393] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d60d9c59d0b44aab8d1d917232ce058 in current term 1: Already voted for candidate fefaaaebea574a5192fd4677ef758607 in this term.
I20260709 13:02:18.867830 10455 leader_election.cc:304] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058; no voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607
I20260709 13:02:18.868619 10673 raft_consensus.cc:3060] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:18.875500 10673 raft_consensus.cc:2749] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:18.879630 10724 consensus_queue.cc:1048] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:18.889245 10720 consensus_queue.cc:1048] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.889613 10735 raft_consensus.cc:993] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: : Instructing follower 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:18.890138 10735 raft_consensus.cc:1081] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:18.893644 10712 consensus_queue.cc:1048] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.895318 10564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:59790
I20260709 13:02:18.896013 10564 raft_consensus.cc:493] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.896438 10564 raft_consensus.cc:3060] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.904433 10564 raft_consensus.cc:515] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.906663 10712 raft_consensus.cc:993] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: : Instructing follower fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:18.915573 10686 consensus_queue.cc:1048] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.916145 10720 raft_consensus.cc:1081] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Signalling peer fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:18.910933 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.917742 10492 raft_consensus.cc:3060] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.918167 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d99fa200de45c789c0fa6c57f9d40f" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:18.918788 10417 raft_consensus.cc:3055] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.919070 10417 raft_consensus.cc:740] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.919785 10417 consensus_queue.cc:260] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.920885 10417 raft_consensus.cc:3060] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.926224 10492 raft_consensus.cc:2468] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 2.
I20260709 13:02:18.927810 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "858c570fc8f141c8901de20bdc550223"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:57994
I20260709 13:02:18.928545 10416 raft_consensus.cc:493] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.928992 10416 raft_consensus.cc:3060] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.929611 10720 consensus_queue.cc:1048] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:18.914168 10564 leader_election.cc:290] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:18.932715 10530 leader_election.cc:304] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:18.937885 10720 raft_consensus.cc:2804] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.940996 10720 raft_consensus.cc:697] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 2 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:18.941948 10720 consensus_queue.cc:237] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.945363 10417 raft_consensus.cc:2468] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 2.
I20260709 13:02:18.939527 10416 raft_consensus.cc:515] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.950773 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858c570fc8f141c8901de20bdc550223" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.952328 10416 leader_election.cc:290] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.952675 10564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858c570fc8f141c8901de20bdc550223" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.953555 10686 raft_consensus.cc:993] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: : Instructing follower fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:18.956247 10564 raft_consensus.cc:3055] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.956868 10564 raft_consensus.cc:740] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:18.961061 10564 consensus_queue.cc:260] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.960188 10686 raft_consensus.cc:1081] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Signalling peer fefaaaebea574a5192fd4677ef758607 to start an election
I20260709 13:02:18.962384 10564 raft_consensus.cc:3060] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.963917 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
 from {username='slave'} at 127.0.0.1:57994
I20260709 13:02:18.964677 10416 raft_consensus.cc:493] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.964745 10724 consensus_queue.cc:1048] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:18.965101 10416 raft_consensus.cc:3060] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.970192 10564 raft_consensus.cc:2468] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:18.971879 10724 consensus_queue.cc:1048] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:18.976790 10380 leader_election.cc:304] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 7d60d9c59d0b44aab8d1d917232ce058
I20260709 13:02:18.977494 10416 raft_consensus.cc:515] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.978557 10724 raft_consensus.cc:2804] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.979122 10724 raft_consensus.cc:697] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:18.980321 10416 leader_election.cc:290] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:18.980003 10724 consensus_queue.cc:237] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.979417 10312 catalog_manager.cc:5697] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.984288 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:18.984951 10492 raft_consensus.cc:3060] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.986127 10563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c0f7704ba64ec2a07db9796e2bbbfe" candidate_uuid: "fefaaaebea574a5192fd4677ef758607" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:18.986908 10563 raft_consensus.cc:3055] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.987298 10563 raft_consensus.cc:740] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:18.988197 10563 consensus_queue.cc:260] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:18.989573 10563 raft_consensus.cc:3060] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.990381 10735 consensus_queue.cc:1048] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.992436 10315 catalog_manager.cc:5697] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 1 to 2, leader changed from 9b830c0afee44934ae266f52e630f381 (127.0.107.195) to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.995756 10673 consensus_queue.cc:1048] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:19.011785 10563 raft_consensus.cc:2468] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:19.013120 10380 leader_election.cc:304] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:19.014076 10673 consensus_queue.cc:1048] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:19.014629 10766 raft_consensus.cc:2804] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:19.015189 10724 consensus_queue.cc:1048] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:19.015395 10766 raft_consensus.cc:697] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Becoming Leader. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:19.017033 10766 consensus_queue.cc:237] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.061136 10492 raft_consensus.cc:2468] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fefaaaebea574a5192fd4677ef758607 in term 2.
I20260709 13:02:19.064648 10314 catalog_manager.cc:5697] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 reported cstate change: term changed from 1 to 2, leader changed from 9b830c0afee44934ae266f52e630f381 (127.0.107.195) to fefaaaebea574a5192fd4677ef758607 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fefaaaebea574a5192fd4677ef758607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.067485 10689 raft_consensus.cc:993] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: : Instructing follower 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:19.068066 10735 raft_consensus.cc:1081] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:19.072875 10689 raft_consensus.cc:993] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: : Instructing follower 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:19.073416 10766 raft_consensus.cc:1081] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:19.077780 10492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:42722
I20260709 13:02:19.078616 10491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:42722
I20260709 13:02:19.079185 10492 raft_consensus.cc:493] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:19.079716 10492 raft_consensus.cc:3060] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.079491 10491 raft_consensus.cc:493] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:19.080999 10491 raft_consensus.cc:3060] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.086755 10492 raft_consensus.cc:515] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.089100 10492 leader_election.cc:290] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:19.091305 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:19.091964 10416 raft_consensus.cc:3055] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:19.091946 10491 raft_consensus.cc:515] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.092764 10416 raft_consensus.cc:740] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:19.093770 10416 consensus_queue.cc:260] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.094841 10491 leader_election.cc:290] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:19.094954 10416 raft_consensus.cc:3060] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.096623 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7fc682fbf84a1baeee7cab59a4b1b1" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:19.097046 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:19.097244 10566 raft_consensus.cc:3060] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.097671 10417 raft_consensus.cc:3055] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:19.098016 10417 raft_consensus.cc:740] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:19.098758 10417 consensus_queue.cc:260] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.099825 10417 raft_consensus.cc:3060] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.104499 10566 raft_consensus.cc:2468] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:19.108021 10417 raft_consensus.cc:2468] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:19.113514 10455 leader_election.cc:304] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:19.116528 10673 raft_consensus.cc:2804] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:19.117053 10673 raft_consensus.cc:697] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:19.117722 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fffe7baa384b2988070ea389f55bad" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:19.118360 10566 raft_consensus.cc:3060] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.117879 10673 consensus_queue.cc:237] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.118652 10686 consensus_queue.cc:1048] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:19.119268 10455 leader_election.cc:304] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:19.120949 10696 raft_consensus.cc:2804] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:19.121429 10696 raft_consensus.cc:697] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:19.122179 10696 consensus_queue.cc:237] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.127086 10315 catalog_manager.cc:5697] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.130430 10416 raft_consensus.cc:2468] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:19.137712 10566 raft_consensus.cc:2468] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:19.142108 10712 raft_consensus.cc:993] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: : Instructing follower 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:19.143493 10712 raft_consensus.cc:1081] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Signalling peer 7d60d9c59d0b44aab8d1d917232ce058 to start an election
I20260709 13:02:19.147740 10312 catalog_manager.cc:5697] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.147816 10492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:02:19.148298 10764 consensus_queue.cc:1048] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:19.149351 10492 raft_consensus.cc:493] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:19.149760 10492 raft_consensus.cc:3060] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.161036 10492 raft_consensus.cc:515] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.163982 10492 leader_election.cc:290] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 9b830c0afee44934ae266f52e630f381 (127.0.107.195:43915)
I20260709 13:02:19.164572 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:19.167042 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d7a6678c0e4eff86f69e87f9aabb29" candidate_uuid: "7d60d9c59d0b44aab8d1d917232ce058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b830c0afee44934ae266f52e630f381"
I20260709 13:02:19.167647 10566 raft_consensus.cc:3055] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:19.167964 10566 raft_consensus.cc:740] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:19.168748 10566 consensus_queue.cc:260] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.169817 10566 raft_consensus.cc:3060] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.177269 10566 raft_consensus.cc:2468] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d60d9c59d0b44aab8d1d917232ce058 in term 2.
I20260709 13:02:19.178251 10455 leader_election.cc:304] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: fefaaaebea574a5192fd4677ef758607
I20260709 13:02:19.178974 10673 raft_consensus.cc:2804] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:19.179471 10673 raft_consensus.cc:697] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Leader. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:19.180276 10673 consensus_queue.cc:237] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:19.187168 10314 catalog_manager.cc:5697] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 reported cstate change: term changed from 1 to 2, leader changed from 9b830c0afee44934ae266f52e630f381 (127.0.107.195) to 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7d60d9c59d0b44aab8d1d917232ce058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:19.215586 10492 raft_consensus.cc:1275] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.217058 10734 consensus_queue.cc:1048] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.229969 10566 raft_consensus.cc:1275] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.231184 10689 consensus_queue.cc:1048] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.428954 10492 raft_consensus.cc:3060] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.434777 10492 raft_consensus.cc:1275] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.436188 10689 consensus_queue.cc:1048] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.444311 10566 raft_consensus.cc:1275] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.445894 10734 consensus_queue.cc:1048] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:19.465878 10416 raft_consensus.cc:1275] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.467223 10764 consensus_queue.cc:1048] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.475162 10492 raft_consensus.cc:1275] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.476904 10686 consensus_queue.cc:1048] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.537986 10492 raft_consensus.cc:1275] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.539387 10734 consensus_queue.cc:1048] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.547233 10566 raft_consensus.cc:1275] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer fefaaaebea574a5192fd4677ef758607: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.549259 10766 consensus_queue.cc:1048] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.604089 10416 raft_consensus.cc:3060] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.609726 10416 raft_consensus.cc:1275] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.610186 10417 raft_consensus.cc:1275] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.611004 10696 consensus_queue.cc:1048] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:19.611536 10673 consensus_queue.cc:1048] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.623466 10566 raft_consensus.cc:1275] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.623756 10564 raft_consensus.cc:1275] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.629444 10723 consensus_queue.cc:1048] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.630277 10774 consensus_queue.cc:1048] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:19.662950 10417 raft_consensus.cc:1275] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.664251 10774 consensus_queue.cc:1048] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:19.672278 10566 raft_consensus.cc:1275] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Refusing update from remote peer 7d60d9c59d0b44aab8d1d917232ce058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:19.673929 10774 consensus_queue.cc:1048] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.678783 10312 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40302:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:21.698618 10312 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40302:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:21.831501   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:21.850076 10381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43023, user_credentials={real_user=slave}} blocked reactor thread for 47476.6us
W20260709 13:02:21.904217 10789 log.cc:927] Time spent T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:02:21.949203 10820 tablet.cc:1724] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:21.977212 10827 tablet.cc:1724] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:21.982014 10826 tablet.cc:1724] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.024827 10820 tablet.cc:1724] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:22.034719 10799 log.cc:927] Time spent T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: Append to log took a long time: real 0.147s	user 0.002s	sys 0.002s
I20260709 13:02:22.065189 10835 tablet.cc:1724] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.069782 10828 tablet.cc:1724] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.071447 10829 tablet.cc:1724] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.015930 10825 tablet.cc:1724] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.120267 10832 tablet.cc:1724] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.133435 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec"
dest_uuid: "fefaaaebea574a5192fd4677ef758607"
mode: GRACEFUL
new_leader_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:43074
I20260709 13:02:22.134384 10416 raft_consensus.cc:606] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Received request to transfer leadership to TS 9b830c0afee44934ae266f52e630f381
I20260709 13:02:22.167166 10843 tablet.cc:1724] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:22.221020 10833 log.cc:927] Time spent T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:02:22.223206 10842 log.cc:927] Time spent T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 13:02:22.129382 10827 tablet.cc:1724] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.242473 10735 raft_consensus.cc:993] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: : Instructing follower 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:22.243502 10795 raft_consensus.cc:1081] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Signalling peer 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:22.246184 10825 tablet.cc:1724] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.250878 10820 tablet.cc:1724] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.235798 10828 tablet.cc:1724] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.256971 10560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:59790
I20260709 13:02:22.257696 10560 raft_consensus.cc:493] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.258088 10560 raft_consensus.cc:3060] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.260038 10846 tablet.cc:1724] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:22.268167 10834 log.cc:927] Time spent T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:02:22.269675 10835 tablet.cc:1724] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.274008 10841 tablet.cc:1724] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.297422 10848 tablet.cc:1724] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.298666 10826 tablet.cc:1724] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.306245 10490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160"
dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
mode: GRACEFUL
new_leader_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:55334
I20260709 13:02:22.307035 10490 raft_consensus.cc:606] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Received request to transfer leadership to TS 9b830c0afee44934ae266f52e630f381
I20260709 13:02:22.311316   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:22.311965   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:22.316381 10829 tablet.cc:1724] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.326355 10832 tablet.cc:1724] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.333223 10829 tablet.cc:1724] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.314248 10841 tablet.cc:1724] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.348639 10820 tablet.cc:1724] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.331851 10560 raft_consensus.cc:515] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:22.358448 10560 leader_election.cc:290] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 2 election: Requested vote from peers 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023), fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905)
I20260709 13:02:22.359596 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:22.360354 10416 raft_consensus.cc:3055] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:22.360647 10416 raft_consensus.cc:740] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fefaaaebea574a5192fd4677ef758607, State: Running, Role: LEADER
I20260709 13:02:22.359635 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac3e53127c467b8d1f57c16ed853ec" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:22.362020 10491 raft_consensus.cc:3060] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.361397 10846 tablet.cc:1724] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.363883 10841 tablet.cc:1724] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.366552 10416 consensus_queue.cc:260] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:22.367848 10416 raft_consensus.cc:3060] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.370847 10491 raft_consensus.cc:2468] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 2.
I20260709 13:02:22.376344 10416 raft_consensus.cc:2468] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 2.
I20260709 13:02:22.376775 10530 leader_election.cc:304] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d60d9c59d0b44aab8d1d917232ce058, 9b830c0afee44934ae266f52e630f381; no voters: 
I20260709 13:02:22.378790 10838 raft_consensus.cc:2804] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:22.379277 10838 raft_consensus.cc:697] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 2 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:22.380067 10838 consensus_queue.cc:237] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:22.384097 10835 tablet.cc:1724] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:22.419112 10314 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc: soft_deleted_table [id=104190cd1b3d4d3e923612a9da7e9313] alter complete (version 1)
I20260709 13:02:22.428084 10312 catalog_manager.cc:5697] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 1 to 2, leader changed from fefaaaebea574a5192fd4677ef758607 (127.0.107.193) to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.797220 10490 raft_consensus.cc:1275] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:22.798931 10840 consensus_queue.cc:1048] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:22.815268 10415 raft_consensus.cc:1275] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:22.816927 10838 consensus_queue.cc:1048] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:22.830888 10780 raft_consensus.cc:993] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: : Instructing follower 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:22.831593 10780 raft_consensus.cc:1081] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Signalling peer 9b830c0afee44934ae266f52e630f381 to start an election
I20260709 13:02:22.833537 10560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160"
dest_uuid: "9b830c0afee44934ae266f52e630f381"
 from {username='slave'} at 127.0.0.1:59804
I20260709 13:02:22.834426 10560 raft_consensus.cc:493] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.834831 10560 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.844501 10560 raft_consensus.cc:515] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:22.846413 10560 leader_election.cc:290] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 3 election: Requested vote from peers fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905), 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023)
I20260709 13:02:22.847582 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fefaaaebea574a5192fd4677ef758607"
I20260709 13:02:22.847630 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7891a8e1aaf4854b11501a249c88160" candidate_uuid: "9b830c0afee44934ae266f52e630f381" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d60d9c59d0b44aab8d1d917232ce058"
I20260709 13:02:22.848757 10415 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.848757 10490 raft_consensus.cc:3055] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:22.849251 10490 raft_consensus.cc:740] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d60d9c59d0b44aab8d1d917232ce058, State: Running, Role: LEADER
I20260709 13:02:22.850404 10490 consensus_queue.cc:260] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:22.852056 10490 raft_consensus.cc:3060] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.859181 10415 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 3.
I20260709 13:02:22.860832 10529 leader_election.cc:304] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b830c0afee44934ae266f52e630f381, fefaaaebea574a5192fd4677ef758607; no voters: 
I20260709 13:02:22.861692 10838 raft_consensus.cc:2804] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:22.861897 10490 raft_consensus.cc:2468] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b830c0afee44934ae266f52e630f381 in term 3.
I20260709 13:02:22.862099 10838 raft_consensus.cc:697] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 3 LEADER]: Becoming Leader. State: Replica: 9b830c0afee44934ae266f52e630f381, State: Running, Role: LEADER
I20260709 13:02:22.863440 10838 consensus_queue.cc:237] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } }
I20260709 13:02:22.871683 10312 catalog_manager.cc:5697] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 reported cstate change: term changed from 2 to 3, leader changed from 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194) to 9b830c0afee44934ae266f52e630f381 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9b830c0afee44934ae266f52e630f381" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b830c0afee44934ae266f52e630f381" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43915 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.358475 10415 raft_consensus.cc:1275] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 3 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.359900 10840 consensus_queue.cc:1048] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefaaaebea574a5192fd4677ef758607" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.380492 10490 raft_consensus.cc:1275] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 3 FOLLOWER]: Refusing update from remote peer 9b830c0afee44934ae266f52e630f381: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.382318 10838 consensus_queue.cc:1048] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d60d9c59d0b44aab8d1d917232ce058" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.396694   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:23.435814   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:23.436776   431 tablet_replica.cc:333] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.437870   431 raft_consensus.cc:2243] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.438463   431 raft_consensus.cc:2272] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.441619   431 tablet_replica.cc:333] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.442401   431 raft_consensus.cc:2243] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.442962   431 raft_consensus.cc:2272] T b8824884fcd346a4bdd6fe6ce338d855 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.445497   431 tablet_replica.cc:333] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.446163   431 raft_consensus.cc:2243] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.447158   431 raft_consensus.cc:2272] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.449801   431 tablet_replica.cc:333] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.450448   431 raft_consensus.cc:2243] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.451279   431 raft_consensus.cc:2272] T 9811fff2b43a412a9fb6a993d88d2821 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.453963   431 tablet_replica.cc:333] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.454509   431 raft_consensus.cc:2243] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.455381   431 raft_consensus.cc:2272] T 858c570fc8f141c8901de20bdc550223 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.457537 10529 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:02:23.459081   431 tablet_replica.cc:333] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.459929   431 raft_consensus.cc:2243] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.460753   431 raft_consensus.cc:2272] T 94d7a6678c0e4eff86f69e87f9aabb29 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.461297 10529 consensus_peers.cc:597] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 -> Peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Couldn't send request to peer fefaaaebea574a5192fd4677ef758607. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.463560   431 tablet_replica.cc:333] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.464396   431 raft_consensus.cc:2243] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.464850   431 raft_consensus.cc:2272] T cccadc9a2dcf42f78928b8c65d22c325 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.467471   431 tablet_replica.cc:333] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.468088   431 raft_consensus.cc:2243] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.468657   431 raft_consensus.cc:2272] T f00b68caa2554546a3394e5cd2987252 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.470979   431 tablet_replica.cc:333] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.471626   431 raft_consensus.cc:2243] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.472128   431 raft_consensus.cc:2272] T 36fffe7baa384b2988070ea389f55bad P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.474578   431 tablet_replica.cc:333] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.475294   431 raft_consensus.cc:2243] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.475862   431 raft_consensus.cc:2272] T 40ac3e53127c467b8d1f57c16ed853ec P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.479231   431 tablet_replica.cc:333] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.479781   431 raft_consensus.cc:2243] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.480296   431 raft_consensus.cc:2272] T 063fe6f11c37465587328a4bcd2a2e06 P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.482585   431 tablet_replica.cc:333] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.483134   431 raft_consensus.cc:2243] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.483580   431 raft_consensus.cc:2272] T b243ff0baebd41938163c175369ea41e P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.486112   431 tablet_replica.cc:333] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.486583   431 raft_consensus.cc:2243] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.487197   431 raft_consensus.cc:2272] T f9d99fa200de45c789c0fa6c57f9d40f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.490221   431 tablet_replica.cc:333] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.491070   431 raft_consensus.cc:2243] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.491690   431 raft_consensus.cc:2272] T d7891a8e1aaf4854b11501a249c88160 P fefaaaebea574a5192fd4677ef758607 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.494014 10455 consensus_peers.cc:597] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 -> Peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Couldn't send request to peer fefaaaebea574a5192fd4677ef758607. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.495219   431 tablet_replica.cc:333] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.495941   431 raft_consensus.cc:2243] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.496863   431 raft_consensus.cc:2272] T d4c0f7704ba64ec2a07db9796e2bbbfe P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.499228   431 tablet_replica.cc:333] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.499720   431 raft_consensus.cc:2243] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.500567   431 raft_consensus.cc:2272] T c12d1f7470184381b693f2b8211e693f P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.503010   431 tablet_replica.cc:333] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.503508   431 raft_consensus.cc:2243] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.504441   431 raft_consensus.cc:2272] T 298b72b24c3244629049a873bd831bf8 P fefaaaebea574a5192fd4677ef758607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.506798   431 tablet_replica.cc:333] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607: stopping tablet replica
I20260709 13:02:23.507426   431 raft_consensus.cc:2243] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.508327   431 raft_consensus.cc:2272] T aca8ba33c6244956886ae26068d4863f P fefaaaebea574a5192fd4677ef758607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.543165   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:23.586720   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:23.615195   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:23.615938   431 tablet_replica.cc:333] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.616752   431 raft_consensus.cc:2243] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.617707   431 raft_consensus.cc:2272] T 36fffe7baa384b2988070ea389f55bad P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.620079   431 tablet_replica.cc:333] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.620777   431 raft_consensus.cc:2243] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.621928   431 raft_consensus.cc:2272] T b8824884fcd346a4bdd6fe6ce338d855 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.626416   431 tablet_replica.cc:333] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.627382   431 raft_consensus.cc:2243] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.628628   431 raft_consensus.cc:2272] T 94d7a6678c0e4eff86f69e87f9aabb29 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.628929 10529 consensus_peers.cc:597] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 -> Peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Couldn't send request to peer fefaaaebea574a5192fd4677ef758607. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.631067   431 tablet_replica.cc:333] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.631819   431 raft_consensus.cc:2243] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.632376   431 raft_consensus.cc:2272] T 858c570fc8f141c8901de20bdc550223 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.634630   431 tablet_replica.cc:333] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.635210   431 raft_consensus.cc:2243] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.635758   431 raft_consensus.cc:2272] T 9811fff2b43a412a9fb6a993d88d2821 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.638193   431 tablet_replica.cc:333] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.638765   431 raft_consensus.cc:2243] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.639575   431 raft_consensus.cc:2272] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.642131   431 tablet_replica.cc:333] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.642711   431 raft_consensus.cc:2243] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.643246   431 raft_consensus.cc:2272] T aca8ba33c6244956886ae26068d4863f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.645608   431 tablet_replica.cc:333] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.646179   431 raft_consensus.cc:2243] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.646665   431 raft_consensus.cc:2272] T c12d1f7470184381b693f2b8211e693f P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.648931   431 tablet_replica.cc:333] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.649551   431 raft_consensus.cc:2243] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.650107   431 raft_consensus.cc:2272] T d4c0f7704ba64ec2a07db9796e2bbbfe P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.652454   431 tablet_replica.cc:333] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.653095   431 raft_consensus.cc:2243] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.653568   431 raft_consensus.cc:2272] T 298b72b24c3244629049a873bd831bf8 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.655766   431 tablet_replica.cc:333] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.656317   431 raft_consensus.cc:2243] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.656749   431 raft_consensus.cc:2272] T 40ac3e53127c467b8d1f57c16ed853ec P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.659418   431 tablet_replica.cc:333] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.660022   431 raft_consensus.cc:2243] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.660544   431 raft_consensus.cc:2272] T 063fe6f11c37465587328a4bcd2a2e06 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.662756   431 tablet_replica.cc:333] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.663280   431 raft_consensus.cc:2243] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.663684   431 raft_consensus.cc:2272] T d7891a8e1aaf4854b11501a249c88160 P 7d60d9c59d0b44aab8d1d917232ce058 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.667136   431 tablet_replica.cc:333] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.667920   431 raft_consensus.cc:2243] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.668664   431 raft_consensus.cc:2272] T f9d99fa200de45c789c0fa6c57f9d40f P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.671367 10530 consensus_peers.cc:597] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 -> Peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Couldn't send request to peer 7d60d9c59d0b44aab8d1d917232ce058. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.672425   431 tablet_replica.cc:333] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.673070   431 raft_consensus.cc:2243] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.673976   431 raft_consensus.cc:2272] T cccadc9a2dcf42f78928b8c65d22c325 P 7d60d9c59d0b44aab8d1d917232ce058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.676389   431 tablet_replica.cc:333] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.676893   431 raft_consensus.cc:2243] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.677791   431 raft_consensus.cc:2272] T f00b68caa2554546a3394e5cd2987252 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.679986   431 tablet_replica.cc:333] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.680533   431 raft_consensus.cc:2243] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.681393   431 raft_consensus.cc:2272] T b243ff0baebd41938163c175369ea41e P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.683660   431 tablet_replica.cc:333] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058: stopping tablet replica
I20260709 13:02:23.684134   431 raft_consensus.cc:2243] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.684686   431 raft_consensus.cc:2272] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 7d60d9c59d0b44aab8d1d917232ce058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.726220   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:23.736142 10529 consensus_peers.cc:597] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 -> Peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Couldn't send request to peer fefaaaebea574a5192fd4677ef758607. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.768515 10530 consensus_peers.cc:597] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 -> Peer 7d60d9c59d0b44aab8d1d917232ce058 (127.0.107.194:43023): Couldn't send request to peer 7d60d9c59d0b44aab8d1d917232ce058. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.769387   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:23.800912   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:23.801607   431 tablet_replica.cc:333] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.802302   431 raft_consensus.cc:2243] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.802871   431 raft_consensus.cc:2272] T 5e7fc682fbf84a1baeee7cab59a4b1b1 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.805248   431 tablet_replica.cc:333] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.805878   431 raft_consensus.cc:2243] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.806394   431 raft_consensus.cc:2272] T b8824884fcd346a4bdd6fe6ce338d855 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.808862   431 tablet_replica.cc:333] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.809434   431 raft_consensus.cc:2243] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.810006   431 raft_consensus.cc:2272] T 858c570fc8f141c8901de20bdc550223 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.812628   431 tablet_replica.cc:333] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
W20260709 13:02:23.812832 10529 consensus_peers.cc:597] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 -> Peer fefaaaebea574a5192fd4677ef758607 (127.0.107.193:42905): Couldn't send request to peer fefaaaebea574a5192fd4677ef758607. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.813532   431 raft_consensus.cc:2243] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.814378   431 raft_consensus.cc:2272] T 94d7a6678c0e4eff86f69e87f9aabb29 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.816710   431 tablet_replica.cc:333] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.817199   431 raft_consensus.cc:2243] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.817607   431 raft_consensus.cc:2272] T 9811fff2b43a412a9fb6a993d88d2821 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.819682   431 tablet_replica.cc:333] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.820194   431 raft_consensus.cc:2243] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.820663   431 raft_consensus.cc:2272] T c6300b3b0c8c4af3a2ae2e4da3fd8841 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.822765   431 tablet_replica.cc:333] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.823383   431 raft_consensus.cc:2243] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.823866   431 raft_consensus.cc:2272] T 36fffe7baa384b2988070ea389f55bad P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.826166   431 tablet_replica.cc:333] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.826902   431 raft_consensus.cc:2243] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.827662   431 raft_consensus.cc:2272] T 40ac3e53127c467b8d1f57c16ed853ec P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.830708   431 tablet_replica.cc:333] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.831444   431 raft_consensus.cc:2243] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.832314   431 raft_consensus.cc:2272] T 063fe6f11c37465587328a4bcd2a2e06 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.834554   431 tablet_replica.cc:333] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.835052   431 raft_consensus.cc:2243] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.835456   431 raft_consensus.cc:2272] T cccadc9a2dcf42f78928b8c65d22c325 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.837714   431 tablet_replica.cc:333] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.838307   431 raft_consensus.cc:2243] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.838723   431 raft_consensus.cc:2272] T b243ff0baebd41938163c175369ea41e P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.840842   431 tablet_replica.cc:333] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.841339   431 raft_consensus.cc:2243] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.842198   431 raft_consensus.cc:2272] T f9d99fa200de45c789c0fa6c57f9d40f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.844214   431 tablet_replica.cc:333] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.844779   431 raft_consensus.cc:2243] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.845510   431 raft_consensus.cc:2272] T d7891a8e1aaf4854b11501a249c88160 P 9b830c0afee44934ae266f52e630f381 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.848486   431 tablet_replica.cc:333] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.848968   431 raft_consensus.cc:2243] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.849426   431 raft_consensus.cc:2272] T d4c0f7704ba64ec2a07db9796e2bbbfe P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.851459   431 tablet_replica.cc:333] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.851917   431 raft_consensus.cc:2243] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.852413   431 raft_consensus.cc:2272] T c12d1f7470184381b693f2b8211e693f P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.854455   431 tablet_replica.cc:333] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.854959   431 raft_consensus.cc:2243] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.855418   431 raft_consensus.cc:2272] T 298b72b24c3244629049a873bd831bf8 P 9b830c0afee44934ae266f52e630f381 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.857414   431 tablet_replica.cc:333] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.857903   431 raft_consensus.cc:2243] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.858325   431 raft_consensus.cc:2272] T aca8ba33c6244956886ae26068d4863f P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.860574   431 tablet_replica.cc:333] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381: stopping tablet replica
I20260709 13:02:23.861074   431 raft_consensus.cc:2243] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.861563   431 raft_consensus.cc:2272] T f00b68caa2554546a3394e5cd2987252 P 9b830c0afee44934ae266f52e630f381 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.902403   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:23.937930   431 master.cc:562] Master@127.0.107.254:35559 shutting down...
I20260709 13:02:23.957940   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.958565   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.958993   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P ae314f7449d04b5c9724026a3b5470dc: stopping tablet replica
I20260709 13:02:23.980496   431 master.cc:584] Master@127.0.107.254:35559 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11133 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23894 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (279600 ms total)
[  PASSED  ] 8 tests.
I20260709 13:02:24.038049   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 410 messages since previous log ~467 seconds ago
I20260709 13:02:24.038309   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 410 messages since previous log ~467 seconds ago
I20260709 13:02:24.038515   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 407 messages since previous log ~467 seconds ago
I20260709 13:02:24.038733   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:02:24.038926   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:02:24.039147   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~116 seconds ago
I20260709 13:02:24.039345   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 1 messages since previous log ~200 seconds ago
I20260709 13:02:24.039621   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:02:24.039914   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
